[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:46:27 dist-test-slave-8tdl krb5kdc[8356](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:46:27 dist-test-slave-8tdl krb5kdc[8356](info): set up 2 sockets
Aug 08 15:46:27 dist-test-slave-8tdl krb5kdc[8356](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 15:46:28.144599 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.074s user 0.008s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:46:28 dist-test-slave-8tdl krb5kdc[8356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203988, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:46:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:46:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:46:28.276695 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:37293
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:37197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:37293
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:28.394234 8369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:28.394552 8369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:28.394634 8369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:28.398852 8369 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:46:28.398962 8369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:28.398998 8369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:28.399051 8369 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:46:28.399106 8369 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:46:28.404647 8369 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:37197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:37293
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:37293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8369
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:28.405860 8369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:28.407011 8369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:28.416208 8375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:28.416213 8378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:28.416230 8376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:28.416419 8369 server_base.cc:1034] running on GCE node
I20260808 15:46:28.417100 8369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:28.418315 8369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:28.419515 8369 hybrid_clock.cc:648] HybridClock initialized: now 1786203988419454 us; error 85 us; skew 500 ppm
Aug 08 15:46:28 dist-test-slave-8tdl krb5kdc[8356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203988, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:28.422415 8369 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:46:28.423430 8369 webserver.cc:460] Webserver started at http://127.8.39.126:44831/ using document root <none> and password file <none>
I20260808 15:46:28.424032 8369 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:28.424129 8369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:28.424365 8369 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:28.426494 8369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "81278ffb3be3454698e7caf9caa07b6f"
format_stamp: "Formatted at 2026-08-08 15:46:28 on dist-test-slave-8tdl"
server_key: "3caf35df87976d249e35d3b8070f8cca"
server_key_iv: "939a6b036269c9248f444d240cc622be"
server_key_version: "encryptionkey@0"
I20260808 15:46:28.427137 8369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "81278ffb3be3454698e7caf9caa07b6f"
format_stamp: "Formatted at 2026-08-08 15:46:28 on dist-test-slave-8tdl"
server_key: "3caf35df87976d249e35d3b8070f8cca"
server_key_iv: "939a6b036269c9248f444d240cc622be"
server_key_version: "encryptionkey@0"
I20260808 15:46:28.431164 8369 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 15:46:28.433717 8385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:28.435163 8369 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:46:28.435313 8369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "81278ffb3be3454698e7caf9caa07b6f"
format_stamp: "Formatted at 2026-08-08 15:46:28 on dist-test-slave-8tdl"
server_key: "3caf35df87976d249e35d3b8070f8cca"
server_key_iv: "939a6b036269c9248f444d240cc622be"
server_key_version: "encryptionkey@0"
I20260808 15:46:28.435437 8369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:28.446799 8369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:28.450354 8369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:28.450618 8369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:28.458467 8369 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:37293
I20260808 15:46:28.458506 8440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:37293 every 8 connection(s)
I20260808 15:46:28.459563 8369 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:46:28.462566 8441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:28.464567 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 8369
I20260808 15:46:28.464746 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:46:28.466598 8349 external_mini_cluster.cc:1428] Setting key 16851ff5adbd470eb41ff9922d25a6e0
I20260808 15:46:28.470587 8441 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81278ffb3be3454698e7caf9caa07b6f: Bootstrap starting.
I20260808 15:46:28.473748 8441 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 81278ffb3be3454698e7caf9caa07b6f: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:28.474769 8441 log.cc:824] T 00000000000000000000000000000000 P 81278ffb3be3454698e7caf9caa07b6f: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:28.477082 8441 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81278ffb3be3454698e7caf9caa07b6f: No bootstrap required, opened a new log
I20260808 15:46:28.482432 8441 raft_consensus.cc:348] T 00000000000000000000000000000000 P 81278ffb3be3454698e7caf9caa07b6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81278ffb3be3454698e7caf9caa07b6f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 37293 } }
I20260808 15:46:28.482764 8441 raft_consensus.cc:374] T 00000000000000000000000000000000 P 81278ffb3be3454698e7caf9caa07b6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:28.482879 8441 raft_consensus.cc:729] T 00000000000000000000000000000000 P 81278ffb3be3454698e7caf9caa07b6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81278ffb3be3454698e7caf9caa07b6f, State: Initialized, Role: FOLLOWER
I20260808 15:46:28.483461 8441 consensus_queue.cc:260] T 00000000000000000000000000000000 P 81278ffb3be3454698e7caf9caa07b6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81278ffb3be3454698e7caf9caa07b6f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 37293 } }
I20260808 15:46:28.483629 8441 raft_consensus.cc:388] T 00000000000000000000000000000000 P 81278ffb3be3454698e7caf9caa07b6f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:46:28.483695 8441 raft_consensus.cc:482] T 00000000000000000000000000000000 P 81278ffb3be3454698e7caf9caa07b6f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:46:28.483801 8441 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 81278ffb3be3454698e7caf9caa07b6f [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:28.485234 8441 raft_consensus.cc:504] T 00000000000000000000000000000000 P 81278ffb3be3454698e7caf9caa07b6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81278ffb3be3454698e7caf9caa07b6f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 37293 } }
I20260808 15:46:28.485613 8441 leader_election.cc:302] T 00000000000000000000000000000000 P 81278ffb3be3454698e7caf9caa07b6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 81278ffb3be3454698e7caf9caa07b6f; no voters:
I20260808 15:46:28.485967 8441 leader_election.cc:288] T 00000000000000000000000000000000 P 81278ffb3be3454698e7caf9caa07b6f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:46:28.486101 8447 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 81278ffb3be3454698e7caf9caa07b6f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:28.486320 8447 raft_consensus.cc:686] T 00000000000000000000000000000000 P 81278ffb3be3454698e7caf9caa07b6f [term 1 LEADER]: Becoming Leader. State: Replica: 81278ffb3be3454698e7caf9caa07b6f, State: Running, Role: LEADER
I20260808 15:46:28.486711 8447 consensus_queue.cc:237] T 00000000000000000000000000000000 P 81278ffb3be3454698e7caf9caa07b6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81278ffb3be3454698e7caf9caa07b6f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 37293 } }
I20260808 15:46:28.487416 8441 sys_catalog.cc:564] T 00000000000000000000000000000000 P 81278ffb3be3454698e7caf9caa07b6f [sys.catalog]: configured and running, proceeding with master startup.
Aug 08 15:46:28 dist-test-slave-8tdl krb5kdc[8356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203988, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:28.488308 8449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81278ffb3be3454698e7caf9caa07b6f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 81278ffb3be3454698e7caf9caa07b6f. Latest consensus state: current_term: 1 leader_uuid: "81278ffb3be3454698e7caf9caa07b6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81278ffb3be3454698e7caf9caa07b6f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 37293 } } }
I20260808 15:46:28.488464 8449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81278ffb3be3454698e7caf9caa07b6f [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:28.488723 8448 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81278ffb3be3454698e7caf9caa07b6f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "81278ffb3be3454698e7caf9caa07b6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81278ffb3be3454698e7caf9caa07b6f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 37293 } } }
I20260808 15:46:28.488831 8448 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81278ffb3be3454698e7caf9caa07b6f [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:28.491484 8451 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:46:28.495077 8451 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:46:28.496735 8444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:28.470802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38640 (local address 127.8.39.126:37293)
0808 15:46:28.471365 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:28.471386 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:28.472491 (+ 1105us) server_negotiation.cc:407] Connection header received
0808 15:46:28.476926 (+ 4435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:28.476940 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:28.477286 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:28.477543 (+ 257us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:28.480706 (+ 3163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:28.481652 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:28.483426 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:28.484222 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:28.484409 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:28.489671 (+ 5262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:28.489679 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:28.489700 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:28.489742 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:28.492526 (+ 2784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:28.493339 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:28.493346 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:28.493352 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:28.493543 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:28.493954 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:28.493958 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:28.493960 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:28.494382 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:28.494622 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:28.495305 (+ 683us) server_negotiation.cc:299] Negotiation successful
0808 15:46:28.495612 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":159,"threads_started":1}
I20260808 15:46:28.501560 8451 catalog_manager.cc:1347] Generated new cluster ID: 6c04cb8b939f414681fee8f5fd661115
I20260808 15:46:28.501629 8451 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:46:28.520766 8451 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:46:28.521739 8451 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:46:28.528673 8451 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 81278ffb3be3454698e7caf9caa07b6f: Generated new TSK 0
I20260808 15:46:28.529470 8451 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.39.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
I20260808 15:46:28.573855 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:0
--local_ip_for_outbound_sockets=127.8.39.65
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:37293
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:37197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:28.732853 8471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:28.733129 8471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:28.733206 8471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:28.737335 8471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:28.737417 8471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:28.737516 8471 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:46:28.743213 8471 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:37197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:37293
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8471
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:28.744359 8471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:28.745530 8471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:28.755596 8477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:28.755580 8476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:28.755824 8471 server_base.cc:1034] running on GCE node
W20260808 15:46:28.755585 8479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:28.756407 8471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:28.757079 8471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:28.758285 8471 hybrid_clock.cc:648] HybridClock initialized: now 1786203988758269 us; error 26 us; skew 500 ppm
Aug 08 15:46:28 dist-test-slave-8tdl krb5kdc[8356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203988, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:28.761281 8471 init.cc:377] Logged in from keytab as kudu/127.8.39.65@KRBTEST.COM (short username kudu)
I20260808 15:46:28.762312 8471 webserver.cc:460] Webserver started at http://127.8.39.65:46445/ using document root <none> and password file <none>
I20260808 15:46:28.762979 8471 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:28.763074 8471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:28.763331 8471 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:28.765600 8471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-0/data/instance:
uuid: "a6849d8792334c70b7a1b8e940a0e555"
format_stamp: "Formatted at 2026-08-08 15:46:28 on dist-test-slave-8tdl"
server_key: "98d4abf25de1bf10dcaa508f746c82a0"
server_key_iv: "577f34bdb77d486674c86cb984e1a77f"
server_key_version: "encryptionkey@0"
I20260808 15:46:28.766245 8471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance:
uuid: "a6849d8792334c70b7a1b8e940a0e555"
format_stamp: "Formatted at 2026-08-08 15:46:28 on dist-test-slave-8tdl"
server_key: "98d4abf25de1bf10dcaa508f746c82a0"
server_key_iv: "577f34bdb77d486674c86cb984e1a77f"
server_key_version: "encryptionkey@0"
I20260808 15:46:28.770903 8471 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260808 15:46:28.773737 8487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:28.775058 8471 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:46:28.775207 8471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "a6849d8792334c70b7a1b8e940a0e555"
format_stamp: "Formatted at 2026-08-08 15:46:28 on dist-test-slave-8tdl"
server_key: "98d4abf25de1bf10dcaa508f746c82a0"
server_key_iv: "577f34bdb77d486674c86cb984e1a77f"
server_key_version: "encryptionkey@0"
I20260808 15:46:28.775331 8471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:28.792271 8471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:28.796049 8471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:28.796335 8471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:28.797070 8471 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:46:28.798032 8471 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:28.798110 8471 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:28.798192 8471 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:28.798240 8471 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:28.809394 8471 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:40313
I20260808 15:46:28.809417 8605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:40313 every 8 connection(s)
I20260808 15:46:28.810432 8471 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:46:28.813076 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 8471
I20260808 15:46:28.813205 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance
I20260808 15:46:28.813491 8349 external_mini_cluster.cc:1428] Setting key b2fe81d877cb953af6807aa55e46a88a
Aug 08 15:46:28 dist-test-slave-8tdl krb5kdc[8356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203988, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.39.66@KRBTEST.COM; defaulting to no policy
I20260808 15:46:28.826136 8444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:28.812430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:47201 (local address 127.8.39.126:37293)
0808 15:46:28.812573 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:28.812576 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:28.813652 (+ 1076us) server_negotiation.cc:407] Connection header received
0808 15:46:28.815403 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:28.815406 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:28.815459 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:28.815540 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:28.816756 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:28.817410 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:28.818721 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:28.819190 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:28.819321 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:28.821872 (+ 2551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:28.821878 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:28.821885 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:28.821925 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:28.823760 (+ 1835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:28.824327 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:28.824331 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:28.824335 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:28.824446 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:28.824803 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:28.824806 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:28.824808 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:28.825084 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:28.825198 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:28.825779 (+ 581us) server_negotiation.cc:299] Negotiation successful
0808 15:46:28.825914 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 15:46:28.827016 8608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:28.812849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:37293 (local address 127.8.39.65:47201)
0808 15:46:28.813447 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:28.813538 (+ 91us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:28.815197 (+ 1659us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:28.815728 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:28.815735 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:28.816109 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:28.816610 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:28.816624 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:28.817574 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:28.817577 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:28.818571 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:28.818581 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:28.819364 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:28.819368 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:28.819524 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:28.820184 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:28.820202 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:28.821685 (+ 1483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:28.823907 (+ 2222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:28.823914 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:28.823937 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:28.824214 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:28.824565 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:28.824567 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:28.824569 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:28.824710 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:28.825236 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:28.825242 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:28.825515 (+ 273us) client_negotiation.cc:769] Sending connection context
0808 15:46:28.825689 (+ 174us) client_negotiation.cc:240] Negotiation successful
0808 15:46:28.825993 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":166,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.66@KRBTEST.COM" created.
I20260808 15:46:28.828552 8606 heartbeater.cc:347] Connected to a master server at 127.8.39.126:37293
I20260808 15:46:28.828820 8606 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:28.829366 8606 heartbeater.cc:511] Master 127.8.39.126:37293 requested a full tablet report, sending...
I20260808 15:46:28.831081 8402 ts_manager.cc:194] Registered new tserver with Master: a6849d8792334c70b7a1b8e940a0e555 (127.8.39.65:40313)
I20260808 15:46:28.832206 8402 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.65@KRBTEST.COM'} at 127.8.39.65:47201
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
I20260808 15:46:28.846764 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:0
--local_ip_for_outbound_sockets=127.8.39.66
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:37293
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:37197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:28.964457 8611 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:28.964809 8611 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:28.964902 8611 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:28.969213 8611 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:28.969316 8611 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:28.969408 8611 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:46:28.975076 8611 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:37197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:37293
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8611
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:28.976253 8611 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:28.977319 8611 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:28.987182 8617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:28.987205 8619 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:28.987321 8611 server_base.cc:1034] running on GCE node
W20260808 15:46:28.987251 8616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:28.988031 8611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:28.988771 8611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:28.989959 8611 hybrid_clock.cc:648] HybridClock initialized: now 1786203988989934 us; error 37 us; skew 500 ppm
Aug 08 15:46:28 dist-test-slave-8tdl krb5kdc[8356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203988, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:28.992835 8611 init.cc:377] Logged in from keytab as kudu/127.8.39.66@KRBTEST.COM (short username kudu)
I20260808 15:46:28.993793 8611 webserver.cc:460] Webserver started at http://127.8.39.66:39863/ using document root <none> and password file <none>
I20260808 15:46:28.994345 8611 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:28.994405 8611 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:28.994587 8611 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:28.996902 8611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-1/data/instance:
uuid: "46a001fa5c474c2dbef8e2567b443ae8"
format_stamp: "Formatted at 2026-08-08 15:46:28 on dist-test-slave-8tdl"
server_key: "df4253b19e1f737befd38e6f87c7f24e"
server_key_iv: "6b65cbee90adb293bd8baa41492b1d19"
server_key_version: "encryptionkey@0"
I20260808 15:46:28.997565 8611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance:
uuid: "46a001fa5c474c2dbef8e2567b443ae8"
format_stamp: "Formatted at 2026-08-08 15:46:28 on dist-test-slave-8tdl"
server_key: "df4253b19e1f737befd38e6f87c7f24e"
server_key_iv: "6b65cbee90adb293bd8baa41492b1d19"
server_key_version: "encryptionkey@0"
I20260808 15:46:29.001592 8611 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260808 15:46:29.004287 8626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:29.005626 8611 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 15:46:29.005777 8611 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "46a001fa5c474c2dbef8e2567b443ae8"
format_stamp: "Formatted at 2026-08-08 15:46:28 on dist-test-slave-8tdl"
server_key: "df4253b19e1f737befd38e6f87c7f24e"
server_key_iv: "6b65cbee90adb293bd8baa41492b1d19"
server_key_version: "encryptionkey@0"
I20260808 15:46:29.005900 8611 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:29.025576 8611 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:29.029274 8611 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:29.029523 8611 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:29.030220 8611 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:46:29.031147 8611 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:29.031217 8611 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:29.031288 8611 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:29.031328 8611 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:29.042055 8611 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:43369
I20260808 15:46:29.042078 8744 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:43369 every 8 connection(s)
I20260808 15:46:29.042980 8611 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:46:29.044442 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 8611
I20260808 15:46:29.044557 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance
I20260808 15:46:29.044801 8349 external_mini_cluster.cc:1428] Setting key f568799bb4355951c5f9a445adedd864
Aug 08 15:46:29 dist-test-slave-8tdl krb5kdc[8356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203988, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.39.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.67@KRBTEST.COM" created.
I20260808 15:46:29.058893 8444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:29.044969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:43491 (local address 127.8.39.126:37293)
0808 15:46:29.045132 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:29.045137 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:29.046166 (+ 1029us) server_negotiation.cc:407] Connection header received
0808 15:46:29.047715 (+ 1549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:29.047718 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:29.047775 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:29.047863 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:29.049336 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:29.049991 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:29.051348 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:29.051609 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:29.051733 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:29.054767 (+ 3034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:29.054772 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:29.054778 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:29.054815 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:29.056359 (+ 1544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:29.056992 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:29.056996 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:29.056998 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:29.057084 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:29.057462 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:29.057465 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:29.057466 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:29.057663 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:29.057742 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:29.058449 (+ 707us) server_negotiation.cc:299] Negotiation successful
0808 15:46:29.058616 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 15:46:29.060006 8748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:29.045494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:37293 (local address 127.8.39.66:43491)
0808 15:46:29.045997 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:29.046057 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:29.047501 (+ 1444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:29.048042 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:29.048050 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:29.048433 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:29.048988 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:29.049005 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:29.050144 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:29.050148 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:29.051212 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:29.051223 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:29.051780 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:29.051784 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:29.051974 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:29.052647 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:29.052665 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:29.054546 (+ 1881us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:29.056564 (+ 2018us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:29.056573 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:29.056591 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:29.056894 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:29.057203 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:29.057206 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:29.057208 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:29.057363 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:29.057787 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:29.057797 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:29.058090 (+ 293us) client_negotiation.cc:769] Sending connection context
0808 15:46:29.058319 (+ 229us) client_negotiation.cc:240] Negotiation successful
0808 15:46:29.058727 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":149,"threads_started":1}
I20260808 15:46:29.061364 8745 heartbeater.cc:347] Connected to a master server at 127.8.39.126:37293
I20260808 15:46:29.061640 8745 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:29.062224 8745 heartbeater.cc:511] Master 127.8.39.126:37293 requested a full tablet report, sending...
I20260808 15:46:29.063458 8402 ts_manager.cc:194] Registered new tserver with Master: 46a001fa5c474c2dbef8e2567b443ae8 (127.8.39.66:43369)
I20260808 15:46:29.064338 8402 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.66@KRBTEST.COM'} at 127.8.39.66:43491
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
I20260808 15:46:29.077804 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:0
--local_ip_for_outbound_sockets=127.8.39.67
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:37293
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:37197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:29.204905 8751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:29.205188 8751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:29.205237 8751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:29.209702 8751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:29.209766 8751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:29.209826 8751 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:46:29.215193 8751 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:37197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:37293
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:29.216209 8751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:29.217178 8751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:29.226876 8756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:29.226945 8757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:29.227005 8759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:29.227141 8751 server_base.cc:1034] running on GCE node
I20260808 15:46:29.227654 8751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:29.228282 8751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:29.229487 8751 hybrid_clock.cc:648] HybridClock initialized: now 1786203989229449 us; error 49 us; skew 500 ppm
Aug 08 15:46:29 dist-test-slave-8tdl krb5kdc[8356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203989, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:29.232595 8751 init.cc:377] Logged in from keytab as kudu/127.8.39.67@KRBTEST.COM (short username kudu)
I20260808 15:46:29.233642 8751 webserver.cc:460] Webserver started at http://127.8.39.67:40971/ using document root <none> and password file <none>
I20260808 15:46:29.234236 8751 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:29.234335 8751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:29.234594 8751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:29.236802 8751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-2/data/instance:
uuid: "e9496ef67e6a4c12bfda95373324cd80"
format_stamp: "Formatted at 2026-08-08 15:46:29 on dist-test-slave-8tdl"
server_key: "d20f23b138c676b5919420a91f283c85"
server_key_iv: "57aff2df06c360bd2183f0f5d7dc94a0"
server_key_version: "encryptionkey@0"
I20260808 15:46:29.237442 8751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance:
uuid: "e9496ef67e6a4c12bfda95373324cd80"
format_stamp: "Formatted at 2026-08-08 15:46:29 on dist-test-slave-8tdl"
server_key: "d20f23b138c676b5919420a91f283c85"
server_key_iv: "57aff2df06c360bd2183f0f5d7dc94a0"
server_key_version: "encryptionkey@0"
I20260808 15:46:29.241633 8751 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260808 15:46:29.244378 8766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:29.245608 8751 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260808 15:46:29.245757 8751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "e9496ef67e6a4c12bfda95373324cd80"
format_stamp: "Formatted at 2026-08-08 15:46:29 on dist-test-slave-8tdl"
server_key: "d20f23b138c676b5919420a91f283c85"
server_key_iv: "57aff2df06c360bd2183f0f5d7dc94a0"
server_key_version: "encryptionkey@0"
I20260808 15:46:29.245872 8751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:29.260237 8751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:29.263739 8751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:29.263969 8751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:29.264719 8751 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:46:29.265806 8751 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:29.265887 8751 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:29.265964 8751 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:29.266016 8751 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:29.277980 8751 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:44523
I20260808 15:46:29.278003 8882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:44523 every 8 connection(s)
I20260808 15:46:29.279129 8751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:46:29.286196 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 8751
I20260808 15:46:29.286304 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance
I20260808 15:46:29.286587 8349 external_mini_cluster.cc:1428] Setting key f825099b12ec5c9fbbbe0a83350216af
Aug 08 15:46:29 dist-test-slave-8tdl krb5kdc[8356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203989, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:29.293857 8444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:29.281163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:53477 (local address 127.8.39.126:37293)
0808 15:46:29.281330 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:29.281334 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:29.282239 (+ 905us) server_negotiation.cc:407] Connection header received
0808 15:46:29.283637 (+ 1398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:29.283640 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:29.283692 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:29.283773 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:29.285053 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:29.285617 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:29.286990 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:29.287328 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:29.287440 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:29.290568 (+ 3128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:29.290571 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:29.290573 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:29.290599 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:29.291956 (+ 1357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:29.292437 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:29.292439 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:29.292441 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:29.292541 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:29.292850 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:29.292852 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:29.292853 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:29.293041 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:29.293119 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:29.293607 (+ 488us) server_negotiation.cc:299] Negotiation successful
0808 15:46:29.293710 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 15:46:29.294847 8886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:29.281518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:37293 (local address 127.8.39.67:53477)
0808 15:46:29.282066 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:29.282122 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:29.283429 (+ 1307us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:29.283975 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:29.283982 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:29.284364 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:29.284900 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:29.284915 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:29.285776 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:29.285779 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:29.286859 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:29.286869 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:29.287524 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:29.287528 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:29.287746 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:29.288527 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:29.288548 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:29.290399 (+ 1851us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:29.292066 (+ 1667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:29.292071 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:29.292083 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:29.292350 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:29.292623 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:29.292625 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:29.292626 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:29.292763 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:29.293135 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:29.293140 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:29.293383 (+ 243us) client_negotiation.cc:769] Sending connection context
0808 15:46:29.293548 (+ 165us) client_negotiation.cc:240] Negotiation successful
0808 15:46:29.293808 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":133,"threads_started":1}
I20260808 15:46:29.295969 8883 heartbeater.cc:347] Connected to a master server at 127.8.39.126:37293
I20260808 15:46:29.296212 8883 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:29.296694 8883 heartbeater.cc:511] Master 127.8.39.126:37293 requested a full tablet report, sending...
I20260808 15:46:29.297763 8402 ts_manager.cc:194] Registered new tserver with Master: e9496ef67e6a4c12bfda95373324cd80 (127.8.39.67:44523)
I20260808 15:46:29.298400 8402 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.67@KRBTEST.COM'} at 127.8.39.67:53477
I20260808 15:46:29.301290 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 15:46:29 dist-test-slave-8tdl krb5kdc[8356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203989, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 15:46:29 dist-test-slave-8tdl krb5kdc[8356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203989, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.39.65@KRBTEST.COM
I20260808 15:46:29.331521 8892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:29.321254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44106 (local address 127.8.39.65:40313)
0808 15:46:29.321628 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:29.321643 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:29.321668 (+ 25us) server_negotiation.cc:407] Connection header received
0808 15:46:29.321750 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:29.321755 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:29.321953 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:29.322081 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:29.322798 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:29.323659 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:29.324502 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:29.324864 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:29.324949 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:29.327541 (+ 2592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:29.327555 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:29.327578 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:29.327613 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:29.329412 (+ 1799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:29.329849 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:29.329855 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:29.329856 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:29.329934 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:29.330372 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:29.330374 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:29.330376 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:29.330644 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:29.330890 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:29.331102 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 15:46:29.331265 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":154,"threads_started":1}
W20260808 15:46:29.332484 8516 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44106
Aug 08 15:46:29 dist-test-slave-8tdl krb5kdc[8356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 15:46:29 dist-test-slave-8tdl krb5kdc[8356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.65@KRBTEST.COM
I20260808 15:46:29.359886 8892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:29.351498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44118 (local address 127.8.39.65:40313)
0808 15:46:29.351678 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:29.351682 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:29.351760 (+ 78us) server_negotiation.cc:407] Connection header received
0808 15:46:29.351847 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:29.351849 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:29.351898 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:29.352021 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:29.352730 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:29.353292 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:29.354142 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:29.354384 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:29.354474 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:29.357074 (+ 2600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:29.357077 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:29.357079 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:29.357106 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:29.358356 (+ 1250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:29.358789 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:29.358792 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:29.358793 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:29.358868 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:29.359099 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:29.359101 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:29.359102 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:29.359263 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:29.359378 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:29.359561 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 15:46:29.359664 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 15:46:29.360945 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 8471
I20260808 15:46:29.370231 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 8611
I20260808 15:46:29.377686 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 8751
I20260808 15:46:29.384931 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 8369
2026-08-08T15:46:29Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2349 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:46:29 dist-test-slave-8tdl krb5kdc[8900](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:46:29 dist-test-slave-8tdl krb5kdc[8900](info): set up 2 sockets
Aug 08 15:46:29 dist-test-slave-8tdl krb5kdc[8900](info): commencing operation
krb5kdc: starting...
W20260808 15:46:30.481906 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:46:30 dist-test-slave-8tdl krb5kdc[8900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203990, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:46:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:46:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:46:30.614290 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:43227
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:35441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:43227
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:30.726714 8914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:30.727034 8914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:30.727121 8914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:30.731230 8914 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:46:30.731313 8914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:30.731348 8914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:30.731383 8914 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:46:30.731422 8914 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:46:30.737526 8914 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:35441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:43227
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:43227
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8914
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:30.738827 8914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:30.739939 8914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:30.749150 8920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:30.749141 8923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:30.749248 8914 server_base.cc:1034] running on GCE node
W20260808 15:46:30.749143 8919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:30.750108 8914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:30.751381 8914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:30.752555 8914 hybrid_clock.cc:648] HybridClock initialized: now 1786203990752542 us; error 27 us; skew 500 ppm
Aug 08 15:46:30 dist-test-slave-8tdl krb5kdc[8900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203990, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:30.755434 8914 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:46:30.756300 8914 webserver.cc:460] Webserver started at http://127.8.39.126:39873/ using document root <none> and password file <none>
I20260808 15:46:30.756870 8914 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:30.756959 8914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:30.757198 8914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:30.759403 8914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "8641183af2694322a308734c714f63ac"
format_stamp: "Formatted at 2026-08-08 15:46:30 on dist-test-slave-8tdl"
server_key: "7631516386a5ce5eb2e0f6d402e43cbe"
server_key_iv: "6a391a84273382140008029fff185235"
server_key_version: "encryptionkey@0"
I20260808 15:46:30.759981 8914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "8641183af2694322a308734c714f63ac"
format_stamp: "Formatted at 2026-08-08 15:46:30 on dist-test-slave-8tdl"
server_key: "7631516386a5ce5eb2e0f6d402e43cbe"
server_key_iv: "6a391a84273382140008029fff185235"
server_key_version: "encryptionkey@0"
I20260808 15:46:30.763800 8914 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 15:46:30.766337 8930 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:30.767654 8914 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:46:30.767792 8914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "8641183af2694322a308734c714f63ac"
format_stamp: "Formatted at 2026-08-08 15:46:30 on dist-test-slave-8tdl"
server_key: "7631516386a5ce5eb2e0f6d402e43cbe"
server_key_iv: "6a391a84273382140008029fff185235"
server_key_version: "encryptionkey@0"
I20260808 15:46:30.767905 8914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:30.778003 8914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:30.781082 8914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:30.781291 8914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:30.788574 8914 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:43227
I20260808 15:46:30.788600 8987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:43227 every 8 connection(s)
I20260808 15:46:30.789597 8914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:46:30.791142 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 8914
I20260808 15:46:30.791272 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:46:30.791523 8349 external_mini_cluster.cc:1428] Setting key 5c1b7b49ac8fe47498cadcfe28ce1694
I20260808 15:46:30.792886 8988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:30.799963 8988 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8641183af2694322a308734c714f63ac: Bootstrap starting.
Aug 08 15:46:30 dist-test-slave-8tdl krb5kdc[8900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203990, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:30.802788 8988 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8641183af2694322a308734c714f63ac: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:30.803794 8988 log.cc:824] T 00000000000000000000000000000000 P 8641183af2694322a308734c714f63ac: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:30.806143 8988 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8641183af2694322a308734c714f63ac: No bootstrap required, opened a new log
I20260808 15:46:30.807823 8991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:30.793023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49628 (local address 127.8.39.126:43227)
0808 15:46:30.793459 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:30.793487 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:30.793530 (+ 43us) server_negotiation.cc:407] Connection header received
0808 15:46:30.794406 (+ 876us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:30.794428 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:30.794888 (+ 460us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:30.795268 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:30.796106 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:30.797622 (+ 1516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:30.798625 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:30.799357 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:30.799534 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:30.802663 (+ 3129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:30.802710 (+ 47us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:30.802732 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:30.802772 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:30.804680 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:30.805128 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:30.805133 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:30.805140 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:30.805278 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:30.805543 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:30.805546 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:30.805548 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:30.806041 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:30.806219 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:30.806550 (+ 331us) server_negotiation.cc:299] Negotiation successful
0808 15:46:30.806886 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":120,"threads_started":1}
I20260808 15:46:30.810515 8988 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8641183af2694322a308734c714f63ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8641183af2694322a308734c714f63ac" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43227 } }
I20260808 15:46:30.810788 8988 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8641183af2694322a308734c714f63ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:30.810833 8988 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8641183af2694322a308734c714f63ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8641183af2694322a308734c714f63ac, State: Initialized, Role: FOLLOWER
I20260808 15:46:30.811232 8988 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8641183af2694322a308734c714f63ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8641183af2694322a308734c714f63ac" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43227 } }
I20260808 15:46:30.811352 8988 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8641183af2694322a308734c714f63ac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:46:30.811398 8988 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8641183af2694322a308734c714f63ac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:46:30.811489 8988 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8641183af2694322a308734c714f63ac [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:30.812438 8988 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8641183af2694322a308734c714f63ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8641183af2694322a308734c714f63ac" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43227 } }
I20260808 15:46:30.812790 8988 leader_election.cc:302] T 00000000000000000000000000000000 P 8641183af2694322a308734c714f63ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8641183af2694322a308734c714f63ac; no voters:
I20260808 15:46:30.813172 8988 leader_election.cc:288] T 00000000000000000000000000000000 P 8641183af2694322a308734c714f63ac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:46:30.813269 8993 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8641183af2694322a308734c714f63ac [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:30.813448 8993 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8641183af2694322a308734c714f63ac [term 1 LEADER]: Becoming Leader. State: Replica: 8641183af2694322a308734c714f63ac, State: Running, Role: LEADER
I20260808 15:46:30.813752 8993 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8641183af2694322a308734c714f63ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8641183af2694322a308734c714f63ac" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43227 } }
I20260808 15:46:30.814517 8988 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8641183af2694322a308734c714f63ac [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:46:30.815013 8993 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8641183af2694322a308734c714f63ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8641183af2694322a308734c714f63ac. Latest consensus state: current_term: 1 leader_uuid: "8641183af2694322a308734c714f63ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8641183af2694322a308734c714f63ac" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43227 } } }
I20260808 15:46:30.815135 8993 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8641183af2694322a308734c714f63ac [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:30.815546 8997 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:46:30.815492 8994 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8641183af2694322a308734c714f63ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8641183af2694322a308734c714f63ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8641183af2694322a308734c714f63ac" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43227 } } }
I20260808 15:46:30.815651 8994 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8641183af2694322a308734c714f63ac [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:30.819161 8997 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:46:30.824717 8997 catalog_manager.cc:1347] Generated new cluster ID: 73c55c1bde9142e39d38dee439c61bb4
I20260808 15:46:30.824788 8997 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:46:30.837968 8997 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:46:30.839425 8997 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:46:30.858695 8997 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8641183af2694322a308734c714f63ac: Generated new TSK 0
I20260808 15:46:30.859467 8997 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.39.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
I20260808 15:46:30.901849 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:0
--local_ip_for_outbound_sockets=127.8.39.65
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:43227
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:35441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:31.035521 9017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:31.035792 9017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:31.035840 9017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:31.039903 9017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:31.039964 9017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:31.040023 9017 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:46:31.045225 9017 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:35441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:43227
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9017
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:31.046255 9017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:31.047317 9017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:31.057188 9023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:31.057188 9022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:31.057258 9017 server_base.cc:1034] running on GCE node
W20260808 15:46:31.057189 9025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:31.057798 9017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:31.058568 9017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:31.059756 9017 hybrid_clock.cc:648] HybridClock initialized: now 1786203991059718 us; error 48 us; skew 500 ppm
Aug 08 15:46:31 dist-test-slave-8tdl krb5kdc[8900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203991, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:31.062721 9017 init.cc:377] Logged in from keytab as kudu/127.8.39.65@KRBTEST.COM (short username kudu)
I20260808 15:46:31.063642 9017 webserver.cc:460] Webserver started at http://127.8.39.65:42847/ using document root <none> and password file <none>
I20260808 15:46:31.064208 9017 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:31.064297 9017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:31.064535 9017 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:31.066586 9017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-0/data/instance:
uuid: "9540fc8ad5e84d79ae28cfe96aca0f6c"
format_stamp: "Formatted at 2026-08-08 15:46:31 on dist-test-slave-8tdl"
server_key: "eaf8cdd9e085d4cc2463eb0b974257e6"
server_key_iv: "0250411ce2792835e41e750c73876aa3"
server_key_version: "encryptionkey@0"
I20260808 15:46:31.067220 9017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance:
uuid: "9540fc8ad5e84d79ae28cfe96aca0f6c"
format_stamp: "Formatted at 2026-08-08 15:46:31 on dist-test-slave-8tdl"
server_key: "eaf8cdd9e085d4cc2463eb0b974257e6"
server_key_iv: "0250411ce2792835e41e750c73876aa3"
server_key_version: "encryptionkey@0"
I20260808 15:46:31.070920 9017 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:46:31.073683 9032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:31.075011 9017 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:46:31.075142 9017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "9540fc8ad5e84d79ae28cfe96aca0f6c"
format_stamp: "Formatted at 2026-08-08 15:46:31 on dist-test-slave-8tdl"
server_key: "eaf8cdd9e085d4cc2463eb0b974257e6"
server_key_iv: "0250411ce2792835e41e750c73876aa3"
server_key_version: "encryptionkey@0"
I20260808 15:46:31.075254 9017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:31.105737 9017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:31.109233 9017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:31.109447 9017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:31.110059 9017 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:46:31.110963 9017 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:31.111034 9017 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:31.111109 9017 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:31.111156 9017 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:31.120321 9017 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:45019
I20260808 15:46:31.120343 9154 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:45019 every 8 connection(s)
I20260808 15:46:31.121227 9017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:46:31.130163 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 9017
I20260808 15:46:31.130292 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance
I20260808 15:46:31.130594 8349 external_mini_cluster.cc:1428] Setting key c0d2e7f3caaffee60e49c121bd687dcc
Aug 08 15:46:31 dist-test-slave-8tdl krb5kdc[8900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203991, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:31.136498 8991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:31.123054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:35775 (local address 127.8.39.126:43227)
0808 15:46:31.123201 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:31.123205 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:31.124123 (+ 918us) server_negotiation.cc:407] Connection header received
0808 15:46:31.125539 (+ 1416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:31.125542 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:31.125609 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:31.125697 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:31.127247 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.128092 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.129519 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.129759 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.129841 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:31.132700 (+ 2859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:31.132704 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:31.132706 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:31.132733 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:31.134266 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:31.134941 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:31.134944 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:31.134946 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:31.135039 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:31.135388 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:31.135392 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:31.135393 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:31.135583 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:31.135685 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:31.136190 (+ 505us) server_negotiation.cc:299] Negotiation successful
0808 15:46:31.136320 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 15:46:31.137394 9157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:31.123481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43227 (local address 127.8.39.65:35775)
0808 15:46:31.123941 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:31.123988 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:31.125263 (+ 1275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:31.125927 (+ 664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:31.125940 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:31.126409 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:31.127084 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:31.127105 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.128255 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.128259 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:31.129369 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:31.129379 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.129924 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.129931 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:31.130150 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:31.130862 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:31.130884 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:31.132540 (+ 1656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:31.134398 (+ 1858us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:31.134405 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:31.134421 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:31.134797 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:31.135136 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:31.135139 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:31.135141 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:31.135289 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:31.135686 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:31.135694 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:31.135950 (+ 256us) client_negotiation.cc:769] Sending connection context
0808 15:46:31.136136 (+ 186us) client_negotiation.cc:240] Negotiation successful
0808 15:46:31.136483 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":130,"threads_started":1}
I20260808 15:46:31.138698 9155 heartbeater.cc:347] Connected to a master server at 127.8.39.126:43227
I20260808 15:46:31.138985 9155 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:31.139616 9155 heartbeater.cc:511] Master 127.8.39.126:43227 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.8.39.66@KRBTEST.COM; defaulting to no policy
I20260808 15:46:31.141264 8949 ts_manager.cc:194] Registered new tserver with Master: 9540fc8ad5e84d79ae28cfe96aca0f6c (127.8.39.65:45019)
I20260808 15:46:31.142467 8949 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.65@KRBTEST.COM'} at 127.8.39.65:35775
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
I20260808 15:46:31.159725 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:0
--local_ip_for_outbound_sockets=127.8.39.66
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:43227
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:35441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:31.271082 9160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:31.271340 9160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:31.271385 9160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:31.275569 9160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:31.275635 9160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:31.275695 9160 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:46:31.281227 9160 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:35441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:43227
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9160
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:31.282358 9160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:31.283519 9160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:31.293476 9165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:31.293601 9160 server_base.cc:1034] running on GCE node
W20260808 15:46:31.293478 9166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:31.293506 9169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:31.294294 9160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:31.295107 9160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:31.296337 9160 hybrid_clock.cc:648] HybridClock initialized: now 1786203991296318 us; error 27 us; skew 500 ppm
Aug 08 15:46:31 dist-test-slave-8tdl krb5kdc[8900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203991, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:31.299722 9160 init.cc:377] Logged in from keytab as kudu/127.8.39.66@KRBTEST.COM (short username kudu)
I20260808 15:46:31.300612 9160 webserver.cc:460] Webserver started at http://127.8.39.66:45225/ using document root <none> and password file <none>
I20260808 15:46:31.301177 9160 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:31.301270 9160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:31.301504 9160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:31.303692 9160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-1/data/instance:
uuid: "a644d50c13b84d5eab4252ed2ada5d2f"
format_stamp: "Formatted at 2026-08-08 15:46:31 on dist-test-slave-8tdl"
server_key: "d321b87b43410f75e1b4185e4ba119ec"
server_key_iv: "424fd234bcd691d1c7217fc42091d4dc"
server_key_version: "encryptionkey@0"
I20260808 15:46:31.304257 9160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance:
uuid: "a644d50c13b84d5eab4252ed2ada5d2f"
format_stamp: "Formatted at 2026-08-08 15:46:31 on dist-test-slave-8tdl"
server_key: "d321b87b43410f75e1b4185e4ba119ec"
server_key_iv: "424fd234bcd691d1c7217fc42091d4dc"
server_key_version: "encryptionkey@0"
I20260808 15:46:31.308145 9160 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 15:46:31.310534 9176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:31.311913 9160 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:46:31.312075 9160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "a644d50c13b84d5eab4252ed2ada5d2f"
format_stamp: "Formatted at 2026-08-08 15:46:31 on dist-test-slave-8tdl"
server_key: "d321b87b43410f75e1b4185e4ba119ec"
server_key_iv: "424fd234bcd691d1c7217fc42091d4dc"
server_key_version: "encryptionkey@0"
I20260808 15:46:31.312203 9160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:31.356709 9160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:31.360525 9160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:31.360754 9160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:31.361418 9160 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:46:31.362315 9160 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:31.362401 9160 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:31.362496 9160 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:31.362547 9160 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:31.372567 9160 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:42539
I20260808 15:46:31.372628 9294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:42539 every 8 connection(s)
I20260808 15:46:31.373586 9160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:46:31.377550 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 9160
I20260808 15:46:31.377668 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance
I20260808 15:46:31.377928 8349 external_mini_cluster.cc:1428] Setting key f90b9251696b255fcb9e3274618b33c6
Aug 08 15:46:31 dist-test-slave-8tdl krb5kdc[8900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203991, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.39.67@KRBTEST.COM; defaulting to no policy
I20260808 15:46:31.389714 8991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:31.375515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:59661 (local address 127.8.39.126:43227)
0808 15:46:31.375661 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:31.375665 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:31.376591 (+ 926us) server_negotiation.cc:407] Connection header received
0808 15:46:31.378368 (+ 1777us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:31.378372 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:31.378447 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:31.378550 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:31.380253 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.380931 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.382336 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.382806 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.382946 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:31.385397 (+ 2451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:31.385405 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:31.385410 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:31.385452 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:31.387306 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:31.387849 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:31.387856 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:31.387860 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:31.387970 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:31.388307 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:31.388314 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:31.388318 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:31.388687 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:31.388818 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:31.389305 (+ 487us) server_negotiation.cc:299] Negotiation successful
0808 15:46:31.389473 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 15:46:31.390560 9297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:31.375961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43227 (local address 127.8.39.66:59661)
0808 15:46:31.376425 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:31.376468 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:31.378005 (+ 1537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:31.378919 (+ 914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:31.378926 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:31.379386 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:31.380087 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:31.380109 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.381083 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.381089 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:31.382202 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:31.382212 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.382972 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.382975 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:31.383126 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:31.383725 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:31.383742 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:31.385206 (+ 1464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:31.387452 (+ 2246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:31.387457 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:31.387469 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:31.387736 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:31.388069 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:31.388071 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:31.388072 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:31.388202 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:31.388807 (+ 605us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:31.388812 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:31.389054 (+ 242us) client_negotiation.cc:769] Sending connection context
0808 15:46:31.389214 (+ 160us) client_negotiation.cc:240] Negotiation successful
0808 15:46:31.389474 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":136,"threads_started":1}
I20260808 15:46:31.392130 9295 heartbeater.cc:347] Connected to a master server at 127.8.39.126:43227
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.67@KRBTEST.COM" created.
I20260808 15:46:31.392416 9295 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:31.393046 9295 heartbeater.cc:511] Master 127.8.39.126:43227 requested a full tablet report, sending...
I20260808 15:46:31.394253 8949 ts_manager.cc:194] Registered new tserver with Master: a644d50c13b84d5eab4252ed2ada5d2f (127.8.39.66:42539)
I20260808 15:46:31.394953 8949 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.66@KRBTEST.COM'} at 127.8.39.66:59661
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
I20260808 15:46:31.408111 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:0
--local_ip_for_outbound_sockets=127.8.39.67
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:43227
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:35441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:31.520888 9300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:31.521170 9300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:31.521216 9300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:31.525525 9300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:31.525606 9300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:31.525679 9300 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:46:31.531922 9300 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:35441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:43227
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9300
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:31.533068 9300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:31.534257 9300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:31.544570 9305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:31.544605 9306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:31.544564 9308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:31.544960 9300 server_base.cc:1034] running on GCE node
I20260808 15:46:31.545591 9300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:31.546327 9300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:31.547556 9300 hybrid_clock.cc:648] HybridClock initialized: now 1786203991547537 us; error 37 us; skew 500 ppm
Aug 08 15:46:31 dist-test-slave-8tdl krb5kdc[8900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203991, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:31.550472 9300 init.cc:377] Logged in from keytab as kudu/127.8.39.67@KRBTEST.COM (short username kudu)
I20260808 15:46:31.551559 9300 webserver.cc:460] Webserver started at http://127.8.39.67:33189/ using document root <none> and password file <none>
I20260808 15:46:31.552191 9300 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:31.552289 9300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:31.552539 9300 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:31.554872 9300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-2/data/instance:
uuid: "d21de976a87f470eb209cb81954a0a47"
format_stamp: "Formatted at 2026-08-08 15:46:31 on dist-test-slave-8tdl"
server_key: "18040ae309ff1c0cf3eb92ebdcd8501b"
server_key_iv: "459b8da7d53c142d9b32f6aed8cea5e6"
server_key_version: "encryptionkey@0"
I20260808 15:46:31.555563 9300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance:
uuid: "d21de976a87f470eb209cb81954a0a47"
format_stamp: "Formatted at 2026-08-08 15:46:31 on dist-test-slave-8tdl"
server_key: "18040ae309ff1c0cf3eb92ebdcd8501b"
server_key_iv: "459b8da7d53c142d9b32f6aed8cea5e6"
server_key_version: "encryptionkey@0"
I20260808 15:46:31.559696 9300 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 15:46:31.562318 9316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:31.563614 9300 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 15:46:31.563760 9300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "d21de976a87f470eb209cb81954a0a47"
format_stamp: "Formatted at 2026-08-08 15:46:31 on dist-test-slave-8tdl"
server_key: "18040ae309ff1c0cf3eb92ebdcd8501b"
server_key_iv: "459b8da7d53c142d9b32f6aed8cea5e6"
server_key_version: "encryptionkey@0"
I20260808 15:46:31.563881 9300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:31.584465 9300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:31.587603 9300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:31.587818 9300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:31.588507 9300 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:46:31.589386 9300 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:31.589560 9300 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:31.589679 9300 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:31.589727 9300 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:31.599699 9300 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:45697
I20260808 15:46:31.599727 9433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:45697 every 8 connection(s)
I20260808 15:46:31.600649 9300 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:46:31.606086 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 9300
I20260808 15:46:31.606235 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance
I20260808 15:46:31.606546 8349 external_mini_cluster.cc:1428] Setting key 322e20c923d53626d9c1b8c1f6f27a31
Aug 08 15:46:31 dist-test-slave-8tdl krb5kdc[8900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203991, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:31.615463 8991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:31.602488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:47613 (local address 127.8.39.126:43227)
0808 15:46:31.602663 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:31.602668 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:31.603594 (+ 926us) server_negotiation.cc:407] Connection header received
0808 15:46:31.604916 (+ 1322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:31.604919 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:31.604969 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:31.605048 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:31.606183 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.606979 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.608345 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.608618 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.608728 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:31.611514 (+ 2786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:31.611518 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:31.611521 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:31.611556 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:31.613155 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:31.613718 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:31.613722 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:31.613724 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:31.613809 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:31.614168 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:31.614173 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:31.614175 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:31.614409 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:31.614516 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:31.615164 (+ 648us) server_negotiation.cc:299] Negotiation successful
0808 15:46:31.615294 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 15:46:31.616524 9436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:31.602991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43227 (local address 127.8.39.67:47613)
0808 15:46:31.603434 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:31.603476 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:31.604670 (+ 1194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:31.605202 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:31.605208 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:31.605555 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:31.606029 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:31.606043 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.607146 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.607149 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:31.608224 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:31.608234 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.608790 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.608794 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:31.608999 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:31.609577 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:31.609593 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:31.611328 (+ 1735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:31.613289 (+ 1961us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:31.613295 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:31.613311 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:31.613605 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:31.613903 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:31.613907 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:31.613909 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:31.614069 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:31.614515 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:31.614522 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:31.614843 (+ 321us) client_negotiation.cc:769] Sending connection context
0808 15:46:31.615120 (+ 277us) client_negotiation.cc:240] Negotiation successful
0808 15:46:31.615485 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":125,"threads_started":1}
I20260808 15:46:31.617796 9434 heartbeater.cc:347] Connected to a master server at 127.8.39.126:43227
I20260808 15:46:31.618041 9434 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:31.618521 9434 heartbeater.cc:511] Master 127.8.39.126:43227 requested a full tablet report, sending...
I20260808 15:46:31.619650 8948 ts_manager.cc:194] Registered new tserver with Master: d21de976a87f470eb209cb81954a0a47 (127.8.39.67:45697)
I20260808 15:46:31.620380 8948 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.67@KRBTEST.COM'} at 127.8.39.67:47613
I20260808 15:46:31.620453 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:46:31.632130 8991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:31.624779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49632 (local address 127.8.39.126:43227)
0808 15:46:31.624879 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:31.624882 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:31.625149 (+ 267us) server_negotiation.cc:407] Connection header received
0808 15:46:31.625281 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:31.625284 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:31.625330 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:31.625410 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:31.626139 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.626643 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.627498 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.627716 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.627821 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:31.629125 (+ 1304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:31.629129 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:31.629131 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:31.629156 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:31.630411 (+ 1255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:31.630868 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:31.630872 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:31.630874 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:31.630960 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:31.631235 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:31.631238 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:31.631240 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:31.631458 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:31.631596 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:31.631830 (+ 234us) server_negotiation.cc:299] Negotiation successful
0808 15:46:31.631967 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 15:46:31.637364 8948 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49632:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:46:31.640506 8948 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:46:31.655375 9450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:31.649898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33002 (local address 127.8.39.67:45697)
0808 15:46:31.650395 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:31.650408 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:31.650432 (+ 24us) server_negotiation.cc:407] Connection header received
0808 15:46:31.650505 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:31.650509 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:31.650699 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:31.650859 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:46:31.651143 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.652257 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.653714 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.654575 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.654733 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:31.654906 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:31.655086 (+ 180us) server_negotiation.cc:299] Negotiation successful
0808 15:46:31.655182 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":148,"threads_started":1}
I20260808 15:46:31.655378 9445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:31.648955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:42539 (local address 127.0.0.1:42526)
0808 15:46:31.649638 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:31.649653 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:31.649751 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:31.650966 (+ 1215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:31.650969 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:31.650982 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:46:31.651077 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:31.651085 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.652159 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.652165 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:31.653690 (+ 1525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:31.653697 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.654767 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.654770 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:31.654906 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:31.654941 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 15:46:31.655008 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 15:46:31.655195 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"mutex_wait_us":113,"thread_start_us":107,"threads_started":1}
I20260808 15:46:31.655709 9446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:31.648962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32860 (local address 127.8.39.65:45019)
0808 15:46:31.650010 (+ 1048us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:31.650019 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:31.650045 (+ 26us) server_negotiation.cc:407] Connection header received
0808 15:46:31.650124 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:31.650130 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:31.650331 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:31.650866 (+ 535us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:46:31.651012 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.652257 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.654041 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.654614 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.654800 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:31.654962 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:31.655458 (+ 496us) server_negotiation.cc:299] Negotiation successful
0808 15:46:31.655578 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":942,"thread_start_us":74,"threads_started":1}
I20260808 15:46:31.655392 9447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:31.648798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:45019 (local address 127.0.0.1:32860)
0808 15:46:31.649534 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:31.649585 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:31.649711 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:31.650516 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:31.650522 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:31.650544 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:46:31.650710 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:31.650720 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.652396 (+ 1676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.652399 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:31.653686 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:31.653697 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.655022 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.655026 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:31.655118 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:31.655147 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 15:46:31.655215 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 15:46:31.655274 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"mutex_wait_us":27,"thread_start_us":76,"threads_started":1}
I20260808 15:46:31.655398 9448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:31.649413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:45697 (local address 127.0.0.1:33002)
0808 15:46:31.650120 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:31.650135 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:31.650217 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:31.650832 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:31.650835 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:31.650922 (+ 87us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:46:31.651025 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:31.651031 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.652423 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.652425 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:31.653599 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:31.653608 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.654743 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.654750 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:31.654883 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:31.654931 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 15:46:31.655045 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 15:46:31.655210 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"mutex_wait_us":140,"thread_start_us":98,"threads_started":1}
I20260808 15:46:31.656219 9449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:31.649578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42526 (local address 127.8.39.66:42539)
0808 15:46:31.650485 (+ 907us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:31.650500 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:31.650525 (+ 25us) server_negotiation.cc:407] Connection header received
0808 15:46:31.650601 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:31.650605 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:31.650814 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:31.651215 (+ 401us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:46:31.651343 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.652034 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.653833 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.654605 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.655731 (+ 1126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:31.655905 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:31.655955 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 15:46:31.656048 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":794,"thread_start_us":139,"threads_started":1}
I20260808 15:46:31.658500 9365 tablet_service.cc:1467] Processing CreateTablet for tablet 7348b134d02547bda35661a9d9b4f3c6 (DEFAULT_TABLE table=test-table [id=f090e6123a6d4b6e8e3364fb84908e9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:31.658605 9085 tablet_service.cc:1467] Processing CreateTablet for tablet 7348b134d02547bda35661a9d9b4f3c6 (DEFAULT_TABLE table=test-table [id=f090e6123a6d4b6e8e3364fb84908e9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:31.658608 9227 tablet_service.cc:1467] Processing CreateTablet for tablet 7348b134d02547bda35661a9d9b4f3c6 (DEFAULT_TABLE table=test-table [id=f090e6123a6d4b6e8e3364fb84908e9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:31.659560 9365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7348b134d02547bda35661a9d9b4f3c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:31.659610 9085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7348b134d02547bda35661a9d9b4f3c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:31.659610 9227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7348b134d02547bda35661a9d9b4f3c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:31.666030 9451 tablet_bootstrap.cc:492] T 7348b134d02547bda35661a9d9b4f3c6 P d21de976a87f470eb209cb81954a0a47: Bootstrap starting.
I20260808 15:46:31.667557 9452 tablet_bootstrap.cc:492] T 7348b134d02547bda35661a9d9b4f3c6 P 9540fc8ad5e84d79ae28cfe96aca0f6c: Bootstrap starting.
I20260808 15:46:31.668367 9453 tablet_bootstrap.cc:492] T 7348b134d02547bda35661a9d9b4f3c6 P a644d50c13b84d5eab4252ed2ada5d2f: Bootstrap starting.
I20260808 15:46:31.668617 9451 tablet_bootstrap.cc:654] T 7348b134d02547bda35661a9d9b4f3c6 P d21de976a87f470eb209cb81954a0a47: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:31.670269 9451 log.cc:824] T 7348b134d02547bda35661a9d9b4f3c6 P d21de976a87f470eb209cb81954a0a47: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:31.671500 9453 tablet_bootstrap.cc:654] T 7348b134d02547bda35661a9d9b4f3c6 P a644d50c13b84d5eab4252ed2ada5d2f: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:31.672426 9452 tablet_bootstrap.cc:654] T 7348b134d02547bda35661a9d9b4f3c6 P 9540fc8ad5e84d79ae28cfe96aca0f6c: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:31.672523 9453 log.cc:824] T 7348b134d02547bda35661a9d9b4f3c6 P a644d50c13b84d5eab4252ed2ada5d2f: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:31.673188 9451 tablet_bootstrap.cc:492] T 7348b134d02547bda35661a9d9b4f3c6 P d21de976a87f470eb209cb81954a0a47: No bootstrap required, opened a new log
I20260808 15:46:31.673223 9452 log.cc:824] T 7348b134d02547bda35661a9d9b4f3c6 P 9540fc8ad5e84d79ae28cfe96aca0f6c: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:31.673418 9451 ts_tablet_manager.cc:1397] T 7348b134d02547bda35661a9d9b4f3c6 P d21de976a87f470eb209cb81954a0a47: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.002s
I20260808 15:46:31.674649 9453 tablet_bootstrap.cc:492] T 7348b134d02547bda35661a9d9b4f3c6 P a644d50c13b84d5eab4252ed2ada5d2f: No bootstrap required, opened a new log
I20260808 15:46:31.674872 9453 ts_tablet_manager.cc:1397] T 7348b134d02547bda35661a9d9b4f3c6 P a644d50c13b84d5eab4252ed2ada5d2f: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.003s
I20260808 15:46:31.675539 9452 tablet_bootstrap.cc:492] T 7348b134d02547bda35661a9d9b4f3c6 P 9540fc8ad5e84d79ae28cfe96aca0f6c: No bootstrap required, opened a new log
I20260808 15:46:31.675756 9452 ts_tablet_manager.cc:1397] T 7348b134d02547bda35661a9d9b4f3c6 P 9540fc8ad5e84d79ae28cfe96aca0f6c: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260808 15:46:31.677634 9451 raft_consensus.cc:348] T 7348b134d02547bda35661a9d9b4f3c6 P d21de976a87f470eb209cb81954a0a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9540fc8ad5e84d79ae28cfe96aca0f6c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 45019 } } peers { permanent_uuid: "a644d50c13b84d5eab4252ed2ada5d2f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 42539 } } peers { permanent_uuid: "d21de976a87f470eb209cb81954a0a47" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45697 } }
I20260808 15:46:31.677938 9451 raft_consensus.cc:374] T 7348b134d02547bda35661a9d9b4f3c6 P d21de976a87f470eb209cb81954a0a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:31.677996 9451 raft_consensus.cc:729] T 7348b134d02547bda35661a9d9b4f3c6 P d21de976a87f470eb209cb81954a0a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d21de976a87f470eb209cb81954a0a47, State: Initialized, Role: FOLLOWER
I20260808 15:46:31.678892 9451 consensus_queue.cc:260] T 7348b134d02547bda35661a9d9b4f3c6 P d21de976a87f470eb209cb81954a0a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9540fc8ad5e84d79ae28cfe96aca0f6c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 45019 } } peers { permanent_uuid: "a644d50c13b84d5eab4252ed2ada5d2f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 42539 } } peers { permanent_uuid: "d21de976a87f470eb209cb81954a0a47" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45697 } }
I20260808 15:46:31.678854 9453 raft_consensus.cc:348] T 7348b134d02547bda35661a9d9b4f3c6 P a644d50c13b84d5eab4252ed2ada5d2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9540fc8ad5e84d79ae28cfe96aca0f6c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 45019 } } peers { permanent_uuid: "a644d50c13b84d5eab4252ed2ada5d2f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 42539 } } peers { permanent_uuid: "d21de976a87f470eb209cb81954a0a47" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45697 } }
I20260808 15:46:31.679180 9453 raft_consensus.cc:374] T 7348b134d02547bda35661a9d9b4f3c6 P a644d50c13b84d5eab4252ed2ada5d2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:31.679351 9453 raft_consensus.cc:729] T 7348b134d02547bda35661a9d9b4f3c6 P a644d50c13b84d5eab4252ed2ada5d2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a644d50c13b84d5eab4252ed2ada5d2f, State: Initialized, Role: FOLLOWER
I20260808 15:46:31.679764 9453 consensus_queue.cc:260] T 7348b134d02547bda35661a9d9b4f3c6 P a644d50c13b84d5eab4252ed2ada5d2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9540fc8ad5e84d79ae28cfe96aca0f6c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 45019 } } peers { permanent_uuid: "a644d50c13b84d5eab4252ed2ada5d2f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 42539 } } peers { permanent_uuid: "d21de976a87f470eb209cb81954a0a47" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45697 } }
I20260808 15:46:31.680002 9451 ts_tablet_manager.cc:1428] T 7348b134d02547bda35661a9d9b4f3c6 P d21de976a87f470eb209cb81954a0a47: Time spent starting tablet: real 0.007s user 0.006s sys 0.002s
I20260808 15:46:31.680326 9452 raft_consensus.cc:348] T 7348b134d02547bda35661a9d9b4f3c6 P 9540fc8ad5e84d79ae28cfe96aca0f6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9540fc8ad5e84d79ae28cfe96aca0f6c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 45019 } } peers { permanent_uuid: "a644d50c13b84d5eab4252ed2ada5d2f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 42539 } } peers { permanent_uuid: "d21de976a87f470eb209cb81954a0a47" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45697 } }
I20260808 15:46:31.680541 9434 heartbeater.cc:503] Master 127.8.39.126:43227 was elected leader, sending a full tablet report...
I20260808 15:46:31.680590 9452 raft_consensus.cc:374] T 7348b134d02547bda35661a9d9b4f3c6 P 9540fc8ad5e84d79ae28cfe96aca0f6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:31.680647 9452 raft_consensus.cc:729] T 7348b134d02547bda35661a9d9b4f3c6 P 9540fc8ad5e84d79ae28cfe96aca0f6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9540fc8ad5e84d79ae28cfe96aca0f6c, State: Initialized, Role: FOLLOWER
I20260808 15:46:31.680737 9453 ts_tablet_manager.cc:1428] T 7348b134d02547bda35661a9d9b4f3c6 P a644d50c13b84d5eab4252ed2ada5d2f: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260808 15:46:31.681046 9295 heartbeater.cc:503] Master 127.8.39.126:43227 was elected leader, sending a full tablet report...
I20260808 15:46:31.681143 9452 consensus_queue.cc:260] T 7348b134d02547bda35661a9d9b4f3c6 P 9540fc8ad5e84d79ae28cfe96aca0f6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9540fc8ad5e84d79ae28cfe96aca0f6c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 45019 } } peers { permanent_uuid: "a644d50c13b84d5eab4252ed2ada5d2f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 42539 } } peers { permanent_uuid: "d21de976a87f470eb209cb81954a0a47" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45697 } }
I20260808 15:46:31.681819 9155 heartbeater.cc:503] Master 127.8.39.126:43227 was elected leader, sending a full tablet report...
I20260808 15:46:31.683063 9452 ts_tablet_manager.cc:1428] T 7348b134d02547bda35661a9d9b4f3c6 P 9540fc8ad5e84d79ae28cfe96aca0f6c: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260808 15:46:31.797508 9459 raft_consensus.cc:482] T 7348b134d02547bda35661a9d9b4f3c6 P 9540fc8ad5e84d79ae28cfe96aca0f6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:46:31.797827 9459 raft_consensus.cc:504] T 7348b134d02547bda35661a9d9b4f3c6 P 9540fc8ad5e84d79ae28cfe96aca0f6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9540fc8ad5e84d79ae28cfe96aca0f6c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 45019 } } peers { permanent_uuid: "a644d50c13b84d5eab4252ed2ada5d2f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 42539 } } peers { permanent_uuid: "d21de976a87f470eb209cb81954a0a47" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45697 } }
I20260808 15:46:31.799232 9459 leader_election.cc:288] T 7348b134d02547bda35661a9d9b4f3c6 P 9540fc8ad5e84d79ae28cfe96aca0f6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a644d50c13b84d5eab4252ed2ada5d2f (127.8.39.66:42539), d21de976a87f470eb209cb81954a0a47 (127.8.39.67:45697)
I20260808 15:46:31.804623 9449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:31.800025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:39349 (local address 127.8.39.66:42539)
0808 15:46:31.800286 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:31.800290 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:31.800306 (+ 16us) server_negotiation.cc:407] Connection header received
0808 15:46:31.800365 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:31.800367 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:31.800420 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:31.800507 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:46:31.800834 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.801571 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.803283 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.803918 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.804041 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:31.804104 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:31.804416 (+ 312us) server_negotiation.cc:299] Negotiation successful
0808 15:46:31.804493 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168}
I20260808 15:46:31.804623 9450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:31.800128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:50873 (local address 127.8.39.67:45697)
0808 15:46:31.800444 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:31.800451 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:31.800468 (+ 17us) server_negotiation.cc:407] Connection header received
0808 15:46:31.800613 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:31.800617 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:31.800663 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:31.800709 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:46:31.801088 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.801783 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.803283 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.803918 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.804038 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:31.804104 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:31.804416 (+ 312us) server_negotiation.cc:299] Negotiation successful
0808 15:46:31.804493 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232}
I20260808 15:46:31.804728 9461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:31.799525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:42539 (local address 127.8.39.65:39349)
0808 15:46:31.800090 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:31.800106 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:31.800212 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:31.800554 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:31.800558 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:31.800577 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:46:31.800711 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:31.800716 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.801698 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.801701 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:31.803146 (+ 1445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:31.803158 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.804081 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.804085 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:31.804257 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:31.804311 (+ 54us) client_negotiation.cc:769] Sending connection context
0808 15:46:31.804385 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 15:46:31.804548 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"mutex_wait_us":156,"thread_start_us":165,"threads_started":1}
I20260808 15:46:31.804728 9460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:31.799639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:45697 (local address 127.8.39.65:50873)
0808 15:46:31.800402 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:31.800413 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:31.800471 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:31.800844 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:31.800846 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:31.800861 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:46:31.800966 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:31.800971 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.801879 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.801882 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:31.803146 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:31.803158 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.804081 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.804085 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:31.804237 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:31.804305 (+ 68us) client_negotiation.cc:769] Sending connection context
0808 15:46:31.804385 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 15:46:31.804540 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":702,"mutex_wait_us":75,"thread_start_us":126,"threads_started":1}
I20260808 15:46:31.805519 9248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7348b134d02547bda35661a9d9b4f3c6" candidate_uuid: "9540fc8ad5e84d79ae28cfe96aca0f6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a644d50c13b84d5eab4252ed2ada5d2f" is_pre_election: true
I20260808 15:46:31.805694 9387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7348b134d02547bda35661a9d9b4f3c6" candidate_uuid: "9540fc8ad5e84d79ae28cfe96aca0f6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d21de976a87f470eb209cb81954a0a47" is_pre_election: true
I20260808 15:46:31.805835 9248 raft_consensus.cc:2454] T 7348b134d02547bda35661a9d9b4f3c6 P a644d50c13b84d5eab4252ed2ada5d2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9540fc8ad5e84d79ae28cfe96aca0f6c in term 0.
I20260808 15:46:31.806021 9387 raft_consensus.cc:2454] T 7348b134d02547bda35661a9d9b4f3c6 P d21de976a87f470eb209cb81954a0a47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9540fc8ad5e84d79ae28cfe96aca0f6c in term 0.
I20260808 15:46:31.806370 9037 leader_election.cc:302] T 7348b134d02547bda35661a9d9b4f3c6 P 9540fc8ad5e84d79ae28cfe96aca0f6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9540fc8ad5e84d79ae28cfe96aca0f6c, a644d50c13b84d5eab4252ed2ada5d2f; no voters:
I20260808 15:46:31.806640 9459 raft_consensus.cc:2781] T 7348b134d02547bda35661a9d9b4f3c6 P 9540fc8ad5e84d79ae28cfe96aca0f6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:46:31.806751 9459 raft_consensus.cc:482] T 7348b134d02547bda35661a9d9b4f3c6 P 9540fc8ad5e84d79ae28cfe96aca0f6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:46:31.806809 9459 raft_consensus.cc:3037] T 7348b134d02547bda35661a9d9b4f3c6 P 9540fc8ad5e84d79ae28cfe96aca0f6c [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:31.807873 9459 raft_consensus.cc:504] T 7348b134d02547bda35661a9d9b4f3c6 P 9540fc8ad5e84d79ae28cfe96aca0f6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9540fc8ad5e84d79ae28cfe96aca0f6c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 45019 } } peers { permanent_uuid: "a644d50c13b84d5eab4252ed2ada5d2f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 42539 } } peers { permanent_uuid: "d21de976a87f470eb209cb81954a0a47" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45697 } }
I20260808 15:46:31.808240 9459 leader_election.cc:288] T 7348b134d02547bda35661a9d9b4f3c6 P 9540fc8ad5e84d79ae28cfe96aca0f6c [CANDIDATE]: Term 1 election: Requested vote from peers a644d50c13b84d5eab4252ed2ada5d2f (127.8.39.66:42539), d21de976a87f470eb209cb81954a0a47 (127.8.39.67:45697)
I20260808 15:46:31.808565 9248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7348b134d02547bda35661a9d9b4f3c6" candidate_uuid: "9540fc8ad5e84d79ae28cfe96aca0f6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a644d50c13b84d5eab4252ed2ada5d2f"
I20260808 15:46:31.808631 9387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7348b134d02547bda35661a9d9b4f3c6" candidate_uuid: "9540fc8ad5e84d79ae28cfe96aca0f6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d21de976a87f470eb209cb81954a0a47"
I20260808 15:46:31.808683 9248 raft_consensus.cc:3037] T 7348b134d02547bda35661a9d9b4f3c6 P a644d50c13b84d5eab4252ed2ada5d2f [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:31.808773 9387 raft_consensus.cc:3037] T 7348b134d02547bda35661a9d9b4f3c6 P d21de976a87f470eb209cb81954a0a47 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:31.809820 9248 raft_consensus.cc:2454] T 7348b134d02547bda35661a9d9b4f3c6 P a644d50c13b84d5eab4252ed2ada5d2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9540fc8ad5e84d79ae28cfe96aca0f6c in term 1.
I20260808 15:46:31.809870 9387 raft_consensus.cc:2454] T 7348b134d02547bda35661a9d9b4f3c6 P d21de976a87f470eb209cb81954a0a47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9540fc8ad5e84d79ae28cfe96aca0f6c in term 1.
I20260808 15:46:31.810149 9037 leader_election.cc:302] T 7348b134d02547bda35661a9d9b4f3c6 P 9540fc8ad5e84d79ae28cfe96aca0f6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9540fc8ad5e84d79ae28cfe96aca0f6c, a644d50c13b84d5eab4252ed2ada5d2f; no voters:
I20260808 15:46:31.810356 9459 raft_consensus.cc:2781] T 7348b134d02547bda35661a9d9b4f3c6 P 9540fc8ad5e84d79ae28cfe96aca0f6c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:31.810600 9459 raft_consensus.cc:686] T 7348b134d02547bda35661a9d9b4f3c6 P 9540fc8ad5e84d79ae28cfe96aca0f6c [term 1 LEADER]: Becoming Leader. State: Replica: 9540fc8ad5e84d79ae28cfe96aca0f6c, State: Running, Role: LEADER
I20260808 15:46:31.810974 9459 consensus_queue.cc:237] T 7348b134d02547bda35661a9d9b4f3c6 P 9540fc8ad5e84d79ae28cfe96aca0f6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9540fc8ad5e84d79ae28cfe96aca0f6c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 45019 } } peers { permanent_uuid: "a644d50c13b84d5eab4252ed2ada5d2f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 42539 } } peers { permanent_uuid: "d21de976a87f470eb209cb81954a0a47" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45697 } }
I20260808 15:46:31.814050 8949 catalog_manager.cc:5495] T 7348b134d02547bda35661a9d9b4f3c6 P 9540fc8ad5e84d79ae28cfe96aca0f6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9540fc8ad5e84d79ae28cfe96aca0f6c (127.8.39.65). New cstate: current_term: 1 leader_uuid: "9540fc8ad5e84d79ae28cfe96aca0f6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9540fc8ad5e84d79ae28cfe96aca0f6c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a644d50c13b84d5eab4252ed2ada5d2f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 42539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d21de976a87f470eb209cb81954a0a47" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45697 } health_report { overall_health: UNKNOWN } } }
Aug 08 15:46:31 dist-test-slave-8tdl krb5kdc[8900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203990, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.65@KRBTEST.COM
I20260808 15:46:31.847699 9446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:31.838632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32868 (local address 127.8.39.65:45019)
0808 15:46:31.838817 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:31.838822 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:31.838958 (+ 136us) server_negotiation.cc:407] Connection header received
0808 15:46:31.839152 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:31.839156 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:31.839209 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:31.839295 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:31.840003 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.840508 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.841409 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.841638 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.841751 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:31.844328 (+ 2577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:31.844343 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:31.844358 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:31.844383 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:31.846101 (+ 1718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:31.846518 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:31.846523 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:31.846525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:31.846602 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:31.846888 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:31.846890 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:31.846892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:31.847154 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:31.847309 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:31.847457 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 15:46:31.847574 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260808 15:46:31.851682 9435 tablet.cc:2369] T 7348b134d02547bda35661a9d9b4f3c6 P d21de976a87f470eb209cb81954a0a47: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 15:46:31 dist-test-slave-8tdl krb5kdc[8900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203991, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
W20260808 15:46:31.872601 9156 tablet.cc:2369] T 7348b134d02547bda35661a9d9b4f3c6 P 9540fc8ad5e84d79ae28cfe96aca0f6c: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 15:46:31 dist-test-slave-8tdl krb5kdc[8900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203991, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.39.65@KRBTEST.COM
W20260808 15:46:31.874882 9296 tablet.cc:2369] T 7348b134d02547bda35661a9d9b4f3c6 P a644d50c13b84d5eab4252ed2ada5d2f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:46:31.877264 9446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:31.868711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32874 (local address 127.8.39.65:45019)
0808 15:46:31.868880 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:31.868886 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:31.869062 (+ 176us) server_negotiation.cc:407] Connection header received
0808 15:46:31.869248 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:31.869251 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:31.869294 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:31.869376 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:31.870071 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.870599 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.871460 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.871691 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.871795 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:31.874332 (+ 2537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:31.874335 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:31.874337 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:31.874361 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:31.875837 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:31.876240 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:31.876242 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:31.876244 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:31.876316 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:31.876561 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:31.876563 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:31.876564 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:31.876716 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:31.876830 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:31.877054 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 15:46:31.877148 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
Aug 08 15:46:31 dist-test-slave-8tdl krb5kdc[8900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203991, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 15:46:31 dist-test-slave-8tdl krb5kdc[8900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203991, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.65@KRBTEST.COM
I20260808 15:46:31.904721 9446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:31.896204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32880 (local address 127.8.39.65:45019)
0808 15:46:31.896385 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:31.896389 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:31.896463 (+ 74us) server_negotiation.cc:407] Connection header received
0808 15:46:31.896641 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:31.896644 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:31.896693 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:31.896773 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:31.897445 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.897943 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.898816 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:31.899022 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:31.899119 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:31.901428 (+ 2309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:31.901431 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:31.901433 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:31.901457 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:31.902763 (+ 1306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:31.903304 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:31.903324 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:31.903327 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:31.903453 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:31.903819 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:31.903824 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:31.903826 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:31.904063 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:31.904213 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:31.904449 (+ 236us) server_negotiation.cc:299] Negotiation successful
0808 15:46:31.904549 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
W20260808 15:46:31.906298 9063 tablet_service.cc:2908] Rejecting scan request for tablet 7348b134d02547bda35661a9d9b4f3c6: Uninitialized: clean time has not yet been initialized
I20260808 15:46:31.908667 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 9017
I20260808 15:46:31.915933 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 9160
I20260808 15:46:31.924970 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 9300
I20260808 15:46:31.932013 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 8914
2026-08-08T15:46:31Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2547 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:46:31 dist-test-slave-8tdl krb5kdc[9477](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:46:31 dist-test-slave-8tdl krb5kdc[9477](info): set up 2 sockets
Aug 08 15:46:31 dist-test-slave-8tdl krb5kdc[9477](info): commencing operation
krb5kdc: starting...
W20260808 15:46:33.037703 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.082s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:46:33 dist-test-slave-8tdl krb5kdc[9477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203993, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:46:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:46:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:46:33.174006 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:44717
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:43755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:44717
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:33.297801 9491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:33.298151 9491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:33.298266 9491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:33.302995 9491 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:46:33.303081 9491 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 15:46:33.303115 9491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:33.303181 9491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:33.303237 9491 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:46:33.303279 9491 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:46:33.309166 9491 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:43755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:44717
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:44717
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:33.310287 9491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:33.311394 9491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:33.319819 9496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:33.319869 9491 server_base.cc:1034] running on GCE node
W20260808 15:46:33.319837 9497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:33.319819 9499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:33.320714 9491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:33.321907 9491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:33.323132 9491 hybrid_clock.cc:648] HybridClock initialized: now 1786203993323102 us; error 40 us; skew 500 ppm
Aug 08 15:46:33 dist-test-slave-8tdl krb5kdc[9477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203993, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:33.329632 9491 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:46:33.330664 9491 webserver.cc:460] Webserver started at http://127.8.39.126:40077/ using document root <none> and password file <none>
I20260808 15:46:33.331337 9491 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:33.331434 9491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:33.331681 9491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:33.334002 9491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "bb77853812324008b4d5e2f85620c44a"
format_stamp: "Formatted at 2026-08-08 15:46:33 on dist-test-slave-8tdl"
server_key: "07f344d9baff7fbc3918c9060ec9ef6d"
server_key_iv: "895606d97f95c0fa7eb1d2e443eca1a2"
server_key_version: "encryptionkey@0"
I20260808 15:46:33.334604 9491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "bb77853812324008b4d5e2f85620c44a"
format_stamp: "Formatted at 2026-08-08 15:46:33 on dist-test-slave-8tdl"
server_key: "07f344d9baff7fbc3918c9060ec9ef6d"
server_key_iv: "895606d97f95c0fa7eb1d2e443eca1a2"
server_key_version: "encryptionkey@0"
I20260808 15:46:33.338553 9491 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 15:46:33.341022 9507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:33.342315 9491 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:46:33.342473 9491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "bb77853812324008b4d5e2f85620c44a"
format_stamp: "Formatted at 2026-08-08 15:46:33 on dist-test-slave-8tdl"
server_key: "07f344d9baff7fbc3918c9060ec9ef6d"
server_key_iv: "895606d97f95c0fa7eb1d2e443eca1a2"
server_key_version: "encryptionkey@0"
I20260808 15:46:33.342585 9491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:33.352643 9491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:33.355852 9491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:33.356078 9491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:33.365427 9491 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:44717
I20260808 15:46:33.365432 9573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:44717 every 8 connection(s)
I20260808 15:46:33.366448 9491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:46:33.369292 9574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:33.371589 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 9491
I20260808 15:46:33.371701 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:46:33.372001 8349 external_mini_cluster.cc:1428] Setting key 2dd96ef390d555961332e32c24e3c547
I20260808 15:46:33.375777 9574 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb77853812324008b4d5e2f85620c44a: Bootstrap starting.
I20260808 15:46:33.378299 9574 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bb77853812324008b4d5e2f85620c44a: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:33.379173 9574 log.cc:824] T 00000000000000000000000000000000 P bb77853812324008b4d5e2f85620c44a: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:33.381239 9574 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb77853812324008b4d5e2f85620c44a: No bootstrap required, opened a new log
Aug 08 15:46:33 dist-test-slave-8tdl krb5kdc[9477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203993, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:33.385896 9574 raft_consensus.cc:348] T 00000000000000000000000000000000 P bb77853812324008b4d5e2f85620c44a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb77853812324008b4d5e2f85620c44a" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 44717 } }
I20260808 15:46:33.386205 9574 raft_consensus.cc:374] T 00000000000000000000000000000000 P bb77853812324008b4d5e2f85620c44a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:33.386276 9574 raft_consensus.cc:729] T 00000000000000000000000000000000 P bb77853812324008b4d5e2f85620c44a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb77853812324008b4d5e2f85620c44a, State: Initialized, Role: FOLLOWER
I20260808 15:46:33.386766 9574 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb77853812324008b4d5e2f85620c44a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb77853812324008b4d5e2f85620c44a" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 44717 } }
I20260808 15:46:33.386942 9574 raft_consensus.cc:388] T 00000000000000000000000000000000 P bb77853812324008b4d5e2f85620c44a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:46:33.387018 9574 raft_consensus.cc:482] T 00000000000000000000000000000000 P bb77853812324008b4d5e2f85620c44a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:46:33.387113 9574 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bb77853812324008b4d5e2f85620c44a [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:33.387523 9577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:33.373462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57944 (local address 127.8.39.126:44717)
0808 15:46:33.373891 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:33.373912 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:33.373949 (+ 37us) server_negotiation.cc:407] Connection header received
0808 15:46:33.374884 (+ 935us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:33.374904 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:33.375240 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:33.375535 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:33.376485 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:33.377654 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:33.378844 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:33.379426 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:33.379566 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:33.382319 (+ 2753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:33.382325 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:33.382341 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:33.382372 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:33.384343 (+ 1971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:33.384819 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:33.384825 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:33.384830 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:33.384974 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:33.385221 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:33.385224 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:33.385226 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:33.385737 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:33.385946 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:33.386134 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 15:46:33.386437 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":147,"threads_started":1}
I20260808 15:46:33.388177 9574 raft_consensus.cc:504] T 00000000000000000000000000000000 P bb77853812324008b4d5e2f85620c44a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb77853812324008b4d5e2f85620c44a" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 44717 } }
I20260808 15:46:33.388531 9574 leader_election.cc:302] T 00000000000000000000000000000000 P bb77853812324008b4d5e2f85620c44a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bb77853812324008b4d5e2f85620c44a; no voters:
I20260808 15:46:33.388870 9574 leader_election.cc:288] T 00000000000000000000000000000000 P bb77853812324008b4d5e2f85620c44a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:46:33.389021 9579 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bb77853812324008b4d5e2f85620c44a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:33.389252 9579 raft_consensus.cc:686] T 00000000000000000000000000000000 P bb77853812324008b4d5e2f85620c44a [term 1 LEADER]: Becoming Leader. State: Replica: bb77853812324008b4d5e2f85620c44a, State: Running, Role: LEADER
I20260808 15:46:33.389552 9579 consensus_queue.cc:237] T 00000000000000000000000000000000 P bb77853812324008b4d5e2f85620c44a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb77853812324008b4d5e2f85620c44a" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 44717 } }
I20260808 15:46:33.390120 9574 sys_catalog.cc:564] T 00000000000000000000000000000000 P bb77853812324008b4d5e2f85620c44a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:46:33.391319 9581 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb77853812324008b4d5e2f85620c44a [sys.catalog]: SysCatalogTable state changed. Reason: New leader bb77853812324008b4d5e2f85620c44a. Latest consensus state: current_term: 1 leader_uuid: "bb77853812324008b4d5e2f85620c44a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb77853812324008b4d5e2f85620c44a" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 44717 } } }
I20260808 15:46:33.391322 9580 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb77853812324008b4d5e2f85620c44a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bb77853812324008b4d5e2f85620c44a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb77853812324008b4d5e2f85620c44a" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 44717 } } }
I20260808 15:46:33.391479 9580 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb77853812324008b4d5e2f85620c44a [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:33.391479 9581 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb77853812324008b4d5e2f85620c44a [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:33.392395 9588 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:46:33.395474 9588 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:46:33.401176 9588 catalog_manager.cc:1347] Generated new cluster ID: 6d106a4274ed4c37a3aa66684cd8b021
I20260808 15:46:33.401252 9588 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:46:33.432497 9588 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:46:33.433619 9588 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:46:33.443179 9588 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bb77853812324008b4d5e2f85620c44a: Generated new TSK 0
I20260808 15:46:33.443885 9588 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.39.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
I20260808 15:46:33.477137 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:0
--local_ip_for_outbound_sockets=127.8.39.65
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:44717
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:43755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:33.593319 9600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:33.593633 9600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:33.593715 9600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:33.597810 9600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:33.597908 9600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:33.597981 9600 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 15:46:33.598060 9600 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:46:33.603583 9600 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:43755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.39.126:44717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9600
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:33.604831 9600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:33.605895 9600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:33.615643 9607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:33.615715 9606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:33.615650 9609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:33.615996 9600 server_base.cc:1034] running on GCE node
I20260808 15:46:33.616444 9600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:33.617136 9600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:33.618330 9600 hybrid_clock.cc:648] HybridClock initialized: now 1786203993618304 us; error 43 us; skew 500 ppm
Aug 08 15:46:33 dist-test-slave-8tdl krb5kdc[9477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203993, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:33.621456 9600 init.cc:377] Logged in from keytab as kudu/127.8.39.65@KRBTEST.COM (short username kudu)
I20260808 15:46:33.622434 9600 webserver.cc:460] Webserver started at http://127.8.39.65:32947/ using document root <none> and password file <none>
I20260808 15:46:33.623097 9600 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:33.623198 9600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:33.623469 9600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:33.625660 9600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-0/data/instance:
uuid: "5323722d76a147128793565dd6d7608c"
format_stamp: "Formatted at 2026-08-08 15:46:33 on dist-test-slave-8tdl"
server_key: "027c8e9e7f2c6908540b4e8d5a440423"
server_key_iv: "0dba986360d172420902883b227aa9b4"
server_key_version: "encryptionkey@0"
I20260808 15:46:33.626281 9600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance:
uuid: "5323722d76a147128793565dd6d7608c"
format_stamp: "Formatted at 2026-08-08 15:46:33 on dist-test-slave-8tdl"
server_key: "027c8e9e7f2c6908540b4e8d5a440423"
server_key_iv: "0dba986360d172420902883b227aa9b4"
server_key_version: "encryptionkey@0"
I20260808 15:46:33.630326 9600 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260808 15:46:33.632923 9617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:33.634153 9600 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:46:33.634300 9600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "5323722d76a147128793565dd6d7608c"
format_stamp: "Formatted at 2026-08-08 15:46:33 on dist-test-slave-8tdl"
server_key: "027c8e9e7f2c6908540b4e8d5a440423"
server_key_iv: "0dba986360d172420902883b227aa9b4"
server_key_version: "encryptionkey@0"
I20260808 15:46:33.634423 9600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:33.654129 9600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:33.657567 9600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:33.657773 9600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:33.659343 9600 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:33.659412 9600 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:33.659484 9600 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:33.659529 9600 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 15:46:33 dist-test-slave-8tdl krb5kdc[9477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203993, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:33.670373 9600 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:37825
I20260808 15:46:33.670768 9740 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:37825 every 8 connection(s)
I20260808 15:46:33.671420 9600 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:46:33.673830 9577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:33.660131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:50849 (local address 127.8.39.126:44717)
0808 15:46:33.660279 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:33.660284 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:33.661152 (+ 868us) server_negotiation.cc:407] Connection header received
0808 15:46:33.662198 (+ 1046us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:33.662205 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:33.662277 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:33.662355 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:33.663850 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:33.664762 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:33.666545 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:33.666999 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:33.667130 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:33.669960 (+ 2830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:33.669966 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:33.669972 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:33.670009 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:33.671865 (+ 1856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:33.672460 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:33.672463 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:33.672464 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:33.672554 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:33.672825 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:33.672827 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:33.672828 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:33.673014 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:33.673093 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:33.673580 (+ 487us) server_negotiation.cc:299] Negotiation successful
0808 15:46:33.673705 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 15:46:33.674460 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 9600
I20260808 15:46:33.674567 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance
I20260808 15:46:33.674813 9627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:33.660549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:44717 (local address 127.8.39.65:50849)
0808 15:46:33.660989 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:33.661039 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:33.661946 (+ 907us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:33.662817 (+ 871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:33.662824 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:33.663144 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:33.663681 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:33.663698 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:33.664906 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:33.664911 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:33.666391 (+ 1480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:33.666404 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:33.667175 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:33.667180 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:33.667346 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:33.667971 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:33.667987 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:33.669769 (+ 1782us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:33.672010 (+ 2241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:33.672016 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:33.672030 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:33.672354 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:33.672624 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:33.672626 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:33.672627 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:33.672749 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:33.673103 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:33.673107 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:33.673335 (+ 228us) client_negotiation.cc:769] Sending connection context
0808 15:46:33.673518 (+ 183us) client_negotiation.cc:240] Negotiation successful
0808 15:46:33.673776 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":129,"threads_started":1}
I20260808 15:46:33.674906 8349 external_mini_cluster.cc:1428] Setting key 2856a4b4550643227e2164a7706e2e09
I20260808 15:46:33.676548 9741 heartbeater.cc:347] Connected to a master server at 127.8.39.126:44717
I20260808 15:46:33.676704 9741 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:33.677284 9741 heartbeater.cc:511] Master 127.8.39.126:44717 requested a full tablet report, sending...
I20260808 15:46:33.679080 9524 ts_manager.cc:194] Registered new tserver with Master: 5323722d76a147128793565dd6d7608c (127.8.39.65:37825)
I20260808 15:46:33.680684 9524 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.65@KRBTEST.COM'} at 127.8.39.65:50849
WARNING: no policy specified for kudu/127.8.39.66@KRBTEST.COM; defaulting to no policy
I20260808 15:46:33.687213 9748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:33.678911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:44717 (local address 127.8.39.65:50891)
0808 15:46:33.679229 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:33.679243 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:33.679344 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:33.679629 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:33.679632 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:33.679856 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:33.679987 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:33.679995 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:33.680843 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:33.680849 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:33.681614 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:33.681624 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:33.682263 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:33.682266 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:33.682355 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:33.682977 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:33.682992 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:33.683389 (+ 397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:33.685503 (+ 2114us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:33.685506 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:33.685507 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:33.685702 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:33.686048 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:33.686050 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:33.686051 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:33.686127 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:33.686605 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:33.686607 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:33.686751 (+ 144us) client_negotiation.cc:769] Sending connection context
0808 15:46:33.686918 (+ 167us) client_negotiation.cc:240] Negotiation successful
0808 15:46:33.687060 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":120,"threads_started":1}
I20260808 15:46:33.687263 9577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:33.678944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:50891 (local address 127.8.39.126:44717)
0808 15:46:33.679064 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:33.679068 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:33.679309 (+ 241us) server_negotiation.cc:407] Connection header received
0808 15:46:33.679429 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:33.679433 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:33.679499 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:33.679591 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:33.680113 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:33.680710 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:33.681745 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:33.682132 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:33.682258 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:33.683545 (+ 1287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:33.683553 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:33.683557 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:33.683591 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:33.685385 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:33.685806 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:33.685812 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:33.685816 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:33.685915 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:33.686226 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:33.686232 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:33.686236 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:33.686482 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:33.686584 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:33.686994 (+ 410us) server_negotiation.cc:299] Negotiation successful
0808 15:46:33.687133 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
I20260808 15:46:33.705453 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:0
--local_ip_for_outbound_sockets=127.8.39.66
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:44717
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:43755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:33.822366 9750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:33.822643 9750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:33.822747 9750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:33.826787 9750 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:33.826858 9750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:33.826898 9750 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 15:46:33.826965 9750 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:46:33.832377 9750 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:43755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.39.126:44717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9750
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:33.833446 9750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:33.834479 9750 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:33.844213 9758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:33.844177 9756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:33.844188 9755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:33.844264 9750 server_base.cc:1034] running on GCE node
I20260808 15:46:33.844753 9750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:33.845405 9750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:33.846623 9750 hybrid_clock.cc:648] HybridClock initialized: now 1786203993846599 us; error 41 us; skew 500 ppm
Aug 08 15:46:33 dist-test-slave-8tdl krb5kdc[9477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203993, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:33.849318 9750 init.cc:377] Logged in from keytab as kudu/127.8.39.66@KRBTEST.COM (short username kudu)
I20260808 15:46:33.850179 9750 webserver.cc:460] Webserver started at http://127.8.39.66:38487/ using document root <none> and password file <none>
I20260808 15:46:33.850818 9750 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:33.850924 9750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:33.851154 9750 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:33.853257 9750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-1/data/instance:
uuid: "518661ec5e6d4d47a25c2d48d8c9828f"
format_stamp: "Formatted at 2026-08-08 15:46:33 on dist-test-slave-8tdl"
server_key: "b5a28858336d197ae9572df1b4ae5201"
server_key_iv: "e185ff876849d547207796e05344917b"
server_key_version: "encryptionkey@0"
I20260808 15:46:33.853827 9750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance:
uuid: "518661ec5e6d4d47a25c2d48d8c9828f"
format_stamp: "Formatted at 2026-08-08 15:46:33 on dist-test-slave-8tdl"
server_key: "b5a28858336d197ae9572df1b4ae5201"
server_key_iv: "e185ff876849d547207796e05344917b"
server_key_version: "encryptionkey@0"
I20260808 15:46:33.857618 9750 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 15:46:33.860127 9765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:33.861348 9750 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:46:33.861467 9750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "518661ec5e6d4d47a25c2d48d8c9828f"
format_stamp: "Formatted at 2026-08-08 15:46:33 on dist-test-slave-8tdl"
server_key: "b5a28858336d197ae9572df1b4ae5201"
server_key_iv: "e185ff876849d547207796e05344917b"
server_key_version: "encryptionkey@0"
I20260808 15:46:33.861588 9750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:33.883450 9750 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:33.886597 9750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:33.886864 9750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:33.888274 9750 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:33.888324 9750 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:33.888386 9750 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:33.888420 9750 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 15:46:33 dist-test-slave-8tdl krb5kdc[9477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203993, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:33.899637 9750 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:44615
I20260808 15:46:33.899681 9889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:44615 every 8 connection(s)
I20260808 15:46:33.900755 9750 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:46:33.902383 9577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:33.889277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:53545 (local address 127.8.39.126:44717)
0808 15:46:33.889408 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:33.889413 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:33.890317 (+ 904us) server_negotiation.cc:407] Connection header received
0808 15:46:33.891694 (+ 1377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:33.891697 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:33.891759 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:33.891871 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:33.893493 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:33.894052 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:33.895316 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:33.895536 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:33.895646 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:33.898495 (+ 2849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:33.898499 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:33.898507 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:33.898532 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:33.900197 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:33.900682 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:33.900685 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:33.900687 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:33.900788 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:33.901227 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:33.901231 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:33.901232 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:33.901457 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:33.901554 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:33.902155 (+ 601us) server_negotiation.cc:299] Negotiation successful
0808 15:46:33.902262 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 15:46:33.902810 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 9750
I20260808 15:46:33.902925 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance
I20260808 15:46:33.903174 8349 external_mini_cluster.cc:1428] Setting key 9f88a27219473350c37d07db9e84782b
I20260808 15:46:33.903296 9774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:33.889673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:44717 (local address 127.8.39.66:53545)
0808 15:46:33.890130 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:33.890223 (+ 93us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:33.891474 (+ 1251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:33.892098 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:33.892107 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:33.892624 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:33.893298 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:33.893317 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:33.894186 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:33.894189 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:33.895177 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:33.895188 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:33.895723 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:33.895728 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:33.895901 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:33.896597 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:33.896620 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:33.898323 (+ 1703us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:33.900310 (+ 1987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:33.900315 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:33.900325 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:33.900575 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:33.900912 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:33.900915 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:33.900917 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:33.901102 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:33.901612 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:33.901620 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:33.901910 (+ 290us) client_negotiation.cc:769] Sending connection context
0808 15:46:33.902090 (+ 180us) client_negotiation.cc:240] Negotiation successful
0808 15:46:33.902325 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":133,"threads_started":1}
I20260808 15:46:33.906745 9890 heartbeater.cc:347] Connected to a master server at 127.8.39.126:44717
I20260808 15:46:33.906895 9890 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:33.907485 9890 heartbeater.cc:511] Master 127.8.39.126:44717 requested a full tablet report, sending...
I20260808 15:46:33.908457 9525 ts_manager.cc:194] Registered new tserver with Master: 518661ec5e6d4d47a25c2d48d8c9828f (127.8.39.66:44615)
I20260808 15:46:33.909013 9525 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.66@KRBTEST.COM'} at 127.8.39.66:53545
I20260808 15:46:33.915016 9577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:33.906868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:40823 (local address 127.8.39.126:44717)
0808 15:46:33.907057 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:33.907063 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:33.907312 (+ 249us) server_negotiation.cc:407] Connection header received
0808 15:46:33.907420 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:33.907423 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:33.907470 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:33.907568 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:33.908328 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:33.909145 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:33.910278 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:33.910609 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:33.910756 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:33.911873 (+ 1117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:33.911876 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:33.911879 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:33.911903 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:33.913331 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:33.913762 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:33.913765 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:33.913767 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:33.913844 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:33.914119 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:33.914122 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:33.914124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:33.914336 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:33.914442 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:33.914730 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 15:46:33.914855 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260808 15:46:33.915035 9897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:33.906825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:44717 (local address 127.8.39.66:40823)
0808 15:46:33.907215 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:33.907230 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:33.907333 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:33.907776 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:33.907781 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:33.908022 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:33.908181 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:33.908192 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:33.909380 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:33.909383 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:33.910150 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:33.910161 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:33.910749 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:33.910753 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:33.910856 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:33.911383 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:33.911401 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:33.911732 (+ 331us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:33.913450 (+ 1718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:33.913453 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:33.913455 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:33.913661 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:33.913932 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:33.913936 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:33.913938 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:33.914030 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:33.914433 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:33.914435 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:33.914534 (+ 99us) client_negotiation.cc:769] Sending connection context
0808 15:46:33.914638 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 15:46:33.914841 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":105,"threads_started":1}
WARNING: no policy specified for kudu/127.8.39.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
I20260808 15:46:33.933863 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:0
--local_ip_for_outbound_sockets=127.8.39.67
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:44717
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:43755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:34.048020 9900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:34.048305 9900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:34.048386 9900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:34.052443 9900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:34.052536 9900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:34.052603 9900 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 15:46:34.052685 9900 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:46:34.058094 9900 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:43755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.39.126:44717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9900
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:34.059238 9900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:34.060253 9900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:34.070109 9907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:34.070264 9900 server_base.cc:1034] running on GCE node
W20260808 15:46:34.070109 9906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:34.070109 9909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:34.070997 9900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:34.071661 9900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:34.072839 9900 hybrid_clock.cc:648] HybridClock initialized: now 1786203994072814 us; error 39 us; skew 500 ppm
Aug 08 15:46:34 dist-test-slave-8tdl krb5kdc[9477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203994, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:34.075668 9900 init.cc:377] Logged in from keytab as kudu/127.8.39.67@KRBTEST.COM (short username kudu)
I20260808 15:46:34.076628 9900 webserver.cc:460] Webserver started at http://127.8.39.67:34957/ using document root <none> and password file <none>
I20260808 15:46:34.077235 9900 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:34.077325 9900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:34.077557 9900 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:34.079653 9900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-2/data/instance:
uuid: "045555061ba24a73a9d2e3d3973cd4d8"
format_stamp: "Formatted at 2026-08-08 15:46:34 on dist-test-slave-8tdl"
server_key: "2c5ac51a6416b311ebfbcef38d0b9a09"
server_key_iv: "9276f29a5511dda059e1fb65fea0b9e8"
server_key_version: "encryptionkey@0"
I20260808 15:46:34.080233 9900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance:
uuid: "045555061ba24a73a9d2e3d3973cd4d8"
format_stamp: "Formatted at 2026-08-08 15:46:34 on dist-test-slave-8tdl"
server_key: "2c5ac51a6416b311ebfbcef38d0b9a09"
server_key_iv: "9276f29a5511dda059e1fb65fea0b9e8"
server_key_version: "encryptionkey@0"
I20260808 15:46:34.084395 9900 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 15:46:34.087054 9916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:34.088233 9900 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:46:34.088370 9900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "045555061ba24a73a9d2e3d3973cd4d8"
format_stamp: "Formatted at 2026-08-08 15:46:34 on dist-test-slave-8tdl"
server_key: "2c5ac51a6416b311ebfbcef38d0b9a09"
server_key_iv: "9276f29a5511dda059e1fb65fea0b9e8"
server_key_version: "encryptionkey@0"
I20260808 15:46:34.088480 9900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:34.135946 9900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:34.140095 9900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:34.140311 9900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:34.141885 9900 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:34.141935 9900 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:34.142009 9900 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:34.142040 9900 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 15:46:34 dist-test-slave-8tdl krb5kdc[9477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203994, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:34.153813 9900 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:34653
I20260808 15:46:34.153837 10036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:34653 every 8 connection(s)
I20260808 15:46:34.155069 9900 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:46:34.156432 9577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.142753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:33761 (local address 127.8.39.126:44717)
0808 15:46:34.142909 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:34.142914 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:34.143990 (+ 1076us) server_negotiation.cc:407] Connection header received
0808 15:46:34.144987 (+ 997us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:34.144991 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:34.145051 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:34.145113 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:34.146968 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.147710 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.148850 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.149097 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.149217 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.152297 (+ 3080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:34.152301 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:34.152304 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:34.152338 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:34.154192 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:34.154722 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:34.154726 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:34.154728 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:34.154856 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:34.155242 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:34.155245 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:34.155247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:34.155433 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:34.155550 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:34.156132 (+ 582us) server_negotiation.cc:299] Negotiation successful
0808 15:46:34.156259 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 15:46:34.157176 9925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.143317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:44717 (local address 127.8.39.67:33761)
0808 15:46:34.143850 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:34.143893 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:34.144712 (+ 819us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:34.145568 (+ 856us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:34.145578 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:34.146070 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:34.146792 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:34.146816 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.147839 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.147842 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:34.148725 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:34.148734 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.149275 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.149279 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:34.149447 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.150090 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:34.150117 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:34.152122 (+ 2005us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:34.154305 (+ 2183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:34.154310 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:34.154321 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:34.154578 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:34.154946 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:34.154948 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:34.154949 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:34.155100 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:34.155550 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:34.155557 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:34.155858 (+ 301us) client_negotiation.cc:769] Sending connection context
0808 15:46:34.156068 (+ 210us) client_negotiation.cc:240] Negotiation successful
0808 15:46:34.156383 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":155,"threads_started":1}
I20260808 15:46:34.158257 10037 heartbeater.cc:347] Connected to a master server at 127.8.39.126:44717
I20260808 15:46:34.158411 10037 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:34.158943 10037 heartbeater.cc:511] Master 127.8.39.126:44717 requested a full tablet report, sending...
I20260808 15:46:34.160032 9525 ts_manager.cc:194] Registered new tserver with Master: 045555061ba24a73a9d2e3d3973cd4d8 (127.8.39.67:34653)
I20260808 15:46:34.160737 9525 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.67@KRBTEST.COM'} at 127.8.39.67:33761
I20260808 15:46:34.161444 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 9900
I20260808 15:46:34.161568 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance
I20260808 15:46:34.161830 8349 external_mini_cluster.cc:1428] Setting key 0670ef304e3c993bc1d1e4d9a721b023
I20260808 15:46:34.163707 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:46:34.169238 9577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.161043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:56339 (local address 127.8.39.126:44717)
0808 15:46:34.161139 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:34.161142 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:34.161153 (+ 11us) server_negotiation.cc:407] Connection header received
0808 15:46:34.161181 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:34.161183 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:34.161216 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:34.161301 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:34.163189 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.163697 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.164561 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.164836 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.164943 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.166164 (+ 1221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:34.166167 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:34.166170 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:34.166194 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:34.167637 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:34.168060 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:34.168065 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:34.168066 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:34.168149 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:34.168414 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:34.168419 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:34.168421 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:34.168602 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:34.168704 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:34.168963 (+ 259us) server_negotiation.cc:299] Negotiation successful
0808 15:46:34.169076 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 15:46:34.169252 10043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.160308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:44717 (local address 127.8.39.67:56339)
0808 15:46:34.160580 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:34.160592 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:34.160662 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:34.162774 (+ 2112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:34.162777 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:34.162972 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:34.163074 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:34.163079 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.163828 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.163831 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:34.164412 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:34.164420 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.164960 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.164963 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:34.165073 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.165611 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:34.165623 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:34.166039 (+ 416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:34.167756 (+ 1717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:34.167759 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:34.167761 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:34.167958 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:34.168237 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:34.168241 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:34.168243 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:34.168328 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:34.168694 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:34.168697 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:34.168793 (+ 96us) client_negotiation.cc:769] Sending connection context
0808 15:46:34.168895 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 15:46:34.169052 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":106,"threads_started":1}
Aug 08 15:46:34 dist-test-slave-8tdl krb5kdc[9477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203994, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 15:46:34 dist-test-slave-8tdl krb5kdc[9477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203994, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:34.192368 9577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.183579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57946 (local address 127.8.39.126:44717)
0808 15:46:34.183724 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:34.183727 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:34.183743 (+ 16us) server_negotiation.cc:407] Connection header received
0808 15:46:34.183789 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:34.183791 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:34.183832 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:34.183992 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:34.184927 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.185574 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.186429 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.186653 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.186789 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.189245 (+ 2456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:34.189248 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:34.189250 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:34.189275 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:34.190642 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:34.191151 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:34.191154 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:34.191155 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:34.191229 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:34.191488 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:34.191491 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:34.191492 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:34.191705 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:34.191834 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:34.192101 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 15:46:34.192245 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 15:46:34.195276 9525 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57946:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:46:34.198298 9525 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:46:34.213292 10058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.207128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36280 (local address 127.8.39.67:34653)
0808 15:46:34.207496 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:34.207509 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:34.207999 (+ 490us) server_negotiation.cc:407] Connection header received
0808 15:46:34.208087 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:34.208093 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:34.208297 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:34.208456 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:46:34.208830 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.210028 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.211846 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.212672 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.212781 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.212959 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:34.213013 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 15:46:34.213108 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":117,"threads_started":1}
I20260808 15:46:34.213316 10059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.206906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:37825 (local address 127.0.0.1:49032)
0808 15:46:34.207777 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:34.207793 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:34.207923 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:34.208468 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:34.208473 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:34.208494 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:46:34.208630 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:34.208637 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.210180 (+ 1543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.210183 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:34.211444 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:34.211454 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.212634 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.212640 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:34.212777 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.212827 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 15:46:34.212928 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 15:46:34.213143 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":804,"mutex_wait_us":232,"spinlock_wait_cycles":11648,"thread_start_us":118,"threads_started":1}
I20260808 15:46:34.213632 10056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.207431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:44615 (local address 127.0.0.1:39922)
0808 15:46:34.207813 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:34.207826 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:34.207917 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:34.209005 (+ 1088us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:34.209010 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:34.209027 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:46:34.209121 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:34.209127 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.210111 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.210118 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:34.211696 (+ 1578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:34.211707 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.213015 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.213020 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:34.213106 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.213129 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 15:46:34.213201 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 15:46:34.213268 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"mutex_wait_us":148,"thread_start_us":119,"threads_started":1}
I20260808 15:46:34.213657 10060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.208007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39922 (local address 127.8.39.66:44615)
0808 15:46:34.208392 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:34.208404 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:34.208435 (+ 31us) server_negotiation.cc:407] Connection header received
0808 15:46:34.208510 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:34.208515 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:34.208694 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:34.208841 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:46:34.209245 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.209991 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.211846 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.212677 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.212781 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.212947 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:34.213400 (+ 453us) server_negotiation.cc:299] Negotiation successful
0808 15:46:34.213509 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":213,"threads_started":1}
I20260808 15:46:34.213317 10055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.206662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:34653 (local address 127.0.0.1:36280)
0808 15:46:34.207647 (+ 985us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:34.207699 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:34.207844 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:34.208608 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:34.208610 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:34.208624 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:46:34.208711 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:34.208720 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.210157 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.210160 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:34.211697 (+ 1537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:34.211707 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.212806 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.212809 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:34.212888 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.212915 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 15:46:34.212971 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 15:46:34.213144 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":822,"mutex_wait_us":189,"thread_start_us":80,"threads_started":1}
I20260808 15:46:34.214320 10057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.207076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49032 (local address 127.8.39.65:37825)
0808 15:46:34.207685 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:34.207691 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:34.208029 (+ 338us) server_negotiation.cc:407] Connection header received
0808 15:46:34.208110 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:34.208115 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:34.208296 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:34.208785 (+ 489us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:46:34.208938 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.210029 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.211581 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.212431 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.213866 (+ 1435us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.214027 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:34.214094 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 15:46:34.214191 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":517,"thread_start_us":85,"threads_started":1}
I20260808 15:46:34.216547 9820 tablet_service.cc:1467] Processing CreateTablet for tablet aae6b1eb525a4a0ea99091bda150ecd9 (DEFAULT_TABLE table=test-table [id=8adcd1533f954e35bf0d6d707e1acdbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:34.216651 9670 tablet_service.cc:1467] Processing CreateTablet for tablet aae6b1eb525a4a0ea99091bda150ecd9 (DEFAULT_TABLE table=test-table [id=8adcd1533f954e35bf0d6d707e1acdbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:34.216614 9967 tablet_service.cc:1467] Processing CreateTablet for tablet aae6b1eb525a4a0ea99091bda150ecd9 (DEFAULT_TABLE table=test-table [id=8adcd1533f954e35bf0d6d707e1acdbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:34.217556 9820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aae6b1eb525a4a0ea99091bda150ecd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:34.217617 9670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aae6b1eb525a4a0ea99091bda150ecd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:34.217624 9967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aae6b1eb525a4a0ea99091bda150ecd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:34.224280 10061 tablet_bootstrap.cc:492] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f: Bootstrap starting.
I20260808 15:46:34.225235 10062 tablet_bootstrap.cc:492] T aae6b1eb525a4a0ea99091bda150ecd9 P 5323722d76a147128793565dd6d7608c: Bootstrap starting.
I20260808 15:46:34.225754 10063 tablet_bootstrap.cc:492] T aae6b1eb525a4a0ea99091bda150ecd9 P 045555061ba24a73a9d2e3d3973cd4d8: Bootstrap starting.
I20260808 15:46:34.227103 10061 tablet_bootstrap.cc:654] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:34.227120 10062 tablet_bootstrap.cc:654] T aae6b1eb525a4a0ea99091bda150ecd9 P 5323722d76a147128793565dd6d7608c: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:34.227669 10063 tablet_bootstrap.cc:654] T aae6b1eb525a4a0ea99091bda150ecd9 P 045555061ba24a73a9d2e3d3973cd4d8: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:34.227931 10062 log.cc:824] T aae6b1eb525a4a0ea99091bda150ecd9 P 5323722d76a147128793565dd6d7608c: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:34.228051 10061 log.cc:824] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:34.228441 10063 log.cc:824] T aae6b1eb525a4a0ea99091bda150ecd9 P 045555061ba24a73a9d2e3d3973cd4d8: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:34.229694 10062 tablet_bootstrap.cc:492] T aae6b1eb525a4a0ea99091bda150ecd9 P 5323722d76a147128793565dd6d7608c: No bootstrap required, opened a new log
I20260808 15:46:34.229888 10062 ts_tablet_manager.cc:1397] T aae6b1eb525a4a0ea99091bda150ecd9 P 5323722d76a147128793565dd6d7608c: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 15:46:34.230289 10063 tablet_bootstrap.cc:492] T aae6b1eb525a4a0ea99091bda150ecd9 P 045555061ba24a73a9d2e3d3973cd4d8: No bootstrap required, opened a new log
I20260808 15:46:34.230469 10063 ts_tablet_manager.cc:1397] T aae6b1eb525a4a0ea99091bda150ecd9 P 045555061ba24a73a9d2e3d3973cd4d8: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 15:46:34.231191 10061 tablet_bootstrap.cc:492] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f: No bootstrap required, opened a new log
I20260808 15:46:34.231379 10061 ts_tablet_manager.cc:1397] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 15:46:34.233652 10062 raft_consensus.cc:348] T aae6b1eb525a4a0ea99091bda150ecd9 P 5323722d76a147128793565dd6d7608c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } } peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } }
I20260808 15:46:34.233893 10062 raft_consensus.cc:374] T aae6b1eb525a4a0ea99091bda150ecd9 P 5323722d76a147128793565dd6d7608c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:34.233946 10062 raft_consensus.cc:729] T aae6b1eb525a4a0ea99091bda150ecd9 P 5323722d76a147128793565dd6d7608c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5323722d76a147128793565dd6d7608c, State: Initialized, Role: FOLLOWER
I20260808 15:46:34.234395 10062 consensus_queue.cc:260] T aae6b1eb525a4a0ea99091bda150ecd9 P 5323722d76a147128793565dd6d7608c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } } peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } }
I20260808 15:46:34.234386 10063 raft_consensus.cc:348] T aae6b1eb525a4a0ea99091bda150ecd9 P 045555061ba24a73a9d2e3d3973cd4d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } } peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } }
I20260808 15:46:34.234638 10063 raft_consensus.cc:374] T aae6b1eb525a4a0ea99091bda150ecd9 P 045555061ba24a73a9d2e3d3973cd4d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:34.234799 10063 raft_consensus.cc:729] T aae6b1eb525a4a0ea99091bda150ecd9 P 045555061ba24a73a9d2e3d3973cd4d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 045555061ba24a73a9d2e3d3973cd4d8, State: Initialized, Role: FOLLOWER
I20260808 15:46:34.235257 10063 consensus_queue.cc:260] T aae6b1eb525a4a0ea99091bda150ecd9 P 045555061ba24a73a9d2e3d3973cd4d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } } peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } }
I20260808 15:46:34.235463 10062 ts_tablet_manager.cc:1428] T aae6b1eb525a4a0ea99091bda150ecd9 P 5323722d76a147128793565dd6d7608c: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 15:46:34.235466 10061 raft_consensus.cc:348] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } } peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } }
I20260808 15:46:34.235886 9741 heartbeater.cc:503] Master 127.8.39.126:44717 was elected leader, sending a full tablet report...
I20260808 15:46:34.236234 10063 ts_tablet_manager.cc:1428] T aae6b1eb525a4a0ea99091bda150ecd9 P 045555061ba24a73a9d2e3d3973cd4d8: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260808 15:46:34.236567 10037 heartbeater.cc:503] Master 127.8.39.126:44717 was elected leader, sending a full tablet report...
I20260808 15:46:34.236821 10061 raft_consensus.cc:374] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:34.236900 10061 raft_consensus.cc:729] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 518661ec5e6d4d47a25c2d48d8c9828f, State: Initialized, Role: FOLLOWER
I20260808 15:46:34.237327 10061 consensus_queue.cc:260] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } } peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } }
I20260808 15:46:34.238343 10061 ts_tablet_manager.cc:1428] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260808 15:46:34.238718 9890 heartbeater.cc:503] Master 127.8.39.126:44717 was elected leader, sending a full tablet report...
W20260808 15:46:34.402420 9891 tablet.cc:2369] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:46:34.406497 10038 tablet.cc:2369] T aae6b1eb525a4a0ea99091bda150ecd9 P 045555061ba24a73a9d2e3d3973cd4d8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:46:34.422889 9742 tablet.cc:2369] T aae6b1eb525a4a0ea99091bda150ecd9 P 5323722d76a147128793565dd6d7608c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:46:34.492393 10069 raft_consensus.cc:482] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:46:34.492645 10069 raft_consensus.cc:504] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } } peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } }
I20260808 15:46:34.493911 10069 leader_election.cc:288] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 045555061ba24a73a9d2e3d3973cd4d8 (127.8.39.67:34653), 5323722d76a147128793565dd6d7608c (127.8.39.65:37825)
I20260808 15:46:34.499359 10057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.494321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:55999 (local address 127.8.39.65:37825)
0808 15:46:34.494467 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:34.494475 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:34.494668 (+ 193us) server_negotiation.cc:407] Connection header received
0808 15:46:34.494865 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:34.494868 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:34.494927 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:34.495055 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:46:34.495396 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.496207 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.498025 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.498652 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.498792 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.498859 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:34.499152 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 15:46:34.499223 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 15:46:34.499359 10058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.494346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:35073 (local address 127.8.39.67:34653)
0808 15:46:34.494475 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:34.494480 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:34.494750 (+ 270us) server_negotiation.cc:407] Connection header received
0808 15:46:34.494875 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:34.494878 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:34.494927 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:34.495018 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:46:34.495396 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.496182 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.498008 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.498652 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.498792 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.498859 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:34.499147 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 15:46:34.499223 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 15:46:34.499424 10071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.494218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:37825 (local address 127.8.39.66:55999)
0808 15:46:34.494559 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:34.494574 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:34.494732 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:34.495061 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:34.495063 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:34.495074 (+ 11us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:46:34.495267 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:34.495275 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.496319 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.496323 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:34.497867 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:34.497879 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.498892 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.498896 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:34.499023 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.499044 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 15:46:34.499111 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 15:46:34.499230 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"mutex_wait_us":231,"thread_start_us":94,"threads_started":1}
I20260808 15:46:34.499434 10070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.494250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:34653 (local address 127.8.39.66:35073)
0808 15:46:34.494645 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:34.494658 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:34.494764 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:34.495044 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:34.495049 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:34.495068 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:46:34.495271 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:34.495275 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.496319 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.496323 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:34.497869 (+ 1546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:34.497879 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.498836 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.498841 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:34.498958 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.499011 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 15:46:34.499111 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 15:46:34.499229 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"mutex_wait_us":235,"thread_start_us":106,"threads_started":1}
I20260808 15:46:34.500209 9989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aae6b1eb525a4a0ea99091bda150ecd9" candidate_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "045555061ba24a73a9d2e3d3973cd4d8" is_pre_election: true
I20260808 15:46:34.500218 9690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aae6b1eb525a4a0ea99091bda150ecd9" candidate_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5323722d76a147128793565dd6d7608c" is_pre_election: true
I20260808 15:46:34.500521 9690 raft_consensus.cc:2454] T aae6b1eb525a4a0ea99091bda150ecd9 P 5323722d76a147128793565dd6d7608c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 518661ec5e6d4d47a25c2d48d8c9828f in term 0.
I20260808 15:46:34.500526 9989 raft_consensus.cc:2454] T aae6b1eb525a4a0ea99091bda150ecd9 P 045555061ba24a73a9d2e3d3973cd4d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 518661ec5e6d4d47a25c2d48d8c9828f in term 0.
I20260808 15:46:34.501021 9768 leader_election.cc:302] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 045555061ba24a73a9d2e3d3973cd4d8, 518661ec5e6d4d47a25c2d48d8c9828f, 5323722d76a147128793565dd6d7608c; no voters:
I20260808 15:46:34.501331 10069 raft_consensus.cc:2781] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:46:34.501423 10069 raft_consensus.cc:482] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:46:34.501475 10069 raft_consensus.cc:3037] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:34.502902 10069 raft_consensus.cc:504] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } } peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } }
I20260808 15:46:34.503273 10069 leader_election.cc:288] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f [CANDIDATE]: Term 1 election: Requested vote from peers 045555061ba24a73a9d2e3d3973cd4d8 (127.8.39.67:34653), 5323722d76a147128793565dd6d7608c (127.8.39.65:37825)
I20260808 15:46:34.503693 9690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aae6b1eb525a4a0ea99091bda150ecd9" candidate_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5323722d76a147128793565dd6d7608c"
I20260808 15:46:34.503692 9989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aae6b1eb525a4a0ea99091bda150ecd9" candidate_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "045555061ba24a73a9d2e3d3973cd4d8"
I20260808 15:46:34.503846 9989 raft_consensus.cc:3037] T aae6b1eb525a4a0ea99091bda150ecd9 P 045555061ba24a73a9d2e3d3973cd4d8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:34.503846 9690 raft_consensus.cc:3037] T aae6b1eb525a4a0ea99091bda150ecd9 P 5323722d76a147128793565dd6d7608c [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:34.505404 9690 raft_consensus.cc:2454] T aae6b1eb525a4a0ea99091bda150ecd9 P 5323722d76a147128793565dd6d7608c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 518661ec5e6d4d47a25c2d48d8c9828f in term 1.
I20260808 15:46:34.505836 9768 leader_election.cc:302] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518661ec5e6d4d47a25c2d48d8c9828f, 5323722d76a147128793565dd6d7608c; no voters:
I20260808 15:46:34.505851 9989 raft_consensus.cc:2454] T aae6b1eb525a4a0ea99091bda150ecd9 P 045555061ba24a73a9d2e3d3973cd4d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 518661ec5e6d4d47a25c2d48d8c9828f in term 1.
I20260808 15:46:34.506136 10069 raft_consensus.cc:2781] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:34.506381 10069 raft_consensus.cc:686] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f [term 1 LEADER]: Becoming Leader. State: Replica: 518661ec5e6d4d47a25c2d48d8c9828f, State: Running, Role: LEADER
I20260808 15:46:34.506788 10069 consensus_queue.cc:237] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } } peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } }
I20260808 15:46:34.509778 9524 catalog_manager.cc:5495] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f reported cstate change: term changed from 0 to 1, leader changed from <none> to 518661ec5e6d4d47a25c2d48d8c9828f (127.8.39.66). New cstate: current_term: 1 leader_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } health_report { overall_health: HEALTHY } } }
I20260808 15:46:34.591805 10060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.587951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48646 (local address 127.8.39.66:44615)
0808 15:46:34.588084 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:34.588088 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:34.588103 (+ 15us) server_negotiation.cc:407] Connection header received
0808 15:46:34.588174 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:34.588176 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:34.588238 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:34.588321 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:46:34.588621 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.589123 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.590126 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.590341 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.590424 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.590812 (+ 388us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:46:34.591341 (+ 529us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:46:34.591513 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:34.591595 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 15:46:34.591657 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 15:46:34.597640 9989 raft_consensus.cc:1261] T aae6b1eb525a4a0ea99091bda150ecd9 P 045555061ba24a73a9d2e3d3973cd4d8 [term 1 FOLLOWER]: Refusing update from remote peer 518661ec5e6d4d47a25c2d48d8c9828f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:46:34.597687 9690 raft_consensus.cc:1261] T aae6b1eb525a4a0ea99091bda150ecd9 P 5323722d76a147128793565dd6d7608c [term 1 FOLLOWER]: Refusing update from remote peer 518661ec5e6d4d47a25c2d48d8c9828f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:46:34.598338 10069 consensus_queue.cc:1035] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f [LEADER]: Connected to new peer: Peer: permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:46:34.598563 10072 consensus_queue.cc:1035] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:46:34.604761 10075 mvcc.cc:205] Tried to move back new op lower bound from 7316291561864753152 to 7316291561502294016. Current Snapshot: MvccSnapshot[applied={T|T < 7316291561864753152}]
I20260808 15:46:34.606289 10076 mvcc.cc:205] Tried to move back new op lower bound from 7316291561864753152 to 7316291561502294016. Current Snapshot: MvccSnapshot[applied={T|T < 7316291561864753152}]
I20260808 15:46:34.618376 9525 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57946:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:46:34.618629 9525 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57946:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:46:34.621207 9525 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bb77853812324008b4d5e2f85620c44a: Sending DeleteTablet for 3 replicas of tablet aae6b1eb525a4a0ea99091bda150ecd9
I20260808 15:46:34.622089 9670 tablet_service.cc:1514] Processing DeleteTablet for tablet aae6b1eb525a4a0ea99091bda150ecd9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:46:34 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:49032
I20260808 15:46:34.622097 9967 tablet_service.cc:1514] Processing DeleteTablet for tablet aae6b1eb525a4a0ea99091bda150ecd9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:46:34 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:36280
I20260808 15:46:34.622859 9524 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57946:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 15:46:34.622921 9820 tablet_service.cc:1514] Processing DeleteTablet for tablet aae6b1eb525a4a0ea99091bda150ecd9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:46:34 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:39922
I20260808 15:46:34.622972 10085 tablet_replica.cc:330] T aae6b1eb525a4a0ea99091bda150ecd9 P 045555061ba24a73a9d2e3d3973cd4d8: stopping tablet replica
W20260808 15:46:34.623283 9524 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:46:34.623476 10085 raft_consensus.cc:2229] T aae6b1eb525a4a0ea99091bda150ecd9 P 045555061ba24a73a9d2e3d3973cd4d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:46:34.623510 10086 tablet_replica.cc:330] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f: stopping tablet replica
I20260808 15:46:34.623848 10085 raft_consensus.cc:2258] T aae6b1eb525a4a0ea99091bda150ecd9 P 045555061ba24a73a9d2e3d3973cd4d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:46:34.623888 10086 raft_consensus.cc:2229] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:46:34.624300 10084 tablet_replica.cc:330] T aae6b1eb525a4a0ea99091bda150ecd9 P 5323722d76a147128793565dd6d7608c: stopping tablet replica
I20260808 15:46:34.624317 10086 raft_consensus.cc:2258] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:46:34.624646 10084 raft_consensus.cc:2229] T aae6b1eb525a4a0ea99091bda150ecd9 P 5323722d76a147128793565dd6d7608c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:46:34.624960 10084 raft_consensus.cc:2258] T aae6b1eb525a4a0ea99091bda150ecd9 P 5323722d76a147128793565dd6d7608c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:46:34.626298 10086 ts_tablet_manager.cc:1905] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:46:34.626802 10085 ts_tablet_manager.cc:1905] T aae6b1eb525a4a0ea99091bda150ecd9 P 045555061ba24a73a9d2e3d3973cd4d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:46:34.627562 10084 ts_tablet_manager.cc:1905] T aae6b1eb525a4a0ea99091bda150ecd9 P 5323722d76a147128793565dd6d7608c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:46:34.628957 9670 tablet_service.cc:1467] Processing CreateTablet for tablet 61c592a8e336482282a75eb3f334fd77 (DEFAULT_TABLE table=test-table [id=a5abb60dc5dd46dc97ad42410ae972a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:34.629279 9670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61c592a8e336482282a75eb3f334fd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:34.629436 10086 ts_tablet_manager.cc:1918] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:46:34.629601 10086 log.cc:1196] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-1/wal/wals/aae6b1eb525a4a0ea99091bda150ecd9
I20260808 15:46:34.629885 10085 ts_tablet_manager.cc:1918] T aae6b1eb525a4a0ea99091bda150ecd9 P 045555061ba24a73a9d2e3d3973cd4d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:46:34.630012 10085 log.cc:1196] T aae6b1eb525a4a0ea99091bda150ecd9 P 045555061ba24a73a9d2e3d3973cd4d8: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/aae6b1eb525a4a0ea99091bda150ecd9
I20260808 15:46:34.630054 10086 ts_tablet_manager.cc:1939] T aae6b1eb525a4a0ea99091bda150ecd9 P 518661ec5e6d4d47a25c2d48d8c9828f: Deleting consensus metadata
I20260808 15:46:34.630429 10085 ts_tablet_manager.cc:1939] T aae6b1eb525a4a0ea99091bda150ecd9 P 045555061ba24a73a9d2e3d3973cd4d8: Deleting consensus metadata
I20260808 15:46:34.630797 9820 tablet_service.cc:1467] Processing CreateTablet for tablet 61c592a8e336482282a75eb3f334fd77 (DEFAULT_TABLE table=test-table [id=a5abb60dc5dd46dc97ad42410ae972a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:34.631063 9820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61c592a8e336482282a75eb3f334fd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:34.631423 9509 catalog_manager.cc:4841] TS 518661ec5e6d4d47a25c2d48d8c9828f (127.8.39.66:44615): tablet aae6b1eb525a4a0ea99091bda150ecd9 (table test-table [id=8adcd1533f954e35bf0d6d707e1acdbe]) successfully deleted
I20260808 15:46:34.632144 10062 tablet_bootstrap.cc:492] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c: Bootstrap starting.
I20260808 15:46:34.632933 10061 tablet_bootstrap.cc:492] T 61c592a8e336482282a75eb3f334fd77 P 518661ec5e6d4d47a25c2d48d8c9828f: Bootstrap starting.
I20260808 15:46:34.633157 10062 tablet_bootstrap.cc:654] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:34.633186 9967 tablet_service.cc:1467] Processing CreateTablet for tablet 61c592a8e336482282a75eb3f334fd77 (DEFAULT_TABLE table=test-table [id=a5abb60dc5dd46dc97ad42410ae972a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:34.633440 9967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61c592a8e336482282a75eb3f334fd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:34.633852 10084 ts_tablet_manager.cc:1918] T aae6b1eb525a4a0ea99091bda150ecd9 P 5323722d76a147128793565dd6d7608c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:46:34.633921 10061 tablet_bootstrap.cc:654] T 61c592a8e336482282a75eb3f334fd77 P 518661ec5e6d4d47a25c2d48d8c9828f: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:34.633939 10084 log.cc:1196] T aae6b1eb525a4a0ea99091bda150ecd9 P 5323722d76a147128793565dd6d7608c: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-0/wal/wals/aae6b1eb525a4a0ea99091bda150ecd9
I20260808 15:46:34.634261 10084 ts_tablet_manager.cc:1939] T aae6b1eb525a4a0ea99091bda150ecd9 P 5323722d76a147128793565dd6d7608c: Deleting consensus metadata
I20260808 15:46:34.634442 10062 tablet_bootstrap.cc:492] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c: No bootstrap required, opened a new log
I20260808 15:46:34.634533 10062 ts_tablet_manager.cc:1397] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 15:46:34.635185 10062 raft_consensus.cc:348] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } }
I20260808 15:46:34.635308 10062 raft_consensus.cc:374] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:34.635347 10062 raft_consensus.cc:729] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5323722d76a147128793565dd6d7608c, State: Initialized, Role: FOLLOWER
I20260808 15:46:34.635495 10062 consensus_queue.cc:260] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } }
I20260808 15:46:34.635648 10063 tablet_bootstrap.cc:492] T 61c592a8e336482282a75eb3f334fd77 P 045555061ba24a73a9d2e3d3973cd4d8: Bootstrap starting.
I20260808 15:46:34.635802 10062 ts_tablet_manager.cc:1428] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260808 15:46:34.635845 9510 catalog_manager.cc:4841] TS 5323722d76a147128793565dd6d7608c (127.8.39.65:37825): tablet aae6b1eb525a4a0ea99091bda150ecd9 (table test-table [id=8adcd1533f954e35bf0d6d707e1acdbe]) successfully deleted
I20260808 15:46:34.636212 10061 tablet_bootstrap.cc:492] T 61c592a8e336482282a75eb3f334fd77 P 518661ec5e6d4d47a25c2d48d8c9828f: No bootstrap required, opened a new log
I20260808 15:46:34.636197 9509 catalog_manager.cc:4841] TS 045555061ba24a73a9d2e3d3973cd4d8 (127.8.39.67:34653): tablet aae6b1eb525a4a0ea99091bda150ecd9 (table test-table [id=8adcd1533f954e35bf0d6d707e1acdbe]) successfully deleted
I20260808 15:46:34.636291 10061 ts_tablet_manager.cc:1397] T 61c592a8e336482282a75eb3f334fd77 P 518661ec5e6d4d47a25c2d48d8c9828f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 15:46:34.636672 10063 tablet_bootstrap.cc:654] T 61c592a8e336482282a75eb3f334fd77 P 045555061ba24a73a9d2e3d3973cd4d8: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:34.636734 10061 raft_consensus.cc:348] T 61c592a8e336482282a75eb3f334fd77 P 518661ec5e6d4d47a25c2d48d8c9828f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } }
I20260808 15:46:34.636834 10061 raft_consensus.cc:374] T 61c592a8e336482282a75eb3f334fd77 P 518661ec5e6d4d47a25c2d48d8c9828f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:34.636868 10061 raft_consensus.cc:729] T 61c592a8e336482282a75eb3f334fd77 P 518661ec5e6d4d47a25c2d48d8c9828f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 518661ec5e6d4d47a25c2d48d8c9828f, State: Initialized, Role: FOLLOWER
I20260808 15:46:34.637017 10061 consensus_queue.cc:260] T 61c592a8e336482282a75eb3f334fd77 P 518661ec5e6d4d47a25c2d48d8c9828f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } }
I20260808 15:46:34.637298 10061 ts_tablet_manager.cc:1428] T 61c592a8e336482282a75eb3f334fd77 P 518661ec5e6d4d47a25c2d48d8c9828f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 15:46:34.638823 10063 tablet_bootstrap.cc:492] T 61c592a8e336482282a75eb3f334fd77 P 045555061ba24a73a9d2e3d3973cd4d8: No bootstrap required, opened a new log
I20260808 15:46:34.638908 10063 ts_tablet_manager.cc:1397] T 61c592a8e336482282a75eb3f334fd77 P 045555061ba24a73a9d2e3d3973cd4d8: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260808 15:46:34.639354 10063 raft_consensus.cc:348] T 61c592a8e336482282a75eb3f334fd77 P 045555061ba24a73a9d2e3d3973cd4d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } }
I20260808 15:46:34.639469 10063 raft_consensus.cc:374] T 61c592a8e336482282a75eb3f334fd77 P 045555061ba24a73a9d2e3d3973cd4d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:34.639500 10063 raft_consensus.cc:729] T 61c592a8e336482282a75eb3f334fd77 P 045555061ba24a73a9d2e3d3973cd4d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 045555061ba24a73a9d2e3d3973cd4d8, State: Initialized, Role: FOLLOWER
I20260808 15:46:34.639642 10063 consensus_queue.cc:260] T 61c592a8e336482282a75eb3f334fd77 P 045555061ba24a73a9d2e3d3973cd4d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } }
I20260808 15:46:34.639885 10063 ts_tablet_manager.cc:1428] T 61c592a8e336482282a75eb3f334fd77 P 045555061ba24a73a9d2e3d3973cd4d8: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 15:46:34.730095 10067 raft_consensus.cc:482] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:46:34.730280 10067 raft_consensus.cc:504] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } }
I20260808 15:46:34.731503 10067 leader_election.cc:288] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 518661ec5e6d4d47a25c2d48d8c9828f (127.8.39.66:44615), 045555061ba24a73a9d2e3d3973cd4d8 (127.8.39.67:34653)
I20260808 15:46:34.736614 10060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.731877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:34419 (local address 127.8.39.66:44615)
0808 15:46:34.732029 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:34.732034 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:34.732140 (+ 106us) server_negotiation.cc:407] Connection header received
0808 15:46:34.732409 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:34.732413 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:34.732476 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:34.732534 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:46:34.732970 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.733647 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.735320 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.735940 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.736065 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.736137 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:34.736361 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 15:46:34.736444 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 15:46:34.736641 10090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.731719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:44615 (local address 127.8.39.65:34419)
0808 15:46:34.732029 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:34.732049 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:34.732238 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:34.732711 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:34.732715 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:34.732731 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:46:34.732856 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:34.732862 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.733775 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.733779 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:34.735166 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:34.735178 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.736087 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.736093 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:34.736217 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.736242 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 15:46:34.736328 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 15:46:34.736424 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":126,"threads_started":1}
I20260808 15:46:34.736816 10058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.732284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:40707 (local address 127.8.39.67:34653)
0808 15:46:34.732408 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:34.732413 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:34.732701 (+ 288us) server_negotiation.cc:407] Connection header received
0808 15:46:34.732803 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:34.732806 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:34.732860 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:34.732949 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:46:34.733273 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.734044 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.735559 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.736050 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.736177 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.736246 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:34.736566 (+ 320us) server_negotiation.cc:299] Negotiation successful
0808 15:46:34.736662 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 15:46:34.737147 10091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.732178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:34653 (local address 127.8.39.65:40707)
0808 15:46:34.732596 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:34.732610 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:34.732711 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:34.733010 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:34.733013 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:34.733032 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:46:34.733151 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:34.733158 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.734194 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.734198 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:34.735439 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:34.735447 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.736313 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.736321 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:34.736419 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.736439 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 15:46:34.736975 (+ 536us) client_negotiation.cc:240] Negotiation successful
0808 15:46:34.737040 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":105,"threads_started":1}
I20260808 15:46:34.737787 9989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61c592a8e336482282a75eb3f334fd77" candidate_uuid: "5323722d76a147128793565dd6d7608c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "045555061ba24a73a9d2e3d3973cd4d8" is_pre_election: true
I20260808 15:46:34.737733 9842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61c592a8e336482282a75eb3f334fd77" candidate_uuid: "5323722d76a147128793565dd6d7608c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" is_pre_election: true
I20260808 15:46:34.737958 9989 raft_consensus.cc:2454] T 61c592a8e336482282a75eb3f334fd77 P 045555061ba24a73a9d2e3d3973cd4d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5323722d76a147128793565dd6d7608c in term 0.
I20260808 15:46:34.738027 9842 raft_consensus.cc:2454] T 61c592a8e336482282a75eb3f334fd77 P 518661ec5e6d4d47a25c2d48d8c9828f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5323722d76a147128793565dd6d7608c in term 0.
I20260808 15:46:34.738415 9619 leader_election.cc:302] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 045555061ba24a73a9d2e3d3973cd4d8, 5323722d76a147128793565dd6d7608c; no voters:
I20260808 15:46:34.738742 10067 raft_consensus.cc:2781] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:46:34.738847 10067 raft_consensus.cc:482] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:46:34.738897 10067 raft_consensus.cc:3037] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:34.739970 10067 raft_consensus.cc:504] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } }
I20260808 15:46:34.740334 10067 leader_election.cc:288] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c [CANDIDATE]: Term 1 election: Requested vote from peers 518661ec5e6d4d47a25c2d48d8c9828f (127.8.39.66:44615), 045555061ba24a73a9d2e3d3973cd4d8 (127.8.39.67:34653)
I20260808 15:46:34.740772 9989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61c592a8e336482282a75eb3f334fd77" candidate_uuid: "5323722d76a147128793565dd6d7608c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "045555061ba24a73a9d2e3d3973cd4d8"
I20260808 15:46:34.740793 9842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61c592a8e336482282a75eb3f334fd77" candidate_uuid: "5323722d76a147128793565dd6d7608c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518661ec5e6d4d47a25c2d48d8c9828f"
I20260808 15:46:34.740908 9989 raft_consensus.cc:3037] T 61c592a8e336482282a75eb3f334fd77 P 045555061ba24a73a9d2e3d3973cd4d8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:34.740921 9842 raft_consensus.cc:3037] T 61c592a8e336482282a75eb3f334fd77 P 518661ec5e6d4d47a25c2d48d8c9828f [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:34.742036 9989 raft_consensus.cc:2454] T 61c592a8e336482282a75eb3f334fd77 P 045555061ba24a73a9d2e3d3973cd4d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5323722d76a147128793565dd6d7608c in term 1.
I20260808 15:46:34.742230 9842 raft_consensus.cc:2454] T 61c592a8e336482282a75eb3f334fd77 P 518661ec5e6d4d47a25c2d48d8c9828f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5323722d76a147128793565dd6d7608c in term 1.
I20260808 15:46:34.742360 9619 leader_election.cc:302] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 045555061ba24a73a9d2e3d3973cd4d8, 5323722d76a147128793565dd6d7608c; no voters:
I20260808 15:46:34.742551 10067 raft_consensus.cc:2781] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:34.742838 10067 raft_consensus.cc:686] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c [term 1 LEADER]: Becoming Leader. State: Replica: 5323722d76a147128793565dd6d7608c, State: Running, Role: LEADER
I20260808 15:46:34.743129 10067 consensus_queue.cc:237] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } }
I20260808 15:46:34.745747 9525 catalog_manager.cc:5495] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c reported cstate change: term changed from 0 to 1, leader changed from <none> to 5323722d76a147128793565dd6d7608c (127.8.39.65). New cstate: current_term: 1 leader_uuid: "5323722d76a147128793565dd6d7608c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } health_report { overall_health: UNKNOWN } } }
Aug 08 15:46:34 dist-test-slave-8tdl krb5kdc[9477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203993, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:34.789374 10099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.780493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:44717 (local address 127.0.0.1:55278)
0808 15:46:34.780832 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:34.780849 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:34.781006 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:34.781275 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:34.781278 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:34.781770 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:34.781876 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:34.781883 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.782703 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.782706 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:34.783252 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:34.783259 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.783695 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.783698 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:34.783768 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.784354 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:34.784367 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:34.785997 (+ 1630us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:34.787794 (+ 1797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:34.787803 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:34.787810 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:34.788045 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:34.788318 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:34.788321 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:34.788323 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:34.788399 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:34.788780 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:34.788790 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:34.788893 (+ 103us) client_negotiation.cc:769] Sending connection context
0808 15:46:34.789006 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 15:46:34.789170 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":112,"threads_started":1}
I20260808 15:46:34.789376 10100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.780567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55278 (local address 127.8.39.126:44717)
0808 15:46:34.780833 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:34.780848 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:34.780938 (+ 90us) server_negotiation.cc:407] Connection header received
0808 15:46:34.781114 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:34.781117 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:34.781163 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:34.781252 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:34.782005 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.782548 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.783363 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.783585 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.783692 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.786128 (+ 2436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:34.786137 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:34.786140 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:34.786160 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:34.787680 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:34.788141 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:34.788147 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:34.788149 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:34.788226 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:34.788489 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:34.788493 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:34.788495 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:34.788673 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:34.788772 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:34.789051 (+ 279us) server_negotiation.cc:299] Negotiation successful
0808 15:46:34.789243 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":86,"server-negotiator.queue_time_us":217,"thread_start_us":118,"threads_started":1}
I20260808 15:46:34.793874 9525 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:55278:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 15:46:34.794750 9525 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:46:34.799757 9820 tablet_service.cc:1467] Processing CreateTablet for tablet bc435ff2c6b6463abc7ccd69eb812dc4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0d2370d2ba3e42b182764708fa8593c6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 15:46:34.799813 9967 tablet_service.cc:1467] Processing CreateTablet for tablet bc435ff2c6b6463abc7ccd69eb812dc4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0d2370d2ba3e42b182764708fa8593c6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 15:46:34.800220 9820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc435ff2c6b6463abc7ccd69eb812dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:34.800246 9967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc435ff2c6b6463abc7ccd69eb812dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:34.799757 9670 tablet_service.cc:1467] Processing CreateTablet for tablet bc435ff2c6b6463abc7ccd69eb812dc4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0d2370d2ba3e42b182764708fa8593c6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 15:46:34.802626 10061 tablet_bootstrap.cc:492] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f: Bootstrap starting.
I20260808 15:46:34.802886 10063 tablet_bootstrap.cc:492] T bc435ff2c6b6463abc7ccd69eb812dc4 P 045555061ba24a73a9d2e3d3973cd4d8: Bootstrap starting.
I20260808 15:46:34.803458 10061 tablet_bootstrap.cc:654] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:34.803665 10063 tablet_bootstrap.cc:654] T bc435ff2c6b6463abc7ccd69eb812dc4 P 045555061ba24a73a9d2e3d3973cd4d8: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:34.804555 9670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc435ff2c6b6463abc7ccd69eb812dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:34.804672 10061 tablet_bootstrap.cc:492] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f: No bootstrap required, opened a new log
I20260808 15:46:34.804760 10061 ts_tablet_manager.cc:1397] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 15:46:34.804854 10063 tablet_bootstrap.cc:492] T bc435ff2c6b6463abc7ccd69eb812dc4 P 045555061ba24a73a9d2e3d3973cd4d8: No bootstrap required, opened a new log
I20260808 15:46:34.804945 10063 ts_tablet_manager.cc:1397] T bc435ff2c6b6463abc7ccd69eb812dc4 P 045555061ba24a73a9d2e3d3973cd4d8: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 15:46:34.805191 10061 raft_consensus.cc:348] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } }
I20260808 15:46:34.805310 10061 raft_consensus.cc:374] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:34.805349 10061 raft_consensus.cc:729] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 518661ec5e6d4d47a25c2d48d8c9828f, State: Initialized, Role: FOLLOWER
I20260808 15:46:34.805397 10063 raft_consensus.cc:348] T bc435ff2c6b6463abc7ccd69eb812dc4 P 045555061ba24a73a9d2e3d3973cd4d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } }
I20260808 15:46:34.805505 10063 raft_consensus.cc:374] T bc435ff2c6b6463abc7ccd69eb812dc4 P 045555061ba24a73a9d2e3d3973cd4d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:34.805536 10063 raft_consensus.cc:729] T bc435ff2c6b6463abc7ccd69eb812dc4 P 045555061ba24a73a9d2e3d3973cd4d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 045555061ba24a73a9d2e3d3973cd4d8, State: Initialized, Role: FOLLOWER
I20260808 15:46:34.805497 10061 consensus_queue.cc:260] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } }
I20260808 15:46:34.805646 10063 consensus_queue.cc:260] T bc435ff2c6b6463abc7ccd69eb812dc4 P 045555061ba24a73a9d2e3d3973cd4d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } }
I20260808 15:46:34.805785 10061 ts_tablet_manager.cc:1428] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260808 15:46:34.805925 10063 ts_tablet_manager.cc:1428] T bc435ff2c6b6463abc7ccd69eb812dc4 P 045555061ba24a73a9d2e3d3973cd4d8: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 15:46:34.806036 10069 tablet_replica.cc:439] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } } }
I20260808 15:46:34.806166 10069 tablet_replica.cc:442] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:46:34.806334 10068 tablet_replica.cc:439] T bc435ff2c6b6463abc7ccd69eb812dc4 P 045555061ba24a73a9d2e3d3973cd4d8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } } }
I20260808 15:46:34.806473 10068 tablet_replica.cc:442] T bc435ff2c6b6463abc7ccd69eb812dc4 P 045555061ba24a73a9d2e3d3973cd4d8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:46:34.807331 10072 raft_consensus.cc:482] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:46:34.807420 10072 raft_consensus.cc:504] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } }
I20260808 15:46:34.807828 10062 tablet_bootstrap.cc:492] T bc435ff2c6b6463abc7ccd69eb812dc4 P 5323722d76a147128793565dd6d7608c: Bootstrap starting.
I20260808 15:46:34.808182 10072 leader_election.cc:288] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5323722d76a147128793565dd6d7608c (127.8.39.65:37825), 045555061ba24a73a9d2e3d3973cd4d8 (127.8.39.67:34653)
I20260808 15:46:34.808553 9989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc435ff2c6b6463abc7ccd69eb812dc4" candidate_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "045555061ba24a73a9d2e3d3973cd4d8" is_pre_election: true
I20260808 15:46:34.808599 9690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc435ff2c6b6463abc7ccd69eb812dc4" candidate_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5323722d76a147128793565dd6d7608c" is_pre_election: true
I20260808 15:46:34.808678 9989 raft_consensus.cc:2454] T bc435ff2c6b6463abc7ccd69eb812dc4 P 045555061ba24a73a9d2e3d3973cd4d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 518661ec5e6d4d47a25c2d48d8c9828f in term 0.
I20260808 15:46:34.808887 10062 tablet_bootstrap.cc:654] T bc435ff2c6b6463abc7ccd69eb812dc4 P 5323722d76a147128793565dd6d7608c: Neither blocks nor log segments found. Creating new log.
W20260808 15:46:34.809285 9768 leader_election.cc:341] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5323722d76a147128793565dd6d7608c (127.8.39.65:37825): Illegal state: must be running to vote when last-logged opid is not known
I20260808 15:46:34.809468 9767 leader_election.cc:302] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 045555061ba24a73a9d2e3d3973cd4d8, 518661ec5e6d4d47a25c2d48d8c9828f; no voters: 5323722d76a147128793565dd6d7608c
I20260808 15:46:34.809907 10072 raft_consensus.cc:2781] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:46:34.809983 10072 raft_consensus.cc:482] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:46:34.810036 10072 raft_consensus.cc:3037] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:34.810251 10062 tablet_bootstrap.cc:492] T bc435ff2c6b6463abc7ccd69eb812dc4 P 5323722d76a147128793565dd6d7608c: No bootstrap required, opened a new log
I20260808 15:46:34.810349 10062 ts_tablet_manager.cc:1397] T bc435ff2c6b6463abc7ccd69eb812dc4 P 5323722d76a147128793565dd6d7608c: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 15:46:34.810773 10062 raft_consensus.cc:348] T bc435ff2c6b6463abc7ccd69eb812dc4 P 5323722d76a147128793565dd6d7608c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } }
I20260808 15:46:34.810877 10062 raft_consensus.cc:374] T bc435ff2c6b6463abc7ccd69eb812dc4 P 5323722d76a147128793565dd6d7608c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:34.810921 10062 raft_consensus.cc:729] T bc435ff2c6b6463abc7ccd69eb812dc4 P 5323722d76a147128793565dd6d7608c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5323722d76a147128793565dd6d7608c, State: Initialized, Role: FOLLOWER
I20260808 15:46:34.811054 10062 consensus_queue.cc:260] T bc435ff2c6b6463abc7ccd69eb812dc4 P 5323722d76a147128793565dd6d7608c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } }
I20260808 15:46:34.811089 10072 raft_consensus.cc:504] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } }
I20260808 15:46:34.811326 10062 ts_tablet_manager.cc:1428] T bc435ff2c6b6463abc7ccd69eb812dc4 P 5323722d76a147128793565dd6d7608c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:46:34.811266 10067 tablet_replica.cc:439] T bc435ff2c6b6463abc7ccd69eb812dc4 P 5323722d76a147128793565dd6d7608c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } } }
I20260808 15:46:34.811432 10067 tablet_replica.cc:442] T bc435ff2c6b6463abc7ccd69eb812dc4 P 5323722d76a147128793565dd6d7608c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:46:34.811435 10072 leader_election.cc:288] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f [CANDIDATE]: Term 1 election: Requested vote from peers 5323722d76a147128793565dd6d7608c (127.8.39.65:37825), 045555061ba24a73a9d2e3d3973cd4d8 (127.8.39.67:34653)
I20260808 15:46:34.811861 9690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc435ff2c6b6463abc7ccd69eb812dc4" candidate_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5323722d76a147128793565dd6d7608c"
I20260808 15:46:34.811923 9989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc435ff2c6b6463abc7ccd69eb812dc4" candidate_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "045555061ba24a73a9d2e3d3973cd4d8"
I20260808 15:46:34.811990 9690 raft_consensus.cc:3037] T bc435ff2c6b6463abc7ccd69eb812dc4 P 5323722d76a147128793565dd6d7608c [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:34.812059 9989 raft_consensus.cc:3037] T bc435ff2c6b6463abc7ccd69eb812dc4 P 045555061ba24a73a9d2e3d3973cd4d8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:34.813009 9989 raft_consensus.cc:2454] T bc435ff2c6b6463abc7ccd69eb812dc4 P 045555061ba24a73a9d2e3d3973cd4d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 518661ec5e6d4d47a25c2d48d8c9828f in term 1.
I20260808 15:46:34.813057 9690 raft_consensus.cc:2454] T bc435ff2c6b6463abc7ccd69eb812dc4 P 5323722d76a147128793565dd6d7608c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 518661ec5e6d4d47a25c2d48d8c9828f in term 1.
I20260808 15:46:34.813301 9767 leader_election.cc:302] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 045555061ba24a73a9d2e3d3973cd4d8, 518661ec5e6d4d47a25c2d48d8c9828f; no voters:
I20260808 15:46:34.813625 10072 raft_consensus.cc:2781] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:34.813730 10072 raft_consensus.cc:686] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f [term 1 LEADER]: Becoming Leader. State: Replica: 518661ec5e6d4d47a25c2d48d8c9828f, State: Running, Role: LEADER
I20260808 15:46:34.813858 10072 consensus_queue.cc:237] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } }
I20260808 15:46:34.814692 10072 tablet_replica.cc:439] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f: TxnStatusTablet state changed. Reason: New leader 518661ec5e6d4d47a25c2d48d8c9828f. Latest consensus state: current_term: 1 leader_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } } }
I20260808 15:46:34.814790 10072 tablet_replica.cc:442] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f: This TxnStatusTablet replica's current role is: LEADER
I20260808 15:46:34.815117 10105 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 15:46:34.815330 10105 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 15:46:34.815671 9525 catalog_manager.cc:5495] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f reported cstate change: term changed from 0 to 1, leader changed from <none> to 518661ec5e6d4d47a25c2d48d8c9828f (127.8.39.66). New cstate: current_term: 1 leader_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } health_report { overall_health: UNKNOWN } } }
I20260808 15:46:34.828562 10099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.824856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:44615 (local address 127.0.0.1:48662)
0808 15:46:34.825022 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:34.825036 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:34.825122 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:34.825399 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:34.825401 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:34.825408 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 15:46:34.825515 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:34.825519 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.826501 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.826504 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:34.827160 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:34.827169 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.827782 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.827786 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:34.827917 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.827967 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 15:46:34.828278 (+ 311us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 15:46:34.828292 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 15:46:34.828352 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 15:46:34.828438 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 15:46:34.828573 10060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.824947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48662 (local address 127.8.39.66:44615)
0808 15:46:34.825068 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:34.825073 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:34.825090 (+ 17us) server_negotiation.cc:407] Connection header received
0808 15:46:34.825233 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:34.825236 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:34.825288 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:34.825387 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:46:34.825610 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.826403 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.827266 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.827615 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.827723 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.828107 (+ 384us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:46:34.828191 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:46:34.828264 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:34.828384 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 15:46:34.828440 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 15:46:34.831681 9690 raft_consensus.cc:1261] T bc435ff2c6b6463abc7ccd69eb812dc4 P 5323722d76a147128793565dd6d7608c [term 1 FOLLOWER]: Refusing update from remote peer 518661ec5e6d4d47a25c2d48d8c9828f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:46:34.831681 9989 raft_consensus.cc:1261] T bc435ff2c6b6463abc7ccd69eb812dc4 P 045555061ba24a73a9d2e3d3973cd4d8 [term 1 FOLLOWER]: Refusing update from remote peer 518661ec5e6d4d47a25c2d48d8c9828f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:46:34.832228 10069 consensus_queue.cc:1035] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:46:34.832435 10072 consensus_queue.cc:1035] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f [LEADER]: Connected to new peer: Peer: permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:46:34.834129 10068 tablet_replica.cc:439] T bc435ff2c6b6463abc7ccd69eb812dc4 P 045555061ba24a73a9d2e3d3973cd4d8: TxnStatusTablet state changed. Reason: New leader 518661ec5e6d4d47a25c2d48d8c9828f. Latest consensus state: current_term: 1 leader_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } } }
I20260808 15:46:34.834259 10068 tablet_replica.cc:442] T bc435ff2c6b6463abc7ccd69eb812dc4 P 045555061ba24a73a9d2e3d3973cd4d8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:46:34.834962 10067 tablet_replica.cc:439] T bc435ff2c6b6463abc7ccd69eb812dc4 P 5323722d76a147128793565dd6d7608c: TxnStatusTablet state changed. Reason: New leader 518661ec5e6d4d47a25c2d48d8c9828f. Latest consensus state: current_term: 1 leader_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } } }
I20260808 15:46:34.835083 10067 tablet_replica.cc:442] T bc435ff2c6b6463abc7ccd69eb812dc4 P 5323722d76a147128793565dd6d7608c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:46:34.835474 10072 tablet_replica.cc:439] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } } }
I20260808 15:46:34.835574 10072 tablet_replica.cc:442] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f: This TxnStatusTablet replica's current role is: LEADER
I20260808 15:46:34.836583 10068 tablet_replica.cc:439] T bc435ff2c6b6463abc7ccd69eb812dc4 P 045555061ba24a73a9d2e3d3973cd4d8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } } }
I20260808 15:46:34.836694 10068 tablet_replica.cc:442] T bc435ff2c6b6463abc7ccd69eb812dc4 P 045555061ba24a73a9d2e3d3973cd4d8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:46:34.841519 10069 tablet_replica.cc:439] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } } }
I20260808 15:46:34.841650 10069 tablet_replica.cc:442] T bc435ff2c6b6463abc7ccd69eb812dc4 P 518661ec5e6d4d47a25c2d48d8c9828f: This TxnStatusTablet replica's current role is: LEADER
I20260808 15:46:34.844166 10077 mvcc.cc:205] Tried to move back new op lower bound from 7316291562825465856 to 7316291562758950912. Current Snapshot: MvccSnapshot[applied={T|T < 7316291562825465856 or (T in {7316291562825465856})}]
I20260808 15:46:34.844415 10067 tablet_replica.cc:439] T bc435ff2c6b6463abc7ccd69eb812dc4 P 5323722d76a147128793565dd6d7608c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5323722d76a147128793565dd6d7608c" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37825 } } peers { permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 } } peers { permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 } } }
I20260808 15:46:34.844522 10067 tablet_replica.cc:442] T bc435ff2c6b6463abc7ccd69eb812dc4 P 5323722d76a147128793565dd6d7608c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:46:34.847088 10057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.842242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59698 (local address 127.8.39.65:37825)
0808 15:46:34.842419 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:34.842423 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:34.842436 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:46:34.842512 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:34.842515 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:34.842574 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:34.842719 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:46:34.843531 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.844041 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.845165 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.845526 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.845640 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.846040 (+ 400us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:46:34.846598 (+ 558us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:46:34.846767 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:34.846898 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 15:46:34.846962 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260808 15:46:34.858855 10060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.855114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:40007 (local address 127.8.39.66:44615)
0808 15:46:34.855381 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:34.855387 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:34.855458 (+ 71us) server_negotiation.cc:407] Connection header received
0808 15:46:34.855585 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:34.855589 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:34.855645 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:34.855719 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:46:34.855953 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.856760 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.857579 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.858042 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.858144 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.858395 (+ 251us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:46:34.858475 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:46:34.858545 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:34.858627 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 15:46:34.858713 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174}
I20260808 15:46:34.858940 10111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.854993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:44615 (local address 127.8.39.65:40007)
0808 15:46:34.855357 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:34.855370 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:34.855489 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:34.855745 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:34.855747 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:34.855752 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 15:46:34.855862 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:34.855866 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.856851 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.856853 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:34.857465 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:34.857473 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.858154 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.858157 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:34.858229 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.858274 (+ 45us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 15:46:34.858555 (+ 281us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 15:46:34.858560 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 15:46:34.858610 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 15:46:34.858713 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":126,"threads_started":1}
I20260808 15:46:34.866873 9989 raft_consensus.cc:1261] T 61c592a8e336482282a75eb3f334fd77 P 045555061ba24a73a9d2e3d3973cd4d8 [term 1 FOLLOWER]: Refusing update from remote peer 5323722d76a147128793565dd6d7608c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:46:34.867146 9842 raft_consensus.cc:1261] T 61c592a8e336482282a75eb3f334fd77 P 518661ec5e6d4d47a25c2d48d8c9828f [term 1 FOLLOWER]: Refusing update from remote peer 5323722d76a147128793565dd6d7608c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:46:34.867578 10067 consensus_queue.cc:1035] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c [LEADER]: Connected to new peer: Peer: permanent_uuid: "045555061ba24a73a9d2e3d3973cd4d8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:46:34.867812 10092 consensus_queue.cc:1035] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c [LEADER]: Connected to new peer: Peer: permanent_uuid: "518661ec5e6d4d47a25c2d48d8c9828f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 44615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:46:34.893232 10057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.889306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:41751 (local address 127.8.39.65:37825)
0808 15:46:34.889428 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:34.889433 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:34.889641 (+ 208us) server_negotiation.cc:407] Connection header received
0808 15:46:34.889787 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:34.889790 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:34.889885 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:34.889968 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:46:34.890248 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.890821 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.892024 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.892384 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.892506 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.892758 (+ 252us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:46:34.892843 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:46:34.892925 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:34.893029 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 15:46:34.893088 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 15:46:34.893316 10116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.889228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:37825 (local address 127.8.39.66:41751)
0808 15:46:34.889560 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:34.889572 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:34.889688 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:34.890013 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:34.890017 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:34.890026 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 15:46:34.890133 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:34.890139 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.890965 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.890969 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:34.891886 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:34.891896 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.892495 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.892502 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:34.892591 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.892636 (+ 45us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 15:46:34.892936 (+ 300us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 15:46:34.892942 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 15:46:34.893015 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 15:46:34.893106 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":119,"threads_started":1}
I20260808 15:46:34.928601 9525 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57946:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:46:34.928783 9525 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57946:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:46:34.931411 9525 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bb77853812324008b4d5e2f85620c44a: Sending DeleteTablet for 3 replicas of tablet 61c592a8e336482282a75eb3f334fd77
I20260808 15:46:34.932161 9820 tablet_service.cc:1514] Processing DeleteTablet for tablet 61c592a8e336482282a75eb3f334fd77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:46:34 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:39922
I20260808 15:46:34.932161 9670 tablet_service.cc:1514] Processing DeleteTablet for tablet 61c592a8e336482282a75eb3f334fd77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:46:34 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:49032
I20260808 15:46:34.932374 10086 tablet_replica.cc:330] T 61c592a8e336482282a75eb3f334fd77 P 518661ec5e6d4d47a25c2d48d8c9828f: stopping tablet replica
I20260808 15:46:34.932485 10086 raft_consensus.cc:2229] T 61c592a8e336482282a75eb3f334fd77 P 518661ec5e6d4d47a25c2d48d8c9828f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:46:34.932598 10086 raft_consensus.cc:2258] T 61c592a8e336482282a75eb3f334fd77 P 518661ec5e6d4d47a25c2d48d8c9828f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:46:34.933320 10084 tablet_replica.cc:330] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c: stopping tablet replica
I20260808 15:46:34.933444 10084 raft_consensus.cc:2229] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:46:34.933458 10086 ts_tablet_manager.cc:1905] T 61c592a8e336482282a75eb3f334fd77 P 518661ec5e6d4d47a25c2d48d8c9828f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:46:34.933768 10084 raft_consensus.cc:2258] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:46:34.934471 10084 ts_tablet_manager.cc:1905] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:46:34.936363 10086 ts_tablet_manager.cc:1918] T 61c592a8e336482282a75eb3f334fd77 P 518661ec5e6d4d47a25c2d48d8c9828f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:46:34.936448 10086 log.cc:1196] T 61c592a8e336482282a75eb3f334fd77 P 518661ec5e6d4d47a25c2d48d8c9828f: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-1/wal/wals/61c592a8e336482282a75eb3f334fd77
I20260808 15:46:34.936717 10086 ts_tablet_manager.cc:1939] T 61c592a8e336482282a75eb3f334fd77 P 518661ec5e6d4d47a25c2d48d8c9828f: Deleting consensus metadata
I20260808 15:46:34.936813 10084 ts_tablet_manager.cc:1918] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:46:34.936897 10084 log.cc:1196] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-0/wal/wals/61c592a8e336482282a75eb3f334fd77
I20260808 15:46:34.937247 10084 ts_tablet_manager.cc:1939] T 61c592a8e336482282a75eb3f334fd77 P 5323722d76a147128793565dd6d7608c: Deleting consensus metadata
I20260808 15:46:34.937465 9509 catalog_manager.cc:4841] TS 518661ec5e6d4d47a25c2d48d8c9828f (127.8.39.66:44615): tablet 61c592a8e336482282a75eb3f334fd77 (table test-table [id=a5abb60dc5dd46dc97ad42410ae972a4]) successfully deleted
I20260808 15:46:34.937927 9967 tablet_service.cc:1514] Processing DeleteTablet for tablet 61c592a8e336482282a75eb3f334fd77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:46:34 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:36280
I20260808 15:46:34.937965 9510 catalog_manager.cc:4841] TS 5323722d76a147128793565dd6d7608c (127.8.39.65:37825): tablet 61c592a8e336482282a75eb3f334fd77 (table test-table [id=a5abb60dc5dd46dc97ad42410ae972a4]) successfully deleted
I20260808 15:46:34.938171 10085 tablet_replica.cc:330] T 61c592a8e336482282a75eb3f334fd77 P 045555061ba24a73a9d2e3d3973cd4d8: stopping tablet replica
I20260808 15:46:34.938303 10085 raft_consensus.cc:2229] T 61c592a8e336482282a75eb3f334fd77 P 045555061ba24a73a9d2e3d3973cd4d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:46:34.938424 10085 raft_consensus.cc:2258] T 61c592a8e336482282a75eb3f334fd77 P 045555061ba24a73a9d2e3d3973cd4d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:46:34.939208 10085 ts_tablet_manager.cc:1905] T 61c592a8e336482282a75eb3f334fd77 P 045555061ba24a73a9d2e3d3973cd4d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:46:34.942070 10085 ts_tablet_manager.cc:1918] T 61c592a8e336482282a75eb3f334fd77 P 045555061ba24a73a9d2e3d3973cd4d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:46:34.942164 10085 log.cc:1196] T 61c592a8e336482282a75eb3f334fd77 P 045555061ba24a73a9d2e3d3973cd4d8: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/61c592a8e336482282a75eb3f334fd77
I20260808 15:46:34.942435 10085 ts_tablet_manager.cc:1939] T 61c592a8e336482282a75eb3f334fd77 P 045555061ba24a73a9d2e3d3973cd4d8: Deleting consensus metadata
I20260808 15:46:34.943168 9509 catalog_manager.cc:4841] TS 045555061ba24a73a9d2e3d3973cd4d8 (127.8.39.67:34653): tablet 61c592a8e336482282a75eb3f334fd77 (table test-table [id=a5abb60dc5dd46dc97ad42410ae972a4]) successfully deleted
Aug 08 15:46:34 dist-test-slave-8tdl krb5kdc[9477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203994, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.39.65@KRBTEST.COM
I20260808 15:46:34.956069 10057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.942775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59706 (local address 127.8.39.65:37825)
0808 15:46:34.942910 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:34.942914 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:34.943644 (+ 730us) server_negotiation.cc:407] Connection header received
0808 15:46:34.943763 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:34.943766 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:34.943819 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:34.943905 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:34.944732 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.945560 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.946694 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.947065 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.947171 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.951382 (+ 4211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:34.951395 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:34.951412 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:34.951445 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:34.953619 (+ 2174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:34.954150 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:34.954157 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:34.954159 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:34.954279 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:34.954606 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:34.954610 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:34.954612 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:34.955045 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:34.955276 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:34.955532 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 15:46:34.955670 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260808 15:46:34.956574 9735 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59706
I20260808 15:46:34.968617 10100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:34.958518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55286 (local address 127.8.39.126:44717)
0808 15:46:34.958654 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:34.958659 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:34.959319 (+ 660us) server_negotiation.cc:407] Connection header received
0808 15:46:34.959550 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:34.959554 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:34.959618 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:34.959700 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:34.960554 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.961391 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.962509 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:34.962964 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:34.963069 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:34.964794 (+ 1725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:34.964798 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:34.964801 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:34.964830 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:34.966624 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:34.967192 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:34.967196 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:34.967198 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:34.967291 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:34.967651 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:34.967654 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:34.967656 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:34.967885 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:34.968019 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:34.968288 (+ 269us) server_negotiation.cc:299] Negotiation successful
0808 15:46:34.968431 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260808 15:46:34.969839 9525 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55286
I20260808 15:46:34.971457 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 9600
I20260808 15:46:34.979998 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 9750
I20260808 15:46:34.989429 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 9900
I20260808 15:46:34.996272 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 9491
2026-08-08T15:46:35Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3065 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:46:35 dist-test-slave-8tdl krb5kdc[10128](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:46:35 dist-test-slave-8tdl krb5kdc[10128](info): set up 2 sockets
Aug 08 15:46:35 dist-test-slave-8tdl krb5kdc[10128](info): commencing operation
krb5kdc: starting...
W20260808 15:46:36.112044 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.091s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:46:36 dist-test-slave-8tdl krb5kdc[10128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203996, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:46:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:46:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:46:36.243435 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:33945
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:33175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:33945
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:36.355788 10141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:36.356103 10141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:36.356182 10141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:36.360292 10141 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:46:36.360370 10141 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 15:46:36.360402 10141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:36.360451 10141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:36.360491 10141 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:46:36.360526 10141 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:46:36.365772 10141 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:33175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:33945
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:33945
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10141
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:36.366834 10141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:36.367875 10141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:36.376492 10149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:36.376523 10147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:36.376523 10146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:36.376816 10141 server_base.cc:1034] running on GCE node
I20260808 15:46:36.377485 10141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:36.378633 10141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:36.379838 10141 hybrid_clock.cc:648] HybridClock initialized: now 1786203996379811 us; error 41 us; skew 500 ppm
Aug 08 15:46:36 dist-test-slave-8tdl krb5kdc[10128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203996, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:36.382900 10141 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:46:36.383769 10141 webserver.cc:460] Webserver started at http://127.8.39.126:44055/ using document root <none> and password file <none>
I20260808 15:46:36.384332 10141 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:36.384423 10141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:36.384646 10141 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:36.386667 10141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "9f8c6fbc6c4d42d49522f068d97daecf"
format_stamp: "Formatted at 2026-08-08 15:46:36 on dist-test-slave-8tdl"
server_key: "291d998e87cb80df615cd18688b7c5ae"
server_key_iv: "01f81097d6bbeca7e37f7ff06bb2e41a"
server_key_version: "encryptionkey@0"
I20260808 15:46:36.387300 10141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "9f8c6fbc6c4d42d49522f068d97daecf"
format_stamp: "Formatted at 2026-08-08 15:46:36 on dist-test-slave-8tdl"
server_key: "291d998e87cb80df615cd18688b7c5ae"
server_key_iv: "01f81097d6bbeca7e37f7ff06bb2e41a"
server_key_version: "encryptionkey@0"
I20260808 15:46:36.391067 10141 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:46:36.393625 10156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:36.395035 10141 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:46:36.395177 10141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "9f8c6fbc6c4d42d49522f068d97daecf"
format_stamp: "Formatted at 2026-08-08 15:46:36 on dist-test-slave-8tdl"
server_key: "291d998e87cb80df615cd18688b7c5ae"
server_key_iv: "01f81097d6bbeca7e37f7ff06bb2e41a"
server_key_version: "encryptionkey@0"
I20260808 15:46:36.395296 10141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:36.413745 10141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:36.417177 10141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:36.417394 10141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:36.425911 10141 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:33945
I20260808 15:46:36.425951 10223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:33945 every 8 connection(s)
I20260808 15:46:36.426888 10141 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:46:36.429735 10224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:36.430593 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 10141
I20260808 15:46:36.430754 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:46:36.431078 8349 external_mini_cluster.cc:1428] Setting key 0337b3a4ade1aaf54b76fbaca29def84
I20260808 15:46:36.436441 10224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf: Bootstrap starting.
I20260808 15:46:36.438874 10224 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:36.439673 10224 log.cc:824] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf: Log is configured to *not* fsync() on all Append() calls
Aug 08 15:46:36 dist-test-slave-8tdl krb5kdc[10128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203996, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:36.442260 10224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf: No bootstrap required, opened a new log
I20260808 15:46:36.446451 10224 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f8c6fbc6c4d42d49522f068d97daecf" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 33945 } }
I20260808 15:46:36.446794 10224 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:36.446851 10224 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f8c6fbc6c4d42d49522f068d97daecf, State: Initialized, Role: FOLLOWER
I20260808 15:46:36.447228 10227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:36.432707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52268 (local address 127.8.39.126:33945)
0808 15:46:36.433213 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:36.433228 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:36.433263 (+ 35us) server_negotiation.cc:407] Connection header received
0808 15:46:36.433968 (+ 705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:36.433986 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:36.434307 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:36.434660 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:36.435538 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:36.436575 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:36.437438 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:36.437915 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:36.438077 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:36.440914 (+ 2837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:36.440920 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:36.440937 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:36.440967 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:36.443858 (+ 2891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:36.444337 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:36.444345 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:36.444351 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:36.444506 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:36.444778 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:36.444782 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:36.444784 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:36.445313 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:36.445517 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:36.445837 (+ 320us) server_negotiation.cc:299] Negotiation successful
0808 15:46:36.446158 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":137,"threads_started":1}
I20260808 15:46:36.447316 10224 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f8c6fbc6c4d42d49522f068d97daecf" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 33945 } }
I20260808 15:46:36.447470 10224 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:46:36.447551 10224 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:46:36.447651 10224 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:36.448695 10224 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f8c6fbc6c4d42d49522f068d97daecf" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 33945 } }
I20260808 15:46:36.449043 10224 leader_election.cc:302] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f8c6fbc6c4d42d49522f068d97daecf; no voters:
I20260808 15:46:36.449437 10224 leader_election.cc:288] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:46:36.449564 10229 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:36.449815 10229 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf [term 1 LEADER]: Becoming Leader. State: Replica: 9f8c6fbc6c4d42d49522f068d97daecf, State: Running, Role: LEADER
I20260808 15:46:36.450191 10229 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f8c6fbc6c4d42d49522f068d97daecf" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 33945 } }
I20260808 15:46:36.450742 10224 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:46:36.452071 10230 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f8c6fbc6c4d42d49522f068d97daecf. Latest consensus state: current_term: 1 leader_uuid: "9f8c6fbc6c4d42d49522f068d97daecf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f8c6fbc6c4d42d49522f068d97daecf" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 33945 } } }
I20260808 15:46:36.452188 10230 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:36.452128 10231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9f8c6fbc6c4d42d49522f068d97daecf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f8c6fbc6c4d42d49522f068d97daecf" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 33945 } } }
I20260808 15:46:36.452236 10231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:36.452553 10238 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:46:36.455534 10238 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:46:36.461074 10238 catalog_manager.cc:1347] Generated new cluster ID: 4ab07357cedd4b89b47888dcf135af24
I20260808 15:46:36.461148 10238 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:46:36.485879 10238 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:46:36.486931 10238 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:46:36.492751 10238 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf: Generated new TSK 0
I20260808 15:46:36.493554 10238 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.39.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
I20260808 15:46:36.529633 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:0
--local_ip_for_outbound_sockets=127.8.39.65
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:33945
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:33175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:36.643453 10250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:36.643711 10250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:36.643759 10250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:36.647835 10250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:36.647891 10250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:36.647935 10250 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 15:46:36.647949 10250 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 15:46:36.647987 10250 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:46:36.653297 10250 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:33175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.39.126:33945
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10250
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:36.654309 10250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:36.655318 10250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:36.665261 10255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:36.665251 10258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:36.665251 10256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:36.665644 10250 server_base.cc:1034] running on GCE node
I20260808 15:46:36.666090 10250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:36.666766 10250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:36.668016 10250 hybrid_clock.cc:648] HybridClock initialized: now 1786203996667996 us; error 31 us; skew 500 ppm
Aug 08 15:46:36 dist-test-slave-8tdl krb5kdc[10128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203996, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:36.671217 10250 init.cc:377] Logged in from keytab as kudu/127.8.39.65@KRBTEST.COM (short username kudu)
I20260808 15:46:36.672196 10250 webserver.cc:460] Webserver started at http://127.8.39.65:39351/ using document root <none> and password file <none>
I20260808 15:46:36.672787 10250 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:36.672852 10250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:36.673079 10250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:36.675428 10250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-0/data/instance:
uuid: "0134846235ac413eaa6321a7491648c2"
format_stamp: "Formatted at 2026-08-08 15:46:36 on dist-test-slave-8tdl"
server_key: "1817c78482eeeb939e996a82ee987b0b"
server_key_iv: "784e1ac7d689b194ed8deebda9449fab"
server_key_version: "encryptionkey@0"
I20260808 15:46:36.676035 10250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance:
uuid: "0134846235ac413eaa6321a7491648c2"
format_stamp: "Formatted at 2026-08-08 15:46:36 on dist-test-slave-8tdl"
server_key: "1817c78482eeeb939e996a82ee987b0b"
server_key_iv: "784e1ac7d689b194ed8deebda9449fab"
server_key_version: "encryptionkey@0"
I20260808 15:46:36.680002 10250 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 15:46:36.682615 10266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:36.683900 10250 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 15:46:36.684082 10250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "0134846235ac413eaa6321a7491648c2"
format_stamp: "Formatted at 2026-08-08 15:46:36 on dist-test-slave-8tdl"
server_key: "1817c78482eeeb939e996a82ee987b0b"
server_key_iv: "784e1ac7d689b194ed8deebda9449fab"
server_key_version: "encryptionkey@0"
I20260808 15:46:36.684188 10250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:36.709061 10250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:36.712455 10250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:36.712664 10250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:36.714395 10250 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:36.714468 10250 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:36.714531 10250 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:36.714572 10250 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 15:46:36 dist-test-slave-8tdl krb5kdc[10128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203996, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:36.725219 10250 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:43167
I20260808 15:46:36.725292 10387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:43167 every 8 connection(s)
I20260808 15:46:36.726284 10250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:46:36.727092 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 10250
I20260808 15:46:36.727209 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance
I20260808 15:46:36.727531 8349 external_mini_cluster.cc:1428] Setting key 323dedaea8c4c1b9b4b340a8c4b25121
I20260808 15:46:36.730104 10227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:36.715265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:55791 (local address 127.8.39.126:33945)
0808 15:46:36.715407 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:36.715411 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:36.716467 (+ 1056us) server_negotiation.cc:407] Connection header received
0808 15:46:36.717595 (+ 1128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:36.717599 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:36.717662 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:36.717711 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:36.719565 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:36.720481 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:36.722283 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:36.722707 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:36.722843 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:36.725874 (+ 3031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:36.725881 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:36.725887 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:36.725925 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:36.727745 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:36.728355 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:36.728358 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:36.728360 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:36.728439 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:36.728811 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:36.728814 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:36.728816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:36.729124 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:36.729214 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:36.729829 (+ 615us) server_negotiation.cc:299] Negotiation successful
0808 15:46:36.729939 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 15:46:36.731271 10277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:36.715810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:33945 (local address 127.8.39.65:55791)
0808 15:46:36.716308 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:36.716354 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:36.717309 (+ 955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:36.718190 (+ 881us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:36.718203 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:36.718655 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:36.719378 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:36.719401 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:36.720643 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:36.720648 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:36.722160 (+ 1512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:36.722170 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:36.722868 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:36.722871 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:36.723094 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:36.723824 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:36.723848 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:36.725691 (+ 1843us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:36.727861 (+ 2170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:36.727870 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:36.727886 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:36.728259 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:36.728534 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:36.728537 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:36.728539 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:36.728713 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:36.729240 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:36.729246 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:36.729570 (+ 324us) client_negotiation.cc:769] Sending connection context
0808 15:46:36.729785 (+ 215us) client_negotiation.cc:240] Negotiation successful
0808 15:46:36.730147 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":133,"threads_started":1}
I20260808 15:46:36.732858 10388 heartbeater.cc:347] Connected to a master server at 127.8.39.126:33945
I20260808 15:46:36.733022 10388 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:36.733625 10388 heartbeater.cc:511] Master 127.8.39.126:33945 requested a full tablet report, sending...
I20260808 15:46:36.735581 10176 ts_manager.cc:194] Registered new tserver with Master: 0134846235ac413eaa6321a7491648c2 (127.8.39.65:43167)
I20260808 15:46:36.737362 10176 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.65@KRBTEST.COM'} at 127.8.39.65:55791
WARNING: no policy specified for kudu/127.8.39.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.66@KRBTEST.COM" created.
I20260808 15:46:36.746994 10227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:36.735495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:56687 (local address 127.8.39.126:33945)
0808 15:46:36.735619 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:36.735623 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:36.739084 (+ 3461us) server_negotiation.cc:407] Connection header received
0808 15:46:36.739245 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:36.739249 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:36.739299 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:36.739403 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:36.739960 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:36.740561 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:36.741376 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:36.741590 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:36.741672 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:36.742966 (+ 1294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:36.742969 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:36.742971 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:36.743030 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:36.744833 (+ 1803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:36.745461 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:36.745465 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:36.745466 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:36.745558 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:36.745875 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:36.745877 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:36.745878 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:36.746134 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:36.746221 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:36.746584 (+ 363us) server_negotiation.cc:299] Negotiation successful
0808 15:46:36.746794 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 15:46:36.747036 10395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:36.735247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:33945 (local address 127.8.39.65:56687)
0808 15:46:36.738972 (+ 3725us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:36.738991 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:36.739114 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:36.739451 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:36.739455 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:36.739708 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:36.739831 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:36.739838 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:36.740690 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:36.740693 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:36.741251 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:36.741260 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:36.741695 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:36.741697 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:36.741767 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:36.742277 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:36.742289 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:36.742752 (+ 463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:36.745015 (+ 2263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:36.745020 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:36.745025 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:36.745315 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:36.745664 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:36.745669 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:36.745672 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:36.745780 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:36.746238 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:36.746242 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:36.746360 (+ 118us) client_negotiation.cc:769] Sending connection context
0808 15:46:36.746513 (+ 153us) client_negotiation.cc:240] Negotiation successful
0808 15:46:36.746727 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3582,"thread_start_us":86,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
I20260808 15:46:36.760221 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:0
--local_ip_for_outbound_sockets=127.8.39.66
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:33945
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:33175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:36.876741 10397 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:36.877066 10397 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:36.877121 10397 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:36.881210 10397 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:36.881283 10397 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:36.881325 10397 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 15:46:36.881340 10397 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 15:46:36.881371 10397 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:46:36.886634 10397 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:33175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.39.126:33945
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10397
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:36.887842 10397 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:36.888947 10397 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:36.898962 10403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:36.899010 10406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:36.899060 10404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:36.899202 10397 server_base.cc:1034] running on GCE node
I20260808 15:46:36.899650 10397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:36.900380 10397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:36.901574 10397 hybrid_clock.cc:648] HybridClock initialized: now 1786203996901558 us; error 36 us; skew 500 ppm
Aug 08 15:46:36 dist-test-slave-8tdl krb5kdc[10128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203996, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:36.904584 10397 init.cc:377] Logged in from keytab as kudu/127.8.39.66@KRBTEST.COM (short username kudu)
I20260808 15:46:36.905525 10397 webserver.cc:460] Webserver started at http://127.8.39.66:35853/ using document root <none> and password file <none>
I20260808 15:46:36.906100 10397 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:36.906189 10397 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:36.906420 10397 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:36.908726 10397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-1/data/instance:
uuid: "5436a2a7d2064e00838827014761f80e"
format_stamp: "Formatted at 2026-08-08 15:46:36 on dist-test-slave-8tdl"
server_key: "808f95cb74cd5d81c3e2186d6b55fef4"
server_key_iv: "575c2bddf090dbd25bc8afe2554ddfdb"
server_key_version: "encryptionkey@0"
I20260808 15:46:36.909315 10397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance:
uuid: "5436a2a7d2064e00838827014761f80e"
format_stamp: "Formatted at 2026-08-08 15:46:36 on dist-test-slave-8tdl"
server_key: "808f95cb74cd5d81c3e2186d6b55fef4"
server_key_iv: "575c2bddf090dbd25bc8afe2554ddfdb"
server_key_version: "encryptionkey@0"
I20260808 15:46:36.913324 10397 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 15:46:36.916010 10414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:36.917447 10397 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 15:46:36.917593 10397 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "5436a2a7d2064e00838827014761f80e"
format_stamp: "Formatted at 2026-08-08 15:46:36 on dist-test-slave-8tdl"
server_key: "808f95cb74cd5d81c3e2186d6b55fef4"
server_key_iv: "575c2bddf090dbd25bc8afe2554ddfdb"
server_key_version: "encryptionkey@0"
I20260808 15:46:36.917689 10397 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:36.947381 10397 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:36.950794 10397 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:36.950984 10397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:36.952692 10397 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:36.952746 10397 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:36.952821 10397 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:36.952858 10397 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 15:46:36 dist-test-slave-8tdl krb5kdc[10128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203996, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:36.965013 10397 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:38029
I20260808 15:46:36.965837 10536 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:38029 every 8 connection(s)
I20260808 15:46:36.966118 10397 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:46:36.967810 10227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:36.953466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:54949 (local address 127.8.39.126:33945)
0808 15:46:36.953617 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:36.953622 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:36.954505 (+ 883us) server_negotiation.cc:407] Connection header received
0808 15:46:36.955468 (+ 963us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:36.955472 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:36.955545 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:36.955660 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:36.957612 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:36.958281 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:36.960354 (+ 2073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:36.960693 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:36.960815 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:36.963890 (+ 3075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:36.963893 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:36.963896 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:36.963931 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:36.965557 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:36.966186 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:36.966190 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:36.966192 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:36.966279 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:36.966702 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:36.966706 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:36.966707 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:36.966946 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:36.967078 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:36.967580 (+ 502us) server_negotiation.cc:299] Negotiation successful
0808 15:46:36.967687 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 15:46:36.968461 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 10397
I20260808 15:46:36.968585 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance
I20260808 15:46:36.968871 10424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:36.953898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:33945 (local address 127.8.39.66:54949)
0808 15:46:36.954334 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:36.954384 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:36.955264 (+ 880us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:36.956022 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:36.956032 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:36.956626 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:36.957405 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:36.957430 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:36.958417 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:36.958425 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:36.960208 (+ 1783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:36.960221 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:36.960874 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:36.960878 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:36.961087 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:36.961731 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:36.961749 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:36.963714 (+ 1965us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:36.965689 (+ 1975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:36.965695 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:36.965710 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:36.966076 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:36.966380 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:36.966385 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:36.966389 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:36.966564 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:36.967087 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:36.967092 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:36.967328 (+ 236us) client_negotiation.cc:769] Sending connection context
0808 15:46:36.967498 (+ 170us) client_negotiation.cc:240] Negotiation successful
0808 15:46:36.967766 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":121,"threads_started":1}
I20260808 15:46:36.968933 8349 external_mini_cluster.cc:1428] Setting key aaa5bfe15ee777abe9c83247417fd4de
I20260808 15:46:36.970233 10537 heartbeater.cc:347] Connected to a master server at 127.8.39.126:33945
I20260808 15:46:36.970402 10537 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:36.971025 10537 heartbeater.cc:511] Master 127.8.39.126:33945 requested a full tablet report, sending...
I20260808 15:46:36.972185 10169 ts_manager.cc:194] Registered new tserver with Master: 5436a2a7d2064e00838827014761f80e (127.8.39.66:38029)
I20260808 15:46:36.973061 10169 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.66@KRBTEST.COM'} at 127.8.39.66:54949
WARNING: no policy specified for kudu/127.8.39.67@KRBTEST.COM; defaulting to no policy
I20260808 15:46:36.981669 10227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:36.972616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:59483 (local address 127.8.39.126:33945)
0808 15:46:36.972735 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:36.972739 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:36.973069 (+ 330us) server_negotiation.cc:407] Connection header received
0808 15:46:36.973317 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:36.973321 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:36.973375 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:36.973427 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:36.974133 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:36.975004 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:36.976366 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:36.976603 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:36.976685 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:36.978381 (+ 1696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:36.978384 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:36.978387 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:36.978409 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:36.979991 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:36.980500 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:36.980503 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:36.980504 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:36.980577 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:36.980813 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:36.980815 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:36.980816 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:36.981019 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:36.981096 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:36.981387 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 15:46:36.981536 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 15:46:36.981679 10545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:36.972578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:33945 (local address 127.8.39.66:59483)
0808 15:46:36.972969 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:36.973000 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:36.973199 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:36.973570 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:36.973574 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:36.973828 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:36.973992 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:36.974002 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:36.975146 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:36.975152 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:36.976219 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:36.976233 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:36.976722 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:36.976728 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:36.976860 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:36.977688 (+ 828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:36.977709 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:36.978219 (+ 510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:36.980106 (+ 1887us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:36.980112 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:36.980115 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:36.980396 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:36.980662 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:36.980664 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:36.980666 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:36.980746 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:36.981098 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:36.981101 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:36.981218 (+ 117us) client_negotiation.cc:769] Sending connection context
0808 15:46:36.981325 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 15:46:36.981484 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":86,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
I20260808 15:46:36.998610 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:0
--local_ip_for_outbound_sockets=127.8.39.67
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:33945
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:33175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:37.111243 10547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:37.111496 10547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:37.111570 10547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:37.115761 10547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:37.115818 10547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:37.115859 10547 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 15:46:37.115908 10547 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 15:46:37.115975 10547 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:46:37.121331 10547 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:33175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.39.126:33945
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10547
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:37.122401 10547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:37.123484 10547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:37.132849 10553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:37.132825 10552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:37.132836 10555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:37.133220 10547 server_base.cc:1034] running on GCE node
I20260808 15:46:37.133599 10547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:37.134239 10547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:37.135421 10547 hybrid_clock.cc:648] HybridClock initialized: now 1786203997135388 us; error 41 us; skew 500 ppm
Aug 08 15:46:37 dist-test-slave-8tdl krb5kdc[10128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203997, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:37.138115 10547 init.cc:377] Logged in from keytab as kudu/127.8.39.67@KRBTEST.COM (short username kudu)
I20260808 15:46:37.139024 10547 webserver.cc:460] Webserver started at http://127.8.39.67:34099/ using document root <none> and password file <none>
I20260808 15:46:37.139601 10547 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:37.139693 10547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:37.139921 10547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:37.141957 10547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-2/data/instance:
uuid: "5f434d1fa4d3494e8cf133768a558af5"
format_stamp: "Formatted at 2026-08-08 15:46:37 on dist-test-slave-8tdl"
server_key: "cd7ee27e8f1a1add9e831acf0ed1828a"
server_key_iv: "1c8ffe731c91b4420e32792f434aa1d0"
server_key_version: "encryptionkey@0"
I20260808 15:46:37.142542 10547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance:
uuid: "5f434d1fa4d3494e8cf133768a558af5"
format_stamp: "Formatted at 2026-08-08 15:46:37 on dist-test-slave-8tdl"
server_key: "cd7ee27e8f1a1add9e831acf0ed1828a"
server_key_iv: "1c8ffe731c91b4420e32792f434aa1d0"
server_key_version: "encryptionkey@0"
I20260808 15:46:37.146373 10547 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260808 15:46:37.149468 10562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:37.151207 10547 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:46:37.151343 10547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "5f434d1fa4d3494e8cf133768a558af5"
format_stamp: "Formatted at 2026-08-08 15:46:37 on dist-test-slave-8tdl"
server_key: "cd7ee27e8f1a1add9e831acf0ed1828a"
server_key_iv: "1c8ffe731c91b4420e32792f434aa1d0"
server_key_version: "encryptionkey@0"
I20260808 15:46:37.151455 10547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:37.168232 10547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:37.171727 10547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:37.171939 10547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:37.173382 10547 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:37.173431 10547 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:37.173470 10547 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:37.173521 10547 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 15:46:37 dist-test-slave-8tdl krb5kdc[10128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203997, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:37.184863 10547 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:45997
I20260808 15:46:37.186003 10547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:46:37.186466 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 10547
I20260808 15:46:37.186592 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance
I20260808 15:46:37.186966 8349 external_mini_cluster.cc:1428] Setting key e754c854a53030f7b4a930e524fba8a0
I20260808 15:46:37.187143 10687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:45997 every 8 connection(s)
I20260808 15:46:37.189085 10227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.174272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:49459 (local address 127.8.39.126:33945)
0808 15:46:37.174427 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:37.174435 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:37.175762 (+ 1327us) server_negotiation.cc:407] Connection header received
0808 15:46:37.177030 (+ 1268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:37.177035 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:37.177103 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:37.177203 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:37.178831 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.179737 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.181014 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.181387 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.181521 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.184118 (+ 2597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:37.184124 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:37.184128 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:37.184162 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:37.185965 (+ 1803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:37.186610 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:37.186614 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:37.186616 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:37.186740 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:37.187133 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:37.187136 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:37.187138 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:37.187386 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:37.187531 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:37.188183 (+ 652us) server_negotiation.cc:299] Negotiation successful
0808 15:46:37.188305 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 15:46:37.189389 10572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.175169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:33945 (local address 127.8.39.67:49459)
0808 15:46:37.175606 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:37.175655 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:37.176757 (+ 1102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:37.177370 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:37.177377 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:37.177827 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:37.178544 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:37.178565 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.179868 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.179872 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:37.180875 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:37.180885 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.181562 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.181566 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:37.181745 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.182375 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:37.182391 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:37.183941 (+ 1550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:37.186126 (+ 2185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:37.186134 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:37.186147 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:37.186475 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:37.186854 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:37.186857 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:37.186858 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:37.187015 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:37.187528 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:37.187534 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:37.187853 (+ 319us) client_negotiation.cc:769] Sending connection context
0808 15:46:37.188138 (+ 285us) client_negotiation.cc:240] Negotiation successful
0808 15:46:37.188450 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":130,"threads_started":1}
I20260808 15:46:37.190438 10688 heartbeater.cc:347] Connected to a master server at 127.8.39.126:33945
I20260808 15:46:37.190591 10688 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:37.191108 10688 heartbeater.cc:511] Master 127.8.39.126:33945 requested a full tablet report, sending...
I20260808 15:46:37.192086 10175 ts_manager.cc:194] Registered new tserver with Master: 5f434d1fa4d3494e8cf133768a558af5 (127.8.39.67:45997)
I20260808 15:46:37.192770 10175 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.67@KRBTEST.COM'} at 127.8.39.67:49459
I20260808 15:46:37.199163 10227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.192640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:49167 (local address 127.8.39.126:33945)
0808 15:46:37.192752 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:37.192756 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:37.192995 (+ 239us) server_negotiation.cc:407] Connection header received
0808 15:46:37.193130 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:37.193134 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:37.193174 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:37.193258 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:37.193701 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.194196 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.195083 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.195312 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.195418 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.196382 (+ 964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:37.196386 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:37.196388 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:37.196411 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:37.197581 (+ 1170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:37.197988 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:37.197991 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:37.197993 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:37.198075 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:37.198335 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:37.198339 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:37.198341 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:37.198516 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:37.198620 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:37.198900 (+ 280us) server_negotiation.cc:299] Negotiation successful
0808 15:46:37.199011 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 15:46:37.199470 10694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.192536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:33945 (local address 127.8.39.67:49167)
0808 15:46:37.192909 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:37.192924 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:37.193033 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:37.193274 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:37.193277 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:37.193463 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:37.193594 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:37.193600 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.194318 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.194321 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:37.194935 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:37.194944 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.195423 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.195427 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:37.195527 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.195947 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:37.195957 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:37.196253 (+ 296us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:37.197689 (+ 1436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:37.197693 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:37.197695 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:37.197883 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:37.198163 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:37.198167 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:37.198169 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:37.198248 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:37.198609 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:37.198612 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:37.198733 (+ 121us) client_negotiation.cc:769] Sending connection context
0808 15:46:37.198845 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 15:46:37.199017 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"mutex_wait_us":1,"thread_start_us":89,"threads_started":1}
I20260808 15:46:37.200925 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 15:46:37 dist-test-slave-8tdl krb5kdc[10128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203997, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 15:46:37 dist-test-slave-8tdl krb5kdc[10128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203997, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:37.228380 10227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.219881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52272 (local address 127.8.39.126:33945)
0808 15:46:37.220034 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:37.220038 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:37.220051 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:46:37.220091 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:37.220093 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:37.220132 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:37.220219 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:37.221019 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.221611 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.222610 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.222893 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.223006 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.225404 (+ 2398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:37.225407 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:37.225409 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:37.225433 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:37.226735 (+ 1302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:37.227160 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:37.227163 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:37.227165 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:37.227245 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:37.227555 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:37.227559 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:37.227560 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:37.227735 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:37.227869 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:37.228095 (+ 226us) server_negotiation.cc:299] Negotiation successful
0808 15:46:37.228214 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 15:46:37.231181 10175 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52272:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:46:37.234367 10175 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:46:37.248396 10706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.242465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:38029 (local address 127.0.0.1:50726)
0808 15:46:37.243210 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:37.243263 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:37.243398 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:37.244422 (+ 1024us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:37.244425 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:37.244439 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:46:37.244557 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:37.244565 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.245576 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.245581 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:37.246807 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:37.246816 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.247826 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.247830 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:37.247957 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.247999 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 15:46:37.248110 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 15:46:37.248222 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"spinlock_wait_cycles":4224,"thread_start_us":69,"threads_started":1}
I20260808 15:46:37.248405 10709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.242642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50726 (local address 127.8.39.66:38029)
0808 15:46:37.243743 (+ 1101us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:37.243756 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:37.243781 (+ 25us) server_negotiation.cc:407] Connection header received
0808 15:46:37.243861 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:37.243866 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:37.244287 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:37.244440 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:46:37.244668 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.245456 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.246932 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.247706 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.247815 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.247988 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:37.248165 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 15:46:37.248258 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":992,"thread_start_us":146,"threads_started":1}
I20260808 15:46:37.249013 10708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.242903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:43167 (local address 127.0.0.1:55036)
0808 15:46:37.243645 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:37.243658 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:37.243734 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:37.244257 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:37.244262 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:37.244287 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:46:37.244493 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:37.244500 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.246042 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.246045 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:37.247510 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:37.247521 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.248622 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.248625 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:37.248709 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.248759 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 15:46:37.248805 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 15:46:37.248877 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":681,"mutex_wait_us":57,"thread_start_us":113,"threads_started":1}
I20260808 15:46:37.249155 10710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.242647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:45997 (local address 127.0.0.1:43576)
0808 15:46:37.243210 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:37.243263 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:37.243398 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:37.244628 (+ 1230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:37.244633 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:37.244653 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:46:37.244751 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:37.244757 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.246135 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.246140 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:37.247241 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:37.247251 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.248637 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.248641 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:37.248782 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.248807 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 15:46:37.248899 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 15:46:37.248982 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434,"mutex_wait_us":69,"spinlock_wait_cycles":6656,"thread_start_us":146,"threads_started":1}
I20260808 15:46:37.249661 10712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.243380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55036 (local address 127.8.39.65:43167)
0808 15:46:37.243761 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:37.243769 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:37.243797 (+ 28us) server_negotiation.cc:407] Connection header received
0808 15:46:37.243876 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:37.243881 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:37.244066 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:37.244648 (+ 582us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:46:37.244767 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.245921 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.247634 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.248452 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.249216 (+ 764us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.249360 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:37.249416 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 15:46:37.249516 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":99,"threads_started":1}
I20260808 15:46:37.250213 10711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.243280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43576 (local address 127.8.39.67:45997)
0808 15:46:37.244012 (+ 732us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:37.244024 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:37.244046 (+ 22us) server_negotiation.cc:407] Connection header received
0808 15:46:37.244118 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:37.244123 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:37.244279 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:37.244440 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:46:37.244878 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.246021 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.247527 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.248302 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.248407 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.248572 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:37.249753 (+ 1181us) server_negotiation.cc:299] Negotiation successful
0808 15:46:37.249857 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":613,"thread_start_us":124,"threads_started":1}
I20260808 15:46:37.252390 10468 tablet_service.cc:1467] Processing CreateTablet for tablet f61343edc594447dbb51f64acde3a35b (DEFAULT_TABLE table=test-table [id=d6dea419fb07432d98ccda0dbcbf787f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:37.252377 10321 tablet_service.cc:1467] Processing CreateTablet for tablet f61343edc594447dbb51f64acde3a35b (DEFAULT_TABLE table=test-table [id=d6dea419fb07432d98ccda0dbcbf787f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:37.252879 10617 tablet_service.cc:1467] Processing CreateTablet for tablet f61343edc594447dbb51f64acde3a35b (DEFAULT_TABLE table=test-table [id=d6dea419fb07432d98ccda0dbcbf787f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:37.253481 10468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f61343edc594447dbb51f64acde3a35b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:37.253491 10321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f61343edc594447dbb51f64acde3a35b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:37.253773 10617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f61343edc594447dbb51f64acde3a35b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:37.260509 10713 tablet_bootstrap.cc:492] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5: Bootstrap starting.
I20260808 15:46:37.261925 10715 tablet_bootstrap.cc:492] T f61343edc594447dbb51f64acde3a35b P 5436a2a7d2064e00838827014761f80e: Bootstrap starting.
I20260808 15:46:37.262724 10713 tablet_bootstrap.cc:654] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:37.263001 10714 tablet_bootstrap.cc:492] T f61343edc594447dbb51f64acde3a35b P 0134846235ac413eaa6321a7491648c2: Bootstrap starting.
I20260808 15:46:37.263531 10713 log.cc:824] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:37.263993 10715 tablet_bootstrap.cc:654] T f61343edc594447dbb51f64acde3a35b P 5436a2a7d2064e00838827014761f80e: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:37.264786 10715 log.cc:824] T f61343edc594447dbb51f64acde3a35b P 5436a2a7d2064e00838827014761f80e: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:37.265076 10714 tablet_bootstrap.cc:654] T f61343edc594447dbb51f64acde3a35b P 0134846235ac413eaa6321a7491648c2: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:37.265832 10714 log.cc:824] T f61343edc594447dbb51f64acde3a35b P 0134846235ac413eaa6321a7491648c2: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:37.266096 10713 tablet_bootstrap.cc:492] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5: No bootstrap required, opened a new log
I20260808 15:46:37.266284 10713 ts_tablet_manager.cc:1397] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 15:46:37.266815 10715 tablet_bootstrap.cc:492] T f61343edc594447dbb51f64acde3a35b P 5436a2a7d2064e00838827014761f80e: No bootstrap required, opened a new log
I20260808 15:46:37.267012 10715 ts_tablet_manager.cc:1397] T f61343edc594447dbb51f64acde3a35b P 5436a2a7d2064e00838827014761f80e: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260808 15:46:37.267491 10714 tablet_bootstrap.cc:492] T f61343edc594447dbb51f64acde3a35b P 0134846235ac413eaa6321a7491648c2: No bootstrap required, opened a new log
I20260808 15:46:37.267675 10714 ts_tablet_manager.cc:1397] T f61343edc594447dbb51f64acde3a35b P 0134846235ac413eaa6321a7491648c2: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 15:46:37.270378 10713 raft_consensus.cc:348] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } } peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } }
I20260808 15:46:37.270655 10713 raft_consensus.cc:374] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:37.270748 10713 raft_consensus.cc:729] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f434d1fa4d3494e8cf133768a558af5, State: Initialized, Role: FOLLOWER
I20260808 15:46:37.270810 10715 raft_consensus.cc:348] T f61343edc594447dbb51f64acde3a35b P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } } peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } }
I20260808 15:46:37.270850 10714 raft_consensus.cc:348] T f61343edc594447dbb51f64acde3a35b P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } } peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } }
I20260808 15:46:37.271098 10715 raft_consensus.cc:374] T f61343edc594447dbb51f64acde3a35b P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:37.271102 10714 raft_consensus.cc:374] T f61343edc594447dbb51f64acde3a35b P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:37.271160 10714 raft_consensus.cc:729] T f61343edc594447dbb51f64acde3a35b P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0134846235ac413eaa6321a7491648c2, State: Initialized, Role: FOLLOWER
I20260808 15:46:37.271162 10715 raft_consensus.cc:729] T f61343edc594447dbb51f64acde3a35b P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5436a2a7d2064e00838827014761f80e, State: Initialized, Role: FOLLOWER
I20260808 15:46:37.271463 10713 consensus_queue.cc:260] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } } peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } }
I20260808 15:46:37.271524 10715 consensus_queue.cc:260] T f61343edc594447dbb51f64acde3a35b P 5436a2a7d2064e00838827014761f80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } } peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } }
I20260808 15:46:37.271591 10714 consensus_queue.cc:260] T f61343edc594447dbb51f64acde3a35b P 0134846235ac413eaa6321a7491648c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } } peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } }
I20260808 15:46:37.272410 10714 ts_tablet_manager.cc:1428] T f61343edc594447dbb51f64acde3a35b P 0134846235ac413eaa6321a7491648c2: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 15:46:37.272487 10715 ts_tablet_manager.cc:1428] T f61343edc594447dbb51f64acde3a35b P 5436a2a7d2064e00838827014761f80e: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 15:46:37.272487 10713 ts_tablet_manager.cc:1428] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260808 15:46:37.272802 10388 heartbeater.cc:503] Master 127.8.39.126:33945 was elected leader, sending a full tablet report...
I20260808 15:46:37.272840 10688 heartbeater.cc:503] Master 127.8.39.126:33945 was elected leader, sending a full tablet report...
I20260808 15:46:37.273708 10537 heartbeater.cc:503] Master 127.8.39.126:33945 was elected leader, sending a full tablet report...
I20260808 15:46:37.286666 10719 raft_consensus.cc:482] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:46:37.286912 10719 raft_consensus.cc:504] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } } peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } }
I20260808 15:46:37.288115 10719 leader_election.cc:288] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5436a2a7d2064e00838827014761f80e (127.8.39.66:38029), 0134846235ac413eaa6321a7491648c2 (127.8.39.65:43167)
I20260808 15:46:37.292902 10572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.288383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:43167 (local address 127.8.39.67:48245)
0808 15:46:37.288686 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:37.288707 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:37.288805 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:37.289204 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:37.289207 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:37.289231 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:46:37.289389 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:37.289398 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.290379 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.290384 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:37.291813 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:37.291825 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.292580 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.292582 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:37.292659 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.292678 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 15:46:37.292736 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 15:46:37.292793 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":25}
I20260808 15:46:37.292975 10712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.288653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:48245 (local address 127.8.39.65:43167)
0808 15:46:37.288936 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:37.288943 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:37.288963 (+ 20us) server_negotiation.cc:407] Connection header received
0808 15:46:37.289026 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:37.289030 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:37.289084 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:37.289165 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:46:37.289519 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.290216 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.291956 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.292459 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.292579 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.292649 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:37.292775 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 15:46:37.292851 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
I20260808 15:46:37.293706 10722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.288403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:38029 (local address 127.8.39.67:46955)
0808 15:46:37.288933 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:37.288953 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:37.289069 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:37.289373 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:37.289375 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:37.289391 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:46:37.289560 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:37.289566 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.290709 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.290713 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:37.292365 (+ 1652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:37.292373 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.293400 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.293403 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:37.293472 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.293489 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 15:46:37.293550 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 15:46:37.293598 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"mutex_wait_us":5,"thread_start_us":170,"threads_started":1}
I20260808 15:46:37.293625 10341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f61343edc594447dbb51f64acde3a35b" candidate_uuid: "5f434d1fa4d3494e8cf133768a558af5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0134846235ac413eaa6321a7491648c2" is_pre_election: true
I20260808 15:46:37.293799 10709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.288621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:46955 (local address 127.8.39.66:38029)
0808 15:46:37.288809 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:37.288814 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:37.289070 (+ 256us) server_negotiation.cc:407] Connection header received
0808 15:46:37.289204 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:37.289207 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:37.289258 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:37.289356 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:46:37.289686 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.290572 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.292481 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.293133 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.293247 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.293309 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:37.293597 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 15:46:37.293686 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260808 15:46:37.293977 10341 raft_consensus.cc:2454] T f61343edc594447dbb51f64acde3a35b P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f434d1fa4d3494e8cf133768a558af5 in term 0.
I20260808 15:46:37.294498 10565 leader_election.cc:302] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0134846235ac413eaa6321a7491648c2, 5f434d1fa4d3494e8cf133768a558af5; no voters:
I20260808 15:46:37.294534 10488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f61343edc594447dbb51f64acde3a35b" candidate_uuid: "5f434d1fa4d3494e8cf133768a558af5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5436a2a7d2064e00838827014761f80e" is_pre_election: true
I20260808 15:46:37.294780 10719 raft_consensus.cc:2781] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:46:37.294871 10488 raft_consensus.cc:2454] T f61343edc594447dbb51f64acde3a35b P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f434d1fa4d3494e8cf133768a558af5 in term 0.
I20260808 15:46:37.294963 10719 raft_consensus.cc:482] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:46:37.295013 10719 raft_consensus.cc:3037] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:37.296196 10719 raft_consensus.cc:504] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } } peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } }
I20260808 15:46:37.296547 10719 leader_election.cc:288] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5 [CANDIDATE]: Term 1 election: Requested vote from peers 5436a2a7d2064e00838827014761f80e (127.8.39.66:38029), 0134846235ac413eaa6321a7491648c2 (127.8.39.65:43167)
I20260808 15:46:37.296895 10488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f61343edc594447dbb51f64acde3a35b" candidate_uuid: "5f434d1fa4d3494e8cf133768a558af5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5436a2a7d2064e00838827014761f80e"
I20260808 15:46:37.297042 10341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f61343edc594447dbb51f64acde3a35b" candidate_uuid: "5f434d1fa4d3494e8cf133768a558af5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0134846235ac413eaa6321a7491648c2"
I20260808 15:46:37.297056 10488 raft_consensus.cc:3037] T f61343edc594447dbb51f64acde3a35b P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:37.297205 10341 raft_consensus.cc:3037] T f61343edc594447dbb51f64acde3a35b P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:37.298437 10341 raft_consensus.cc:2454] T f61343edc594447dbb51f64acde3a35b P 0134846235ac413eaa6321a7491648c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f434d1fa4d3494e8cf133768a558af5 in term 1.
I20260808 15:46:37.298772 10488 raft_consensus.cc:2454] T f61343edc594447dbb51f64acde3a35b P 5436a2a7d2064e00838827014761f80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f434d1fa4d3494e8cf133768a558af5 in term 1.
I20260808 15:46:37.298810 10565 leader_election.cc:302] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0134846235ac413eaa6321a7491648c2, 5f434d1fa4d3494e8cf133768a558af5; no voters:
I20260808 15:46:37.298987 10719 raft_consensus.cc:2781] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:37.299247 10719 raft_consensus.cc:686] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5 [term 1 LEADER]: Becoming Leader. State: Replica: 5f434d1fa4d3494e8cf133768a558af5, State: Running, Role: LEADER
I20260808 15:46:37.299597 10719 consensus_queue.cc:237] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } } peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } }
I20260808 15:46:37.302665 10169 catalog_manager.cc:5495] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f434d1fa4d3494e8cf133768a558af5 (127.8.39.67). New cstate: current_term: 1 leader_uuid: "5f434d1fa4d3494e8cf133768a558af5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } health_report { overall_health: UNKNOWN } } }
Aug 08 15:46:37 dist-test-slave-8tdl krb5kdc[10128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203996, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:37.353806 10730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.344616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:33945 (local address 127.0.0.1:52286)
0808 15:46:37.345016 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:37.345031 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:37.345179 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:37.345430 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:37.345433 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:37.345936 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:37.346054 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:37.346061 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.346933 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.346936 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:37.347560 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:37.347568 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.347987 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.347990 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:37.348066 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.348757 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:37.348770 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:37.350419 (+ 1649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:37.352187 (+ 1768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:37.352199 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:37.352206 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:37.352441 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:37.352729 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:37.352732 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:37.352734 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:37.352812 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:37.353203 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:37.353211 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:37.353318 (+ 107us) client_negotiation.cc:769] Sending connection context
0808 15:46:37.353429 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 15:46:37.353605 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":115,"threads_started":1}
I20260808 15:46:37.353804 10227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.344752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52286 (local address 127.8.39.126:33945)
0808 15:46:37.344929 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:37.344936 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:37.345131 (+ 195us) server_negotiation.cc:407] Connection header received
0808 15:46:37.345277 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:37.345280 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:37.345320 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:37.345382 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:37.346172 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.346797 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.347675 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.347879 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.347953 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.350566 (+ 2613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:37.350570 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:37.350572 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:37.350591 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:37.352090 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:37.352554 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:37.352557 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:37.352559 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:37.352638 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:37.352901 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:37.352904 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:37.352906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:37.353103 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:37.353204 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:37.353485 (+ 281us) server_negotiation.cc:299] Negotiation successful
0808 15:46:37.353675 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":88,"server-negotiator.queue_time_us":92}
I20260808 15:46:37.358163 10169 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:52286:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 15:46:37.359175 10169 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:46:37.364166 10321 tablet_service.cc:1467] Processing CreateTablet for tablet b9549d94d9774b60a48bcf28f97b2074 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ea220259f59b42458e6ece48f7d06fc6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 15:46:37.364204 10468 tablet_service.cc:1467] Processing CreateTablet for tablet b9549d94d9774b60a48bcf28f97b2074 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ea220259f59b42458e6ece48f7d06fc6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 15:46:37.364535 10617 tablet_service.cc:1467] Processing CreateTablet for tablet b9549d94d9774b60a48bcf28f97b2074 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ea220259f59b42458e6ece48f7d06fc6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 15:46:37.364967 10468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9549d94d9774b60a48bcf28f97b2074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:37.364961 10321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9549d94d9774b60a48bcf28f97b2074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:37.365088 10617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9549d94d9774b60a48bcf28f97b2074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:37.367789 10715 tablet_bootstrap.cc:492] T b9549d94d9774b60a48bcf28f97b2074 P 5436a2a7d2064e00838827014761f80e: Bootstrap starting.
I20260808 15:46:37.367903 10713 tablet_bootstrap.cc:492] T b9549d94d9774b60a48bcf28f97b2074 P 5f434d1fa4d3494e8cf133768a558af5: Bootstrap starting.
I20260808 15:46:37.367903 10714 tablet_bootstrap.cc:492] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2: Bootstrap starting.
I20260808 15:46:37.368754 10715 tablet_bootstrap.cc:654] T b9549d94d9774b60a48bcf28f97b2074 P 5436a2a7d2064e00838827014761f80e: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:37.368884 10714 tablet_bootstrap.cc:654] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:37.368884 10713 tablet_bootstrap.cc:654] T b9549d94d9774b60a48bcf28f97b2074 P 5f434d1fa4d3494e8cf133768a558af5: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:37.370272 10713 tablet_bootstrap.cc:492] T b9549d94d9774b60a48bcf28f97b2074 P 5f434d1fa4d3494e8cf133768a558af5: No bootstrap required, opened a new log
I20260808 15:46:37.370366 10713 ts_tablet_manager.cc:1397] T b9549d94d9774b60a48bcf28f97b2074 P 5f434d1fa4d3494e8cf133768a558af5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260808 15:46:37.370601 10714 tablet_bootstrap.cc:492] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2: No bootstrap required, opened a new log
I20260808 15:46:37.370710 10714 ts_tablet_manager.cc:1397] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 15:46:37.370922 10713 raft_consensus.cc:348] T b9549d94d9774b60a48bcf28f97b2074 P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:37.371042 10713 raft_consensus.cc:374] T b9549d94d9774b60a48bcf28f97b2074 P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:37.371076 10713 raft_consensus.cc:729] T b9549d94d9774b60a48bcf28f97b2074 P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f434d1fa4d3494e8cf133768a558af5, State: Initialized, Role: FOLLOWER
I20260808 15:46:37.371202 10713 consensus_queue.cc:260] T b9549d94d9774b60a48bcf28f97b2074 P 5f434d1fa4d3494e8cf133768a558af5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:37.371235 10714 raft_consensus.cc:348] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:37.371330 10714 raft_consensus.cc:374] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:37.371368 10714 raft_consensus.cc:729] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0134846235ac413eaa6321a7491648c2, State: Initialized, Role: FOLLOWER
I20260808 15:46:37.371512 10713 ts_tablet_manager.cc:1428] T b9549d94d9774b60a48bcf28f97b2074 P 5f434d1fa4d3494e8cf133768a558af5: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260808 15:46:37.371487 10714 consensus_queue.cc:260] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:37.371747 10714 ts_tablet_manager.cc:1428] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:46:37.371714 10719 tablet_replica.cc:439] T b9549d94d9774b60a48bcf28f97b2074 P 5f434d1fa4d3494e8cf133768a558af5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } } }
I20260808 15:46:37.371842 10719 tablet_replica.cc:442] T b9549d94d9774b60a48bcf28f97b2074 P 5f434d1fa4d3494e8cf133768a558af5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:46:37.372352 10721 tablet_replica.cc:439] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } } }
I20260808 15:46:37.372515 10721 tablet_replica.cc:442] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:46:37.372900 10715 tablet_bootstrap.cc:492] T b9549d94d9774b60a48bcf28f97b2074 P 5436a2a7d2064e00838827014761f80e: No bootstrap required, opened a new log
I20260808 15:46:37.372978 10715 ts_tablet_manager.cc:1397] T b9549d94d9774b60a48bcf28f97b2074 P 5436a2a7d2064e00838827014761f80e: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260808 15:46:37.373492 10715 raft_consensus.cc:348] T b9549d94d9774b60a48bcf28f97b2074 P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:37.373625 10715 raft_consensus.cc:374] T b9549d94d9774b60a48bcf28f97b2074 P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:37.373669 10715 raft_consensus.cc:729] T b9549d94d9774b60a48bcf28f97b2074 P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5436a2a7d2064e00838827014761f80e, State: Initialized, Role: FOLLOWER
I20260808 15:46:37.373828 10715 consensus_queue.cc:260] T b9549d94d9774b60a48bcf28f97b2074 P 5436a2a7d2064e00838827014761f80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:37.374100 10720 tablet_replica.cc:439] T b9549d94d9774b60a48bcf28f97b2074 P 5436a2a7d2064e00838827014761f80e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } } }
I20260808 15:46:37.374236 10720 tablet_replica.cc:442] T b9549d94d9774b60a48bcf28f97b2074 P 5436a2a7d2064e00838827014761f80e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:46:37.374102 10715 ts_tablet_manager.cc:1428] T b9549d94d9774b60a48bcf28f97b2074 P 5436a2a7d2064e00838827014761f80e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:46:37.426136 10721 raft_consensus.cc:482] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:46:37.426298 10721 raft_consensus.cc:504] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:37.427479 10721 leader_election.cc:288] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5436a2a7d2064e00838827014761f80e (127.8.39.66:38029), 5f434d1fa4d3494e8cf133768a558af5 (127.8.39.67:45997)
I20260808 15:46:37.432766 10711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.428044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:36275 (local address 127.8.39.67:45997)
0808 15:46:37.428188 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:37.428193 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:37.428454 (+ 261us) server_negotiation.cc:407] Connection header received
0808 15:46:37.428658 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:37.428660 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:37.428705 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:37.428782 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:46:37.429102 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.429834 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.431612 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.432018 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.432141 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.432217 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:37.432550 (+ 333us) server_negotiation.cc:299] Negotiation successful
0808 15:46:37.432638 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 15:46:37.432814 10709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.428107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:41953 (local address 127.8.39.66:38029)
0808 15:46:37.428234 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:37.428238 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:37.428287 (+ 49us) server_negotiation.cc:407] Connection header received
0808 15:46:37.428465 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:37.428468 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:37.428520 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:37.428602 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:46:37.429136 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.429633 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.431576 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.432233 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.432336 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.432413 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:37.432619 (+ 206us) server_negotiation.cc:299] Negotiation successful
0808 15:46:37.432707 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 15:46:37.433135 10735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.427816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:45997 (local address 127.8.39.65:36275)
0808 15:46:37.428370 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:37.428386 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:37.428538 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:37.428806 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:37.428809 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:37.428827 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:46:37.428958 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:37.428965 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.429961 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.429964 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:37.431433 (+ 1469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:37.431446 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.432170 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.432174 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:37.432327 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.432392 (+ 65us) client_negotiation.cc:769] Sending connection context
0808 15:46:37.432505 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 15:46:37.432606 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"mutex_wait_us":42,"thread_start_us":111,"threads_started":1}
I20260808 15:46:37.433162 10734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.427731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:38029 (local address 127.8.39.65:41953)
0808 15:46:37.428194 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:37.428211 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:37.428338 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:37.428890 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:37.428893 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:37.428904 (+ 11us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:46:37.429026 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:37.429035 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.429762 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.429765 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:37.431432 (+ 1667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:37.431446 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.432333 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.432336 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:37.432463 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.432503 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 15:46:37.432966 (+ 463us) client_negotiation.cc:240] Negotiation successful
0808 15:46:37.433034 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":397,"mutex_wait_us":61,"thread_start_us":168,"threads_started":1}
I20260808 15:46:37.433928 10636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9549d94d9774b60a48bcf28f97b2074" candidate_uuid: "0134846235ac413eaa6321a7491648c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f434d1fa4d3494e8cf133768a558af5" is_pre_election: true
I20260808 15:46:37.434044 10488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9549d94d9774b60a48bcf28f97b2074" candidate_uuid: "0134846235ac413eaa6321a7491648c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5436a2a7d2064e00838827014761f80e" is_pre_election: true
I20260808 15:46:37.434201 10488 raft_consensus.cc:2454] T b9549d94d9774b60a48bcf28f97b2074 P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0134846235ac413eaa6321a7491648c2 in term 0.
I20260808 15:46:37.434221 10636 raft_consensus.cc:2454] T b9549d94d9774b60a48bcf28f97b2074 P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0134846235ac413eaa6321a7491648c2 in term 0.
I20260808 15:46:37.434562 10272 leader_election.cc:302] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0134846235ac413eaa6321a7491648c2, 5436a2a7d2064e00838827014761f80e; no voters:
I20260808 15:46:37.434870 10721 raft_consensus.cc:2781] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:46:37.434938 10721 raft_consensus.cc:482] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:46:37.434990 10721 raft_consensus.cc:3037] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:37.435972 10721 raft_consensus.cc:504] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:37.436370 10721 leader_election.cc:288] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2 [CANDIDATE]: Term 1 election: Requested vote from peers 5436a2a7d2064e00838827014761f80e (127.8.39.66:38029), 5f434d1fa4d3494e8cf133768a558af5 (127.8.39.67:45997)
I20260808 15:46:37.436687 10636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9549d94d9774b60a48bcf28f97b2074" candidate_uuid: "0134846235ac413eaa6321a7491648c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f434d1fa4d3494e8cf133768a558af5"
I20260808 15:46:37.436688 10488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9549d94d9774b60a48bcf28f97b2074" candidate_uuid: "0134846235ac413eaa6321a7491648c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5436a2a7d2064e00838827014761f80e"
I20260808 15:46:37.436810 10488 raft_consensus.cc:3037] T b9549d94d9774b60a48bcf28f97b2074 P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:37.436820 10636 raft_consensus.cc:3037] T b9549d94d9774b60a48bcf28f97b2074 P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Advancing to term 1
W20260808 15:46:37.437266 10689 tablet.cc:2369] T b9549d94d9774b60a48bcf28f97b2074 P 5f434d1fa4d3494e8cf133768a558af5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:46:37.437911 10488 raft_consensus.cc:2454] T b9549d94d9774b60a48bcf28f97b2074 P 5436a2a7d2064e00838827014761f80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0134846235ac413eaa6321a7491648c2 in term 1.
I20260808 15:46:37.438076 10636 raft_consensus.cc:2454] T b9549d94d9774b60a48bcf28f97b2074 P 5f434d1fa4d3494e8cf133768a558af5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0134846235ac413eaa6321a7491648c2 in term 1.
I20260808 15:46:37.438189 10272 leader_election.cc:302] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0134846235ac413eaa6321a7491648c2, 5436a2a7d2064e00838827014761f80e; no voters:
I20260808 15:46:37.438388 10721 raft_consensus.cc:2781] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:37.438645 10721 raft_consensus.cc:686] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2 [term 1 LEADER]: Becoming Leader. State: Replica: 0134846235ac413eaa6321a7491648c2, State: Running, Role: LEADER
I20260808 15:46:37.439000 10721 consensus_queue.cc:237] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:37.441453 10736 tablet_replica.cc:439] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2: TxnStatusTablet state changed. Reason: New leader 0134846235ac413eaa6321a7491648c2. Latest consensus state: current_term: 1 leader_uuid: "0134846235ac413eaa6321a7491648c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } } }
I20260808 15:46:37.441629 10736 tablet_replica.cc:442] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2: This TxnStatusTablet replica's current role is: LEADER
I20260808 15:46:37.442227 10738 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 15:46:37.442428 10738 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 15:46:37.442719 10175 catalog_manager.cc:5495] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0134846235ac413eaa6321a7491648c2 (127.8.39.65). New cstate: current_term: 1 leader_uuid: "0134846235ac413eaa6321a7491648c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } health_report { overall_health: UNKNOWN } } }
W20260808 15:46:37.467366 10539 tablet.cc:2369] T b9549d94d9774b60a48bcf28f97b2074 P 5436a2a7d2064e00838827014761f80e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:46:37.470732 10712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.466429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55048 (local address 127.8.39.65:43167)
0808 15:46:37.466562 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:37.466566 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:37.466580 (+ 14us) server_negotiation.cc:407] Connection header received
0808 15:46:37.466816 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:37.466818 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:37.466874 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:37.466955 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:46:37.467237 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.467959 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.469163 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.469451 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.469539 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.469900 (+ 361us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:46:37.470323 (+ 423us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:46:37.470412 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:37.470530 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 15:46:37.470579 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 15:46:37.470782 10730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.466323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:43167 (local address 127.0.0.1:55048)
0808 15:46:37.466520 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:37.466538 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:37.466645 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:37.466996 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:37.466999 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:37.467007 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 15:46:37.467121 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:37.467126 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.468077 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.468081 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:37.469054 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:37.469064 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.469568 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.469571 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:37.469681 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.469735 (+ 54us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 15:46:37.470412 (+ 677us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 15:46:37.470429 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 15:46:37.470508 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 15:46:37.470601 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 15:46:37.476339 10636 raft_consensus.cc:1261] T b9549d94d9774b60a48bcf28f97b2074 P 5f434d1fa4d3494e8cf133768a558af5 [term 1 FOLLOWER]: Refusing update from remote peer 0134846235ac413eaa6321a7491648c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:46:37.476339 10488 raft_consensus.cc:1261] T b9549d94d9774b60a48bcf28f97b2074 P 5436a2a7d2064e00838827014761f80e [term 1 FOLLOWER]: Refusing update from remote peer 0134846235ac413eaa6321a7491648c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:46:37.477027 10721 consensus_queue.cc:1035] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:46:37.477257 10736 consensus_queue.cc:1035] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 15:46:37.477851 10389 tablet.cc:2369] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:46:37.480419 10719 tablet_replica.cc:439] T b9549d94d9774b60a48bcf28f97b2074 P 5f434d1fa4d3494e8cf133768a558af5: TxnStatusTablet state changed. Reason: New leader 0134846235ac413eaa6321a7491648c2. Latest consensus state: current_term: 1 leader_uuid: "0134846235ac413eaa6321a7491648c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } } }
I20260808 15:46:37.480548 10719 tablet_replica.cc:442] T b9549d94d9774b60a48bcf28f97b2074 P 5f434d1fa4d3494e8cf133768a558af5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:46:37.481215 10720 tablet_replica.cc:439] T b9549d94d9774b60a48bcf28f97b2074 P 5436a2a7d2064e00838827014761f80e: TxnStatusTablet state changed. Reason: New leader 0134846235ac413eaa6321a7491648c2. Latest consensus state: current_term: 1 leader_uuid: "0134846235ac413eaa6321a7491648c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } } }
I20260808 15:46:37.481359 10720 tablet_replica.cc:442] T b9549d94d9774b60a48bcf28f97b2074 P 5436a2a7d2064e00838827014761f80e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:46:37.485003 10736 tablet_replica.cc:439] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0134846235ac413eaa6321a7491648c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } } }
I20260808 15:46:37.485134 10736 tablet_replica.cc:442] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2: This TxnStatusTablet replica's current role is: LEADER
I20260808 15:46:37.485296 10719 tablet_replica.cc:439] T b9549d94d9774b60a48bcf28f97b2074 P 5f434d1fa4d3494e8cf133768a558af5: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0134846235ac413eaa6321a7491648c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } } }
I20260808 15:46:37.485422 10719 tablet_replica.cc:442] T b9549d94d9774b60a48bcf28f97b2074 P 5f434d1fa4d3494e8cf133768a558af5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:46:37.487743 10721 tablet_replica.cc:439] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0134846235ac413eaa6321a7491648c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } } }
I20260808 15:46:37.487857 10721 tablet_replica.cc:442] T b9549d94d9774b60a48bcf28f97b2074 P 0134846235ac413eaa6321a7491648c2: This TxnStatusTablet replica's current role is: LEADER
I20260808 15:46:37.489112 10720 tablet_replica.cc:439] T b9549d94d9774b60a48bcf28f97b2074 P 5436a2a7d2064e00838827014761f80e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0134846235ac413eaa6321a7491648c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } } }
I20260808 15:46:37.489249 10720 tablet_replica.cc:442] T b9549d94d9774b60a48bcf28f97b2074 P 5436a2a7d2064e00838827014761f80e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:46:37.498595 10711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.494585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43582 (local address 127.8.39.67:45997)
0808 15:46:37.494720 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:37.494725 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:37.494764 (+ 39us) server_negotiation.cc:407] Connection header received
0808 15:46:37.494934 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:37.494938 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:37.495004 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:37.495104 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:46:37.495322 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.496166 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.496993 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.497334 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.497439 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.497689 (+ 250us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:46:37.498208 (+ 519us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:46:37.498318 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:37.498397 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 15:46:37.498462 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 15:46:37.509670 10712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.506367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:42747 (local address 127.8.39.65:43167)
0808 15:46:37.506506 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:37.506509 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:37.506522 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:46:37.506628 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:37.506630 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:37.506672 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:37.506778 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:46:37.507034 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.507523 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.508693 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.508894 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.508969 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.509291 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:46:37.509353 (+ 62us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:46:37.509404 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:37.509520 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 15:46:37.509565 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 15:46:37.509716 10694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.506282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:43167 (local address 127.8.39.67:42747)
0808 15:46:37.506425 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:37.506441 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:37.506526 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:37.506795 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:37.506798 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:37.506805 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 15:46:37.506925 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:37.506931 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.507621 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.507625 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:37.508587 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:37.508597 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.508999 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.509003 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:37.509100 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.509151 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 15:46:37.509431 (+ 280us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 15:46:37.509438 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 15:46:37.509504 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 15:46:37.509582 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 15:46:37.516904 10488 raft_consensus.cc:1261] T f61343edc594447dbb51f64acde3a35b P 5436a2a7d2064e00838827014761f80e [term 1 FOLLOWER]: Refusing update from remote peer 5f434d1fa4d3494e8cf133768a558af5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:46:37.516942 10341 raft_consensus.cc:1261] T f61343edc594447dbb51f64acde3a35b P 0134846235ac413eaa6321a7491648c2 [term 1 FOLLOWER]: Refusing update from remote peer 5f434d1fa4d3494e8cf133768a558af5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:46:37.517402 10723 consensus_queue.cc:1035] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:46:37.517602 10719 consensus_queue.cc:1035] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:46:37.521551 10744 mvcc.cc:205] Tried to move back new op lower bound from 7316291573824512000 to 7316291572941881344. Current Snapshot: MvccSnapshot[applied={T|T < 7316291573824512000}]
I20260808 15:46:37.522912 10741 mvcc.cc:205] Tried to move back new op lower bound from 7316291573824512000 to 7316291572941881344. Current Snapshot: MvccSnapshot[applied={T|T < 7316291573824512000}]
I20260808 15:46:37.541496 10711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.537669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:56831 (local address 127.8.39.67:45997)
0808 15:46:37.537783 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:37.537787 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:37.538001 (+ 214us) server_negotiation.cc:407] Connection header received
0808 15:46:37.538095 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:37.538098 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:37.538147 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:37.538226 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:46:37.538532 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.539158 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.540419 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.540645 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.540757 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.541031 (+ 274us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:46:37.541106 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:46:37.541186 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:37.541301 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 15:46:37.541349 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 15:46:37.541512 10758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:37.537603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:45997 (local address 127.8.39.65:56831)
0808 15:46:37.537916 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:37.537929 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:37.538023 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:37.538251 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:37.538253 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:37.538262 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 15:46:37.538376 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:37.538383 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.539309 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.539312 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:37.540286 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:37.540296 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:37.540774 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:37.540778 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:37.540863 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:37.540903 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 15:46:37.541190 (+ 287us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 15:46:37.541199 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 15:46:37.541278 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 15:46:37.541360 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":104,"threads_started":1}
I20260808 15:46:37.570492 10175 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52272:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:46:37.570721 10175 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52272:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:46:37.573452 10175 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf: Sending DeleteTablet for 3 replicas of tablet f61343edc594447dbb51f64acde3a35b
I20260808 15:46:37.574230 10468 tablet_service.cc:1514] Processing DeleteTablet for tablet f61343edc594447dbb51f64acde3a35b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:46:37 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:50726
I20260808 15:46:37.574434 10617 tablet_service.cc:1514] Processing DeleteTablet for tablet f61343edc594447dbb51f64acde3a35b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:46:37 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:43576
I20260808 15:46:37.575011 10321 tablet_service.cc:1514] Processing DeleteTablet for tablet f61343edc594447dbb51f64acde3a35b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:46:37 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:55036
I20260808 15:46:37.575517 10763 tablet_replica.cc:330] T f61343edc594447dbb51f64acde3a35b P 5436a2a7d2064e00838827014761f80e: stopping tablet replica
I20260808 15:46:37.575668 10175 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52272:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 15:46:37.575834 10763 raft_consensus.cc:2229] T f61343edc594447dbb51f64acde3a35b P 5436a2a7d2064e00838827014761f80e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:46:37.576045 10763 raft_consensus.cc:2258] T f61343edc594447dbb51f64acde3a35b P 5436a2a7d2064e00838827014761f80e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 15:46:37.576061 10175 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:46:37.577641 10763 ts_tablet_manager.cc:1905] T f61343edc594447dbb51f64acde3a35b P 5436a2a7d2064e00838827014761f80e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:46:37.580829 10763 ts_tablet_manager.cc:1918] T f61343edc594447dbb51f64acde3a35b P 5436a2a7d2064e00838827014761f80e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:46:37.580929 10763 log.cc:1196] T f61343edc594447dbb51f64acde3a35b P 5436a2a7d2064e00838827014761f80e: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-1/wal/wals/f61343edc594447dbb51f64acde3a35b
I20260808 15:46:37.581228 10763 ts_tablet_manager.cc:1939] T f61343edc594447dbb51f64acde3a35b P 5436a2a7d2064e00838827014761f80e: Deleting consensus metadata
I20260808 15:46:37.581800 10468 tablet_service.cc:1467] Processing CreateTablet for tablet c1c64916fd9745d9a07186cfea88a997 (DEFAULT_TABLE table=test-table [id=fbb8611f35bf4f9e99893567cd8a9eca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:37.582033 10468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1c64916fd9745d9a07186cfea88a997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:37.582880 10765 tablet_replica.cc:330] T f61343edc594447dbb51f64acde3a35b P 0134846235ac413eaa6321a7491648c2: stopping tablet replica
I20260808 15:46:37.583118 10765 raft_consensus.cc:2229] T f61343edc594447dbb51f64acde3a35b P 0134846235ac413eaa6321a7491648c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:46:37.583238 10765 raft_consensus.cc:2258] T f61343edc594447dbb51f64acde3a35b P 0134846235ac413eaa6321a7491648c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:46:37.584117 10715 tablet_bootstrap.cc:492] T c1c64916fd9745d9a07186cfea88a997 P 5436a2a7d2064e00838827014761f80e: Bootstrap starting.
I20260808 15:46:37.584275 10321 tablet_service.cc:1467] Processing CreateTablet for tablet c1c64916fd9745d9a07186cfea88a997 (DEFAULT_TABLE table=test-table [id=fbb8611f35bf4f9e99893567cd8a9eca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:37.584527 10321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1c64916fd9745d9a07186cfea88a997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:37.585084 10715 tablet_bootstrap.cc:654] T c1c64916fd9745d9a07186cfea88a997 P 5436a2a7d2064e00838827014761f80e: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:37.586870 10161 catalog_manager.cc:4841] TS 5436a2a7d2064e00838827014761f80e (127.8.39.66:38029): tablet f61343edc594447dbb51f64acde3a35b (table test-table [id=d6dea419fb07432d98ccda0dbcbf787f]) successfully deleted
I20260808 15:46:37.587680 10714 tablet_bootstrap.cc:492] T c1c64916fd9745d9a07186cfea88a997 P 0134846235ac413eaa6321a7491648c2: Bootstrap starting.
I20260808 15:46:37.587687 10617 tablet_service.cc:1467] Processing CreateTablet for tablet c1c64916fd9745d9a07186cfea88a997 (DEFAULT_TABLE table=test-table [id=fbb8611f35bf4f9e99893567cd8a9eca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:37.587975 10617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1c64916fd9745d9a07186cfea88a997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:37.589087 10714 tablet_bootstrap.cc:654] T c1c64916fd9745d9a07186cfea88a997 P 0134846235ac413eaa6321a7491648c2: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:37.590502 10713 tablet_bootstrap.cc:492] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5: Bootstrap starting.
I20260808 15:46:37.591559 10713 tablet_bootstrap.cc:654] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:37.592047 10715 tablet_bootstrap.cc:492] T c1c64916fd9745d9a07186cfea88a997 P 5436a2a7d2064e00838827014761f80e: No bootstrap required, opened a new log
I20260808 15:46:37.592154 10715 ts_tablet_manager.cc:1397] T c1c64916fd9745d9a07186cfea88a997 P 5436a2a7d2064e00838827014761f80e: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20260808 15:46:37.592659 10715 raft_consensus.cc:348] T c1c64916fd9745d9a07186cfea88a997 P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:37.592779 10715 raft_consensus.cc:374] T c1c64916fd9745d9a07186cfea88a997 P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:37.592809 10715 raft_consensus.cc:729] T c1c64916fd9745d9a07186cfea88a997 P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5436a2a7d2064e00838827014761f80e, State: Initialized, Role: FOLLOWER
I20260808 15:46:37.592928 10715 consensus_queue.cc:260] T c1c64916fd9745d9a07186cfea88a997 P 5436a2a7d2064e00838827014761f80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:37.593747 10715 ts_tablet_manager.cc:1428] T c1c64916fd9745d9a07186cfea88a997 P 5436a2a7d2064e00838827014761f80e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260808 15:46:37.591578 10764 tablet_replica.cc:330] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5: stopping tablet replica
I20260808 15:46:37.594187 10764 raft_consensus.cc:2229] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:46:37.594584 10764 raft_consensus.cc:2258] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:46:37.596109 10765 ts_tablet_manager.cc:1905] T f61343edc594447dbb51f64acde3a35b P 0134846235ac413eaa6321a7491648c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:46:37.597325 10713 tablet_bootstrap.cc:492] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5: No bootstrap required, opened a new log
I20260808 15:46:37.597416 10713 ts_tablet_manager.cc:1397] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260808 15:46:37.597646 10764 ts_tablet_manager.cc:1905] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:46:37.597867 10713 raft_consensus.cc:348] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:37.597980 10713 raft_consensus.cc:374] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:37.598011 10713 raft_consensus.cc:729] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f434d1fa4d3494e8cf133768a558af5, State: Initialized, Role: FOLLOWER
I20260808 15:46:37.598127 10713 consensus_queue.cc:260] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:37.598385 10713 ts_tablet_manager.cc:1428] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:46:37.599007 10714 tablet_bootstrap.cc:492] T c1c64916fd9745d9a07186cfea88a997 P 0134846235ac413eaa6321a7491648c2: No bootstrap required, opened a new log
I20260808 15:46:37.599124 10714 ts_tablet_manager.cc:1397] T c1c64916fd9745d9a07186cfea88a997 P 0134846235ac413eaa6321a7491648c2: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260808 15:46:37.599407 10765 ts_tablet_manager.cc:1918] T f61343edc594447dbb51f64acde3a35b P 0134846235ac413eaa6321a7491648c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:46:37.599515 10765 log.cc:1196] T f61343edc594447dbb51f64acde3a35b P 0134846235ac413eaa6321a7491648c2: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-0/wal/wals/f61343edc594447dbb51f64acde3a35b
I20260808 15:46:37.599669 10714 raft_consensus.cc:348] T c1c64916fd9745d9a07186cfea88a997 P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:37.599792 10714 raft_consensus.cc:374] T c1c64916fd9745d9a07186cfea88a997 P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:37.599831 10714 raft_consensus.cc:729] T c1c64916fd9745d9a07186cfea88a997 P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0134846235ac413eaa6321a7491648c2, State: Initialized, Role: FOLLOWER
I20260808 15:46:37.599851 10765 ts_tablet_manager.cc:1939] T f61343edc594447dbb51f64acde3a35b P 0134846235ac413eaa6321a7491648c2: Deleting consensus metadata
I20260808 15:46:37.599946 10714 consensus_queue.cc:260] T c1c64916fd9745d9a07186cfea88a997 P 0134846235ac413eaa6321a7491648c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:37.600211 10714 ts_tablet_manager.cc:1428] T c1c64916fd9745d9a07186cfea88a997 P 0134846235ac413eaa6321a7491648c2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:46:37.601037 10160 catalog_manager.cc:4841] TS 0134846235ac413eaa6321a7491648c2 (127.8.39.65:43167): tablet f61343edc594447dbb51f64acde3a35b (table test-table [id=d6dea419fb07432d98ccda0dbcbf787f]) successfully deleted
I20260808 15:46:37.602626 10764 ts_tablet_manager.cc:1918] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:46:37.602837 10764 log.cc:1196] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/f61343edc594447dbb51f64acde3a35b
I20260808 15:46:37.603232 10764 ts_tablet_manager.cc:1939] T f61343edc594447dbb51f64acde3a35b P 5f434d1fa4d3494e8cf133768a558af5: Deleting consensus metadata
I20260808 15:46:37.604408 10159 catalog_manager.cc:4841] TS 5f434d1fa4d3494e8cf133768a558af5 (127.8.39.67:45997): tablet f61343edc594447dbb51f64acde3a35b (table test-table [id=d6dea419fb07432d98ccda0dbcbf787f]) successfully deleted
I20260808 15:46:37.799583 10759 raft_consensus.cc:482] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:46:37.799753 10759 raft_consensus.cc:504] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:37.800547 10759 leader_election.cc:288] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0134846235ac413eaa6321a7491648c2 (127.8.39.65:43167), 5436a2a7d2064e00838827014761f80e (127.8.39.66:38029)
I20260808 15:46:37.801034 10341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1c64916fd9745d9a07186cfea88a997" candidate_uuid: "5f434d1fa4d3494e8cf133768a558af5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0134846235ac413eaa6321a7491648c2" is_pre_election: true
I20260808 15:46:37.801043 10488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1c64916fd9745d9a07186cfea88a997" candidate_uuid: "5f434d1fa4d3494e8cf133768a558af5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5436a2a7d2064e00838827014761f80e" is_pre_election: true
I20260808 15:46:37.801198 10341 raft_consensus.cc:2454] T c1c64916fd9745d9a07186cfea88a997 P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f434d1fa4d3494e8cf133768a558af5 in term 0.
I20260808 15:46:37.801208 10488 raft_consensus.cc:2454] T c1c64916fd9745d9a07186cfea88a997 P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f434d1fa4d3494e8cf133768a558af5 in term 0.
I20260808 15:46:37.801535 10565 leader_election.cc:302] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0134846235ac413eaa6321a7491648c2, 5f434d1fa4d3494e8cf133768a558af5; no voters:
I20260808 15:46:37.801717 10759 raft_consensus.cc:2781] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:46:37.801782 10759 raft_consensus.cc:482] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:46:37.801824 10759 raft_consensus.cc:3037] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:37.802898 10759 raft_consensus.cc:504] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:37.803233 10759 leader_election.cc:288] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5 [CANDIDATE]: Term 1 election: Requested vote from peers 0134846235ac413eaa6321a7491648c2 (127.8.39.65:43167), 5436a2a7d2064e00838827014761f80e (127.8.39.66:38029)
I20260808 15:46:37.803581 10341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1c64916fd9745d9a07186cfea88a997" candidate_uuid: "5f434d1fa4d3494e8cf133768a558af5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0134846235ac413eaa6321a7491648c2"
I20260808 15:46:37.803654 10488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1c64916fd9745d9a07186cfea88a997" candidate_uuid: "5f434d1fa4d3494e8cf133768a558af5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5436a2a7d2064e00838827014761f80e"
I20260808 15:46:37.803710 10341 raft_consensus.cc:3037] T c1c64916fd9745d9a07186cfea88a997 P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:37.803794 10488 raft_consensus.cc:3037] T c1c64916fd9745d9a07186cfea88a997 P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:37.804744 10488 raft_consensus.cc:2454] T c1c64916fd9745d9a07186cfea88a997 P 5436a2a7d2064e00838827014761f80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f434d1fa4d3494e8cf133768a558af5 in term 1.
I20260808 15:46:37.804766 10341 raft_consensus.cc:2454] T c1c64916fd9745d9a07186cfea88a997 P 0134846235ac413eaa6321a7491648c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f434d1fa4d3494e8cf133768a558af5 in term 1.
I20260808 15:46:37.805066 10565 leader_election.cc:302] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0134846235ac413eaa6321a7491648c2, 5f434d1fa4d3494e8cf133768a558af5; no voters:
I20260808 15:46:37.805254 10759 raft_consensus.cc:2781] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:37.805364 10759 raft_consensus.cc:686] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5 [term 1 LEADER]: Becoming Leader. State: Replica: 5f434d1fa4d3494e8cf133768a558af5, State: Running, Role: LEADER
I20260808 15:46:37.805516 10759 consensus_queue.cc:237] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:37.807144 10175 catalog_manager.cc:5495] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f434d1fa4d3494e8cf133768a558af5 (127.8.39.67). New cstate: current_term: 1 leader_uuid: "5f434d1fa4d3494e8cf133768a558af5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } health_report { overall_health: HEALTHY } } }
I20260808 15:46:37.841800 10488 raft_consensus.cc:1261] T c1c64916fd9745d9a07186cfea88a997 P 5436a2a7d2064e00838827014761f80e [term 1 FOLLOWER]: Refusing update from remote peer 5f434d1fa4d3494e8cf133768a558af5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:46:37.841838 10341 raft_consensus.cc:1261] T c1c64916fd9745d9a07186cfea88a997 P 0134846235ac413eaa6321a7491648c2 [term 1 FOLLOWER]: Refusing update from remote peer 5f434d1fa4d3494e8cf133768a558af5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:46:37.842221 10759 consensus_queue.cc:1035] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:46:37.842418 10723 consensus_queue.cc:1035] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 15:46:37.855211 10744 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 15:46:39.409442 10176 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52272:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:46:39.409602 10176 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52272:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:46:39.412041 10176 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf: Sending DeleteTablet for 3 replicas of tablet c1c64916fd9745d9a07186cfea88a997
I20260808 15:46:39.412715 10468 tablet_service.cc:1514] Processing DeleteTablet for tablet c1c64916fd9745d9a07186cfea88a997 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:46:39 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:50726
I20260808 15:46:39.412731 10321 tablet_service.cc:1514] Processing DeleteTablet for tablet c1c64916fd9745d9a07186cfea88a997 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:46:39 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:55036
I20260808 15:46:39.412717 10617 tablet_service.cc:1514] Processing DeleteTablet for tablet c1c64916fd9745d9a07186cfea88a997 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:46:39 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:43576
I20260808 15:46:39.413085 10798 tablet_replica.cc:330] T c1c64916fd9745d9a07186cfea88a997 P 0134846235ac413eaa6321a7491648c2: stopping tablet replica
I20260808 15:46:39.413107 10797 tablet_replica.cc:330] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5: stopping tablet replica
I20260808 15:46:39.413213 10797 raft_consensus.cc:2229] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:46:39.413213 10798 raft_consensus.cc:2229] T c1c64916fd9745d9a07186cfea88a997 P 0134846235ac413eaa6321a7491648c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:46:39.413312 10798 raft_consensus.cc:2258] T c1c64916fd9745d9a07186cfea88a997 P 0134846235ac413eaa6321a7491648c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:46:39.413398 10797 raft_consensus.cc:2258] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:46:39.413993 10798 ts_tablet_manager.cc:1905] T c1c64916fd9745d9a07186cfea88a997 P 0134846235ac413eaa6321a7491648c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:46:39.414211 10797 ts_tablet_manager.cc:1905] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:46:39.416780 10795 tablet_replica.cc:330] T c1c64916fd9745d9a07186cfea88a997 P 5436a2a7d2064e00838827014761f80e: stopping tablet replica
I20260808 15:46:39.416889 10798 ts_tablet_manager.cc:1918] T c1c64916fd9745d9a07186cfea88a997 P 0134846235ac413eaa6321a7491648c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 15:46:39.416944 10795 raft_consensus.cc:2229] T c1c64916fd9745d9a07186cfea88a997 P 5436a2a7d2064e00838827014761f80e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:46:39.416945 10797 ts_tablet_manager.cc:1918] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 15:46:39.416982 10798 log.cc:1196] T c1c64916fd9745d9a07186cfea88a997 P 0134846235ac413eaa6321a7491648c2: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-0/wal/wals/c1c64916fd9745d9a07186cfea88a997
I20260808 15:46:39.417028 10797 log.cc:1196] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/c1c64916fd9745d9a07186cfea88a997
I20260808 15:46:39.417092 10795 raft_consensus.cc:2258] T c1c64916fd9745d9a07186cfea88a997 P 5436a2a7d2064e00838827014761f80e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:46:39.417279 10798 ts_tablet_manager.cc:1939] T c1c64916fd9745d9a07186cfea88a997 P 0134846235ac413eaa6321a7491648c2: Deleting consensus metadata
I20260808 15:46:39.417354 10797 ts_tablet_manager.cc:1939] T c1c64916fd9745d9a07186cfea88a997 P 5f434d1fa4d3494e8cf133768a558af5: Deleting consensus metadata
I20260808 15:46:39.418058 10160 catalog_manager.cc:4841] TS 0134846235ac413eaa6321a7491648c2 (127.8.39.65:43167): tablet c1c64916fd9745d9a07186cfea88a997 (table test-table [id=fbb8611f35bf4f9e99893567cd8a9eca]) successfully deleted
I20260808 15:46:39.418128 10159 catalog_manager.cc:4841] TS 5f434d1fa4d3494e8cf133768a558af5 (127.8.39.67:45997): tablet c1c64916fd9745d9a07186cfea88a997 (table test-table [id=fbb8611f35bf4f9e99893567cd8a9eca]) successfully deleted
I20260808 15:46:39.420503 10795 ts_tablet_manager.cc:1905] T c1c64916fd9745d9a07186cfea88a997 P 5436a2a7d2064e00838827014761f80e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:46:39.423498 10795 ts_tablet_manager.cc:1918] T c1c64916fd9745d9a07186cfea88a997 P 5436a2a7d2064e00838827014761f80e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 15:46:39.423592 10795 log.cc:1196] T c1c64916fd9745d9a07186cfea88a997 P 5436a2a7d2064e00838827014761f80e: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-1/wal/wals/c1c64916fd9745d9a07186cfea88a997
I20260808 15:46:39.423890 10795 ts_tablet_manager.cc:1939] T c1c64916fd9745d9a07186cfea88a997 P 5436a2a7d2064e00838827014761f80e: Deleting consensus metadata
I20260808 15:46:39.424782 10161 catalog_manager.cc:4841] TS 5436a2a7d2064e00838827014761f80e (127.8.39.66:38029): tablet c1c64916fd9745d9a07186cfea88a997 (table test-table [id=fbb8611f35bf4f9e99893567cd8a9eca]) successfully deleted
Aug 08 15:46:39 dist-test-slave-8tdl krb5kdc[10128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203999, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 15:46:39 dist-test-slave-8tdl krb5kdc[10128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786203999, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:39.448124 10806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:39.434626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52288 (local address 127.8.39.126:33945)
0808 15:46:39.435012 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:39.435019 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:39.435037 (+ 18us) server_negotiation.cc:407] Connection header received
0808 15:46:39.435149 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:39.435152 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:39.435199 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:39.435287 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:39.436143 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:39.436711 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:39.437650 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:39.437886 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:39.437974 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:39.444818 (+ 6844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:39.444822 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:39.444824 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:39.444859 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:39.446327 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:39.446799 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:39.446802 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:39.446803 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:39.446883 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:39.447168 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:39.447170 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:39.447171 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:39.447366 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:39.447468 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:39.447740 (+ 272us) server_negotiation.cc:299] Negotiation successful
0808 15:46:39.447897 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":159,"threads_started":1}
I20260808 15:46:39.450894 10176 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52288:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:46:39.451391 10176 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:46:39.456250 10321 tablet_service.cc:1467] Processing CreateTablet for tablet c80f648b63f841d7bb154fb11b1c8371 (DEFAULT_TABLE table=test-table [id=e314816ad87d4765913ab3fdd3f9cf71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:39.456353 10468 tablet_service.cc:1467] Processing CreateTablet for tablet c80f648b63f841d7bb154fb11b1c8371 (DEFAULT_TABLE table=test-table [id=e314816ad87d4765913ab3fdd3f9cf71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:39.456398 10617 tablet_service.cc:1467] Processing CreateTablet for tablet c80f648b63f841d7bb154fb11b1c8371 (DEFAULT_TABLE table=test-table [id=e314816ad87d4765913ab3fdd3f9cf71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:39.456579 10321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c80f648b63f841d7bb154fb11b1c8371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:39.456652 10617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c80f648b63f841d7bb154fb11b1c8371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:39.456655 10468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c80f648b63f841d7bb154fb11b1c8371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:39.459074 10807 tablet_bootstrap.cc:492] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e: Bootstrap starting.
I20260808 15:46:39.459370 10809 tablet_bootstrap.cc:492] T c80f648b63f841d7bb154fb11b1c8371 P 5f434d1fa4d3494e8cf133768a558af5: Bootstrap starting.
I20260808 15:46:39.459640 10808 tablet_bootstrap.cc:492] T c80f648b63f841d7bb154fb11b1c8371 P 0134846235ac413eaa6321a7491648c2: Bootstrap starting.
I20260808 15:46:39.460042 10807 tablet_bootstrap.cc:654] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:39.460232 10809 tablet_bootstrap.cc:654] T c80f648b63f841d7bb154fb11b1c8371 P 5f434d1fa4d3494e8cf133768a558af5: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:39.460541 10808 tablet_bootstrap.cc:654] T c80f648b63f841d7bb154fb11b1c8371 P 0134846235ac413eaa6321a7491648c2: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:39.461266 10807 tablet_bootstrap.cc:492] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e: No bootstrap required, opened a new log
I20260808 15:46:39.461380 10807 ts_tablet_manager.cc:1397] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 15:46:39.461884 10808 tablet_bootstrap.cc:492] T c80f648b63f841d7bb154fb11b1c8371 P 0134846235ac413eaa6321a7491648c2: No bootstrap required, opened a new log
I20260808 15:46:39.461896 10807 raft_consensus.cc:348] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:39.461973 10808 ts_tablet_manager.cc:1397] T c80f648b63f841d7bb154fb11b1c8371 P 0134846235ac413eaa6321a7491648c2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 15:46:39.462010 10807 raft_consensus.cc:374] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:39.462066 10807 raft_consensus.cc:729] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5436a2a7d2064e00838827014761f80e, State: Initialized, Role: FOLLOWER
I20260808 15:46:39.462122 10809 tablet_bootstrap.cc:492] T c80f648b63f841d7bb154fb11b1c8371 P 5f434d1fa4d3494e8cf133768a558af5: No bootstrap required, opened a new log
I20260808 15:46:39.462195 10809 ts_tablet_manager.cc:1397] T c80f648b63f841d7bb154fb11b1c8371 P 5f434d1fa4d3494e8cf133768a558af5: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 15:46:39.462196 10807 consensus_queue.cc:260] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:39.462445 10808 raft_consensus.cc:348] T c80f648b63f841d7bb154fb11b1c8371 P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:39.462569 10807 ts_tablet_manager.cc:1428] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:46:39.462589 10808 raft_consensus.cc:374] T c80f648b63f841d7bb154fb11b1c8371 P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:39.462627 10808 raft_consensus.cc:729] T c80f648b63f841d7bb154fb11b1c8371 P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0134846235ac413eaa6321a7491648c2, State: Initialized, Role: FOLLOWER
I20260808 15:46:39.462659 10809 raft_consensus.cc:348] T c80f648b63f841d7bb154fb11b1c8371 P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:39.462817 10809 raft_consensus.cc:374] T c80f648b63f841d7bb154fb11b1c8371 P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:39.462862 10809 raft_consensus.cc:729] T c80f648b63f841d7bb154fb11b1c8371 P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f434d1fa4d3494e8cf133768a558af5, State: Initialized, Role: FOLLOWER
I20260808 15:46:39.462802 10808 consensus_queue.cc:260] T c80f648b63f841d7bb154fb11b1c8371 P 0134846235ac413eaa6321a7491648c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:39.462980 10809 consensus_queue.cc:260] T c80f648b63f841d7bb154fb11b1c8371 P 5f434d1fa4d3494e8cf133768a558af5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:39.463147 10808 ts_tablet_manager.cc:1428] T c80f648b63f841d7bb154fb11b1c8371 P 0134846235ac413eaa6321a7491648c2: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260808 15:46:39.463246 10809 ts_tablet_manager.cc:1428] T c80f648b63f841d7bb154fb11b1c8371 P 5f434d1fa4d3494e8cf133768a558af5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 15:46:39.573568 10813 raft_consensus.cc:482] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:46:39.573712 10813 raft_consensus.cc:504] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:39.574952 10813 leader_election.cc:288] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0134846235ac413eaa6321a7491648c2 (127.8.39.65:43167), 5f434d1fa4d3494e8cf133768a558af5 (127.8.39.67:45997)
I20260808 15:46:39.580000 10815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:39.575231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:43167 (local address 127.8.39.66:50101)
0808 15:46:39.575771 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:39.575788 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:39.575968 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:39.576255 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:39.576258 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:39.576282 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:46:39.576524 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:39.576531 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:39.577714 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:39.577716 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:39.578707 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:39.578722 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:39.579586 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:39.579589 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:39.579668 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:39.579689 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 15:46:39.579753 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 15:46:39.579812 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"mutex_wait_us":77,"spinlock_wait_cycles":9216,"thread_start_us":133,"threads_started":1}
I20260808 15:46:39.580049 10816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:39.575364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:50101 (local address 127.8.39.65:43167)
0808 15:46:39.575668 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:39.575678 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:39.575978 (+ 300us) server_negotiation.cc:407] Connection header received
0808 15:46:39.576074 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:39.576077 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:39.576132 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:39.576228 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:46:39.576661 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:39.577545 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:39.578847 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:39.579463 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:39.579560 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:39.579615 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:39.579802 (+ 187us) server_negotiation.cc:299] Negotiation successful
0808 15:46:39.579902 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":99,"threads_started":1}
I20260808 15:46:39.580246 10817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:39.575441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:39049 (local address 127.8.39.67:45997)
0808 15:46:39.575709 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:39.575725 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:39.575977 (+ 252us) server_negotiation.cc:407] Connection header received
0808 15:46:39.576074 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:39.576077 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:39.576132 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:39.576228 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:46:39.576708 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:39.577545 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:39.578786 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:39.579423 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:39.579545 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:39.579615 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:39.579977 (+ 362us) server_negotiation.cc:299] Negotiation successful
0808 15:46:39.580083 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":101,"threads_started":1}
I20260808 15:46:39.580266 10814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:39.575304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:45997 (local address 127.8.39.66:39049)
0808 15:46:39.575812 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:39.575826 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:39.575968 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:39.576255 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:39.576258 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:39.576282 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:46:39.576524 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:39.576531 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:39.577708 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:39.577710 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:39.578621 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:39.578633 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:39.579687 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:39.579690 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:39.579802 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:39.579836 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 15:46:39.579913 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 15:46:39.579982 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"mutex_wait_us":74,"spinlock_wait_cycles":24448,"thread_start_us":126,"threads_started":1}
I20260808 15:46:39.580868 10341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c80f648b63f841d7bb154fb11b1c8371" candidate_uuid: "5436a2a7d2064e00838827014761f80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0134846235ac413eaa6321a7491648c2" is_pre_election: true
I20260808 15:46:39.580916 10636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c80f648b63f841d7bb154fb11b1c8371" candidate_uuid: "5436a2a7d2064e00838827014761f80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f434d1fa4d3494e8cf133768a558af5" is_pre_election: true
I20260808 15:46:39.581035 10341 raft_consensus.cc:2454] T c80f648b63f841d7bb154fb11b1c8371 P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5436a2a7d2064e00838827014761f80e in term 0.
I20260808 15:46:39.581081 10636 raft_consensus.cc:2454] T c80f648b63f841d7bb154fb11b1c8371 P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5436a2a7d2064e00838827014761f80e in term 0.
I20260808 15:46:39.581423 10418 leader_election.cc:302] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0134846235ac413eaa6321a7491648c2, 5436a2a7d2064e00838827014761f80e; no voters:
I20260808 15:46:39.581696 10813 raft_consensus.cc:2781] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:46:39.581764 10813 raft_consensus.cc:482] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:46:39.581804 10813 raft_consensus.cc:3037] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:39.582919 10813 raft_consensus.cc:504] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:39.583249 10813 leader_election.cc:288] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e [CANDIDATE]: Term 1 election: Requested vote from peers 0134846235ac413eaa6321a7491648c2 (127.8.39.65:43167), 5f434d1fa4d3494e8cf133768a558af5 (127.8.39.67:45997)
I20260808 15:46:39.583597 10636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c80f648b63f841d7bb154fb11b1c8371" candidate_uuid: "5436a2a7d2064e00838827014761f80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f434d1fa4d3494e8cf133768a558af5"
I20260808 15:46:39.583638 10341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c80f648b63f841d7bb154fb11b1c8371" candidate_uuid: "5436a2a7d2064e00838827014761f80e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0134846235ac413eaa6321a7491648c2"
I20260808 15:46:39.583736 10636 raft_consensus.cc:3037] T c80f648b63f841d7bb154fb11b1c8371 P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:39.583765 10341 raft_consensus.cc:3037] T c80f648b63f841d7bb154fb11b1c8371 P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:39.584643 10636 raft_consensus.cc:2454] T c80f648b63f841d7bb154fb11b1c8371 P 5f434d1fa4d3494e8cf133768a558af5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5436a2a7d2064e00838827014761f80e in term 1.
I20260808 15:46:39.584728 10341 raft_consensus.cc:2454] T c80f648b63f841d7bb154fb11b1c8371 P 0134846235ac413eaa6321a7491648c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5436a2a7d2064e00838827014761f80e in term 1.
I20260808 15:46:39.584941 10417 leader_election.cc:302] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5436a2a7d2064e00838827014761f80e, 5f434d1fa4d3494e8cf133768a558af5; no voters:
I20260808 15:46:39.585098 10813 raft_consensus.cc:2781] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:39.585321 10813 raft_consensus.cc:686] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e [term 1 LEADER]: Becoming Leader. State: Replica: 5436a2a7d2064e00838827014761f80e, State: Running, Role: LEADER
I20260808 15:46:39.585583 10813 consensus_queue.cc:237] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:39.587982 10169 catalog_manager.cc:5495] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5436a2a7d2064e00838827014761f80e (127.8.39.66). New cstate: current_term: 1 leader_uuid: "5436a2a7d2064e00838827014761f80e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } health_report { overall_health: UNKNOWN } } }
I20260808 15:46:39.622494 10821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:39.618642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50730 (local address 127.8.39.66:38029)
0808 15:46:39.618940 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:39.618947 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:39.618959 (+ 12us) server_negotiation.cc:407] Connection header received
0808 15:46:39.619052 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:39.619054 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:39.619145 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:39.619279 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:46:39.619517 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:39.620047 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:39.620861 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:39.621165 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:39.621243 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:39.621496 (+ 253us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:46:39.622021 (+ 525us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:46:39.622168 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:39.622277 (+ 109us) server_negotiation.cc:299] Negotiation successful
0808 15:46:39.622329 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":149,"threads_started":1}
I20260808 15:46:39.632695 10816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:39.629276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:55383 (local address 127.8.39.65:43167)
0808 15:46:39.629442 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:39.629449 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:39.629579 (+ 130us) server_negotiation.cc:407] Connection header received
0808 15:46:39.629750 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:39.629753 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:39.629808 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:39.629904 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:46:39.630153 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:39.630661 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:39.631569 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:39.631790 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:39.631919 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:39.632245 (+ 326us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:46:39.632316 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:46:39.632402 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:39.632492 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 15:46:39.632540 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 15:46:39.632709 10825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:39.629099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:43167 (local address 127.8.39.66:55383)
0808 15:46:39.629485 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:39.629503 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:39.629626 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:39.629912 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:39.629915 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:39.629923 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 15:46:39.630043 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:39.630048 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:39.630798 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:39.630803 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:39.631448 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:39.631457 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:39.631941 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:39.631945 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:39.632035 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:39.632073 (+ 38us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 15:46:39.632408 (+ 335us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 15:46:39.632417 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 15:46:39.632481 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 15:46:39.632557 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":119,"threads_started":1}
I20260808 15:46:39.638429 10636 raft_consensus.cc:1261] T c80f648b63f841d7bb154fb11b1c8371 P 5f434d1fa4d3494e8cf133768a558af5 [term 1 FOLLOWER]: Refusing update from remote peer 5436a2a7d2064e00838827014761f80e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:46:39.638592 10341 raft_consensus.cc:1261] T c80f648b63f841d7bb154fb11b1c8371 P 0134846235ac413eaa6321a7491648c2 [term 1 FOLLOWER]: Refusing update from remote peer 5436a2a7d2064e00838827014761f80e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:46:39.638919 10818 consensus_queue.cc:1035] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:46:39.639113 10813 consensus_queue.cc:1035] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:46:39.656569 10830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:39.652972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:38029 (local address 127.8.39.65:49905)
0808 15:46:39.653261 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:39.653276 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:39.653388 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:39.653596 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:39.653598 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:39.653604 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 15:46:39.653688 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:39.653692 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:39.654363 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:39.654365 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:39.655165 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:39.655175 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:39.655754 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:39.655758 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:39.655888 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:39.655923 (+ 35us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 15:46:39.656290 (+ 367us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 15:46:39.656298 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 15:46:39.656362 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 15:46:39.656443 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":124,"threads_started":1}
I20260808 15:46:39.656564 10821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:39.653048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:49905 (local address 127.8.39.66:38029)
0808 15:46:39.653164 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:39.653170 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:39.653343 (+ 173us) server_negotiation.cc:407] Connection header received
0808 15:46:39.653480 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:39.653483 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:39.653534 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:39.653593 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:46:39.653772 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:39.654273 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:39.655305 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:39.655639 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:39.655741 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:39.656099 (+ 358us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:46:39.656189 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:46:39.656265 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:39.656371 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 15:46:39.656420 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 15:46:39.678501 10169 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52288:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:46:39.678705 10169 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52288:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:46:39.680902 10169 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf: Sending DeleteTablet for 3 replicas of tablet c80f648b63f841d7bb154fb11b1c8371
I20260808 15:46:39.681572 10468 tablet_service.cc:1514] Processing DeleteTablet for tablet c80f648b63f841d7bb154fb11b1c8371 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:46:39 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:50726
I20260808 15:46:39.681660 10617 tablet_service.cc:1514] Processing DeleteTablet for tablet c80f648b63f841d7bb154fb11b1c8371 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:46:39 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:43576
I20260808 15:46:39.681793 10321 tablet_service.cc:1514] Processing DeleteTablet for tablet c80f648b63f841d7bb154fb11b1c8371 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:46:39 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:55036
I20260808 15:46:39.681871 10795 tablet_replica.cc:330] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e: stopping tablet replica
I20260808 15:46:39.681973 10798 tablet_replica.cc:330] T c80f648b63f841d7bb154fb11b1c8371 P 0134846235ac413eaa6321a7491648c2: stopping tablet replica
I20260808 15:46:39.681983 10795 raft_consensus.cc:2229] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:46:39.682091 10798 raft_consensus.cc:2229] T c80f648b63f841d7bb154fb11b1c8371 P 0134846235ac413eaa6321a7491648c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:46:39.682209 10798 raft_consensus.cc:2258] T c80f648b63f841d7bb154fb11b1c8371 P 0134846235ac413eaa6321a7491648c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:46:39.682277 10795 raft_consensus.cc:2258] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:46:39.682474 10797 tablet_replica.cc:330] T c80f648b63f841d7bb154fb11b1c8371 P 5f434d1fa4d3494e8cf133768a558af5: stopping tablet replica
I20260808 15:46:39.682605 10797 raft_consensus.cc:2229] T c80f648b63f841d7bb154fb11b1c8371 P 5f434d1fa4d3494e8cf133768a558af5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:46:39.682552 10169 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52288:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 15:46:39.682744 10797 raft_consensus.cc:2258] T c80f648b63f841d7bb154fb11b1c8371 P 5f434d1fa4d3494e8cf133768a558af5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 15:46:39.682969 10169 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:46:39.683079 10798 ts_tablet_manager.cc:1905] T c80f648b63f841d7bb154fb11b1c8371 P 0134846235ac413eaa6321a7491648c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:46:39.684000 10797 ts_tablet_manager.cc:1905] T c80f648b63f841d7bb154fb11b1c8371 P 5f434d1fa4d3494e8cf133768a558af5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:46:39.685837 10798 ts_tablet_manager.cc:1918] T c80f648b63f841d7bb154fb11b1c8371 P 0134846235ac413eaa6321a7491648c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:46:39.685913 10798 log.cc:1196] T c80f648b63f841d7bb154fb11b1c8371 P 0134846235ac413eaa6321a7491648c2: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-0/wal/wals/c80f648b63f841d7bb154fb11b1c8371
I20260808 15:46:39.686043 10797 ts_tablet_manager.cc:1918] T c80f648b63f841d7bb154fb11b1c8371 P 5f434d1fa4d3494e8cf133768a558af5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:46:39.686103 10797 log.cc:1196] T c80f648b63f841d7bb154fb11b1c8371 P 5f434d1fa4d3494e8cf133768a558af5: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/c80f648b63f841d7bb154fb11b1c8371
I20260808 15:46:39.686201 10798 ts_tablet_manager.cc:1939] T c80f648b63f841d7bb154fb11b1c8371 P 0134846235ac413eaa6321a7491648c2: Deleting consensus metadata
I20260808 15:46:39.686290 10797 ts_tablet_manager.cc:1939] T c80f648b63f841d7bb154fb11b1c8371 P 5f434d1fa4d3494e8cf133768a558af5: Deleting consensus metadata
I20260808 15:46:39.687040 10160 catalog_manager.cc:4841] TS 0134846235ac413eaa6321a7491648c2 (127.8.39.65:43167): tablet c80f648b63f841d7bb154fb11b1c8371 (table test-table [id=e314816ad87d4765913ab3fdd3f9cf71]) successfully deleted
I20260808 15:46:39.687523 10795 ts_tablet_manager.cc:1905] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:46:39.688699 10159 catalog_manager.cc:4841] TS 5f434d1fa4d3494e8cf133768a558af5 (127.8.39.67:45997): tablet c80f648b63f841d7bb154fb11b1c8371 (table test-table [id=e314816ad87d4765913ab3fdd3f9cf71]) successfully deleted
I20260808 15:46:39.690310 10468 tablet_service.cc:1467] Processing CreateTablet for tablet 10c808ad3cd44096b63f446a41dd8cff (DEFAULT_TABLE table=test-table [id=384863994e4a4fc0a764b889fea9d61b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:39.690310 10321 tablet_service.cc:1467] Processing CreateTablet for tablet 10c808ad3cd44096b63f446a41dd8cff (DEFAULT_TABLE table=test-table [id=384863994e4a4fc0a764b889fea9d61b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:39.690562 10321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10c808ad3cd44096b63f446a41dd8cff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:39.690567 10468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10c808ad3cd44096b63f446a41dd8cff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:39.690932 10617 tablet_service.cc:1467] Processing CreateTablet for tablet 10c808ad3cd44096b63f446a41dd8cff (DEFAULT_TABLE table=test-table [id=384863994e4a4fc0a764b889fea9d61b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:39.691196 10617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10c808ad3cd44096b63f446a41dd8cff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:39.692778 10807 tablet_bootstrap.cc:492] T 10c808ad3cd44096b63f446a41dd8cff P 5436a2a7d2064e00838827014761f80e: Bootstrap starting.
I20260808 15:46:39.692932 10808 tablet_bootstrap.cc:492] T 10c808ad3cd44096b63f446a41dd8cff P 0134846235ac413eaa6321a7491648c2: Bootstrap starting.
I20260808 15:46:39.693754 10808 tablet_bootstrap.cc:654] T 10c808ad3cd44096b63f446a41dd8cff P 0134846235ac413eaa6321a7491648c2: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:39.693754 10807 tablet_bootstrap.cc:654] T 10c808ad3cd44096b63f446a41dd8cff P 5436a2a7d2064e00838827014761f80e: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:39.694355 10809 tablet_bootstrap.cc:492] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5: Bootstrap starting.
I20260808 15:46:39.694470 10795 ts_tablet_manager.cc:1918] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:46:39.694597 10795 log.cc:1196] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-1/wal/wals/c80f648b63f841d7bb154fb11b1c8371
I20260808 15:46:39.694970 10795 ts_tablet_manager.cc:1939] T c80f648b63f841d7bb154fb11b1c8371 P 5436a2a7d2064e00838827014761f80e: Deleting consensus metadata
I20260808 15:46:39.695252 10809 tablet_bootstrap.cc:654] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:39.695982 10161 catalog_manager.cc:4841] TS 5436a2a7d2064e00838827014761f80e (127.8.39.66:38029): tablet c80f648b63f841d7bb154fb11b1c8371 (table test-table [id=e314816ad87d4765913ab3fdd3f9cf71]) successfully deleted
I20260808 15:46:39.696091 10807 tablet_bootstrap.cc:492] T 10c808ad3cd44096b63f446a41dd8cff P 5436a2a7d2064e00838827014761f80e: No bootstrap required, opened a new log
I20260808 15:46:39.696178 10807 ts_tablet_manager.cc:1397] T 10c808ad3cd44096b63f446a41dd8cff P 5436a2a7d2064e00838827014761f80e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 15:46:39.696471 10809 tablet_bootstrap.cc:492] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5: No bootstrap required, opened a new log
I20260808 15:46:39.696580 10809 ts_tablet_manager.cc:1397] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260808 15:46:39.696595 10807 raft_consensus.cc:348] T 10c808ad3cd44096b63f446a41dd8cff P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:39.696712 10807 raft_consensus.cc:374] T 10c808ad3cd44096b63f446a41dd8cff P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:39.696748 10807 raft_consensus.cc:729] T 10c808ad3cd44096b63f446a41dd8cff P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5436a2a7d2064e00838827014761f80e, State: Initialized, Role: FOLLOWER
I20260808 15:46:39.696885 10807 consensus_queue.cc:260] T 10c808ad3cd44096b63f446a41dd8cff P 5436a2a7d2064e00838827014761f80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:39.696967 10809 raft_consensus.cc:348] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:39.697072 10809 raft_consensus.cc:374] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:39.697101 10809 raft_consensus.cc:729] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f434d1fa4d3494e8cf133768a558af5, State: Initialized, Role: FOLLOWER
I20260808 15:46:39.697149 10807 ts_tablet_manager.cc:1428] T 10c808ad3cd44096b63f446a41dd8cff P 5436a2a7d2064e00838827014761f80e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:46:39.697220 10809 consensus_queue.cc:260] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:39.697470 10809 ts_tablet_manager.cc:1428] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260808 15:46:39.698441 10808 tablet_bootstrap.cc:492] T 10c808ad3cd44096b63f446a41dd8cff P 0134846235ac413eaa6321a7491648c2: No bootstrap required, opened a new log
I20260808 15:46:39.698541 10808 ts_tablet_manager.cc:1397] T 10c808ad3cd44096b63f446a41dd8cff P 0134846235ac413eaa6321a7491648c2: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20260808 15:46:39.699193 10808 raft_consensus.cc:348] T 10c808ad3cd44096b63f446a41dd8cff P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:39.699321 10808 raft_consensus.cc:374] T 10c808ad3cd44096b63f446a41dd8cff P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:39.699358 10808 raft_consensus.cc:729] T 10c808ad3cd44096b63f446a41dd8cff P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0134846235ac413eaa6321a7491648c2, State: Initialized, Role: FOLLOWER
I20260808 15:46:39.699494 10808 consensus_queue.cc:260] T 10c808ad3cd44096b63f446a41dd8cff P 0134846235ac413eaa6321a7491648c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:39.699748 10808 ts_tablet_manager.cc:1428] T 10c808ad3cd44096b63f446a41dd8cff P 0134846235ac413eaa6321a7491648c2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:46:39.758242 10784 raft_consensus.cc:482] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:46:39.758410 10784 raft_consensus.cc:504] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:39.758921 10784 leader_election.cc:288] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0134846235ac413eaa6321a7491648c2 (127.8.39.65:43167), 5436a2a7d2064e00838827014761f80e (127.8.39.66:38029)
I20260808 15:46:39.759428 10488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10c808ad3cd44096b63f446a41dd8cff" candidate_uuid: "5f434d1fa4d3494e8cf133768a558af5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5436a2a7d2064e00838827014761f80e" is_pre_election: true
I20260808 15:46:39.759431 10341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10c808ad3cd44096b63f446a41dd8cff" candidate_uuid: "5f434d1fa4d3494e8cf133768a558af5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0134846235ac413eaa6321a7491648c2" is_pre_election: true
I20260808 15:46:39.759631 10341 raft_consensus.cc:2454] T 10c808ad3cd44096b63f446a41dd8cff P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f434d1fa4d3494e8cf133768a558af5 in term 0.
I20260808 15:46:39.759672 10488 raft_consensus.cc:2454] T 10c808ad3cd44096b63f446a41dd8cff P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f434d1fa4d3494e8cf133768a558af5 in term 0.
I20260808 15:46:39.759963 10565 leader_election.cc:302] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0134846235ac413eaa6321a7491648c2, 5f434d1fa4d3494e8cf133768a558af5; no voters:
I20260808 15:46:39.760188 10784 raft_consensus.cc:2781] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:46:39.760264 10784 raft_consensus.cc:482] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:46:39.760306 10784 raft_consensus.cc:3037] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:39.761595 10784 raft_consensus.cc:504] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:39.761960 10784 leader_election.cc:288] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5 [CANDIDATE]: Term 1 election: Requested vote from peers 0134846235ac413eaa6321a7491648c2 (127.8.39.65:43167), 5436a2a7d2064e00838827014761f80e (127.8.39.66:38029)
I20260808 15:46:39.762480 10488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10c808ad3cd44096b63f446a41dd8cff" candidate_uuid: "5f434d1fa4d3494e8cf133768a558af5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5436a2a7d2064e00838827014761f80e"
I20260808 15:46:39.762534 10341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10c808ad3cd44096b63f446a41dd8cff" candidate_uuid: "5f434d1fa4d3494e8cf133768a558af5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0134846235ac413eaa6321a7491648c2"
I20260808 15:46:39.762655 10341 raft_consensus.cc:3037] T 10c808ad3cd44096b63f446a41dd8cff P 0134846235ac413eaa6321a7491648c2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:39.762650 10488 raft_consensus.cc:3037] T 10c808ad3cd44096b63f446a41dd8cff P 5436a2a7d2064e00838827014761f80e [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:39.763703 10488 raft_consensus.cc:2454] T 10c808ad3cd44096b63f446a41dd8cff P 5436a2a7d2064e00838827014761f80e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f434d1fa4d3494e8cf133768a558af5 in term 1.
I20260808 15:46:39.763829 10341 raft_consensus.cc:2454] T 10c808ad3cd44096b63f446a41dd8cff P 0134846235ac413eaa6321a7491648c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f434d1fa4d3494e8cf133768a558af5 in term 1.
I20260808 15:46:39.764040 10566 leader_election.cc:302] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5436a2a7d2064e00838827014761f80e, 5f434d1fa4d3494e8cf133768a558af5; no voters:
I20260808 15:46:39.764222 10784 raft_consensus.cc:2781] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:39.764322 10784 raft_consensus.cc:686] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5 [term 1 LEADER]: Becoming Leader. State: Replica: 5f434d1fa4d3494e8cf133768a558af5, State: Running, Role: LEADER
I20260808 15:46:39.764468 10784 consensus_queue.cc:237] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } }
I20260808 15:46:39.766278 10169 catalog_manager.cc:5495] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f434d1fa4d3494e8cf133768a558af5 (127.8.39.67). New cstate: current_term: 1 leader_uuid: "5f434d1fa4d3494e8cf133768a558af5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f434d1fa4d3494e8cf133768a558af5" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45997 } health_report { overall_health: HEALTHY } } }
I20260808 15:46:39.790318 10817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:39.786631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43590 (local address 127.8.39.67:45997)
0808 15:46:39.786768 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:39.786773 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:39.786817 (+ 44us) server_negotiation.cc:407] Connection header received
0808 15:46:39.786995 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:39.786999 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:39.787056 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:39.787149 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:46:39.787415 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:39.788101 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:39.789176 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:39.789418 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:39.789541 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:39.789825 (+ 284us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:46:39.789906 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:46:39.790004 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:39.790102 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 15:46:39.790163 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 15:46:39.797149 10488 raft_consensus.cc:1261] T 10c808ad3cd44096b63f446a41dd8cff P 5436a2a7d2064e00838827014761f80e [term 1 FOLLOWER]: Refusing update from remote peer 5f434d1fa4d3494e8cf133768a558af5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:46:39.797202 10341 raft_consensus.cc:1261] T 10c808ad3cd44096b63f446a41dd8cff P 0134846235ac413eaa6321a7491648c2 [term 1 FOLLOWER]: Refusing update from remote peer 5f434d1fa4d3494e8cf133768a558af5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:46:39.797500 10784 consensus_queue.cc:1035] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5436a2a7d2064e00838827014761f80e" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:46:39.797734 10759 consensus_queue.cc:1035] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0134846235ac413eaa6321a7491648c2" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 43167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 15:46:39.814329 10776 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 15:46:41.367543 10175 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52288:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:46:41.367760 10175 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52288:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:46:41.370414 10175 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9f8c6fbc6c4d42d49522f068d97daecf: Sending DeleteTablet for 3 replicas of tablet 10c808ad3cd44096b63f446a41dd8cff
I20260808 15:46:41.371071 10321 tablet_service.cc:1514] Processing DeleteTablet for tablet 10c808ad3cd44096b63f446a41dd8cff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:46:41 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:55036
I20260808 15:46:41.371166 10468 tablet_service.cc:1514] Processing DeleteTablet for tablet 10c808ad3cd44096b63f446a41dd8cff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:46:41 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:50726
I20260808 15:46:41.371447 10617 tablet_service.cc:1514] Processing DeleteTablet for tablet 10c808ad3cd44096b63f446a41dd8cff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:46:41 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:43576
I20260808 15:46:41.371953 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 10250
I20260808 15:46:41.371977 10866 tablet_replica.cc:330] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5: stopping tablet replica
I20260808 15:46:41.373394 10866 raft_consensus.cc:2229] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:46:41.373728 10866 raft_consensus.cc:2258] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:46:41.375548 10866 ts_tablet_manager.cc:1905] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:46:41.377761 10866 ts_tablet_manager.cc:1918] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 15:46:41.377861 10866 log.cc:1196] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/10c808ad3cd44096b63f446a41dd8cff
I20260808 15:46:41.378136 10866 ts_tablet_manager.cc:1939] T 10c808ad3cd44096b63f446a41dd8cff P 5f434d1fa4d3494e8cf133768a558af5: Deleting consensus metadata
I20260808 15:46:41.378147 10865 tablet_replica.cc:330] T 10c808ad3cd44096b63f446a41dd8cff P 5436a2a7d2064e00838827014761f80e: stopping tablet replica
I20260808 15:46:41.378327 10865 raft_consensus.cc:2229] T 10c808ad3cd44096b63f446a41dd8cff P 5436a2a7d2064e00838827014761f80e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:46:41.378479 10865 raft_consensus.cc:2258] T 10c808ad3cd44096b63f446a41dd8cff P 5436a2a7d2064e00838827014761f80e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:46:41.378950 10159 catalog_manager.cc:4841] TS 5f434d1fa4d3494e8cf133768a558af5 (127.8.39.67:45997): tablet 10c808ad3cd44096b63f446a41dd8cff (table test-table [id=384863994e4a4fc0a764b889fea9d61b]) successfully deleted
I20260808 15:46:41.379604 10865 ts_tablet_manager.cc:1905] T 10c808ad3cd44096b63f446a41dd8cff P 5436a2a7d2064e00838827014761f80e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:46:41.383373 10865 ts_tablet_manager.cc:1918] T 10c808ad3cd44096b63f446a41dd8cff P 5436a2a7d2064e00838827014761f80e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 15:46:41.383474 10865 log.cc:1196] T 10c808ad3cd44096b63f446a41dd8cff P 5436a2a7d2064e00838827014761f80e: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786203987027663-8349-0/minicluster-data/ts-1/wal/wals/10c808ad3cd44096b63f446a41dd8cff
I20260808 15:46:41.383792 10865 ts_tablet_manager.cc:1939] T 10c808ad3cd44096b63f446a41dd8cff P 5436a2a7d2064e00838827014761f80e: Deleting consensus metadata
I20260808 15:46:41.384536 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 10397
W20260808 15:46:41.384641 10160 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.39.65:43167 (error 108)
I20260808 15:46:41.386607 10868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:41.386027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:43167 (local address 127.0.0.1:55060)
0808 15:46:41.386353 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:41.386459 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.65:43167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":101,"threads_started":1}
W20260808 15:46:41.386922 10160 catalog_manager.cc:4584] TS 0134846235ac413eaa6321a7491648c2 (127.8.39.65:43167): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 10c808ad3cd44096b63f446a41dd8cff: Network error: Client connection negotiation failed: client connection to 127.8.39.65:43167: connect: Connection refused (error 111)
I20260808 15:46:41.394042 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 10547
I20260808 15:46:41.395594 10868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:41.393883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:38029 (local address 127.0.0.1:50744)
0808 15:46:41.394023 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:41.394082 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.66:38029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260808 15:46:41.402967 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 10141
2026-08-08T15:46:41Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6406 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:46:41 dist-test-slave-8tdl krb5kdc[10872](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:46:41 dist-test-slave-8tdl krb5kdc[10872](info): set up 2 sockets
Aug 08 15:46:41 dist-test-slave-8tdl krb5kdc[10872](info): commencing operation
krb5kdc: starting...
W20260808 15:46:42.524945 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.097s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:46:42 dist-test-slave-8tdl krb5kdc[10872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:46:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:46:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:46:42.660089 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:43009
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:37209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:43009
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:42.772814 10887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:42.773147 10887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:42.773232 10887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:42.777354 10887 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:46:42.777453 10887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:42.777488 10887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:42.777530 10887 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:46:42.777563 10887 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:46:42.783079 10887 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:37209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:43009
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:43009
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10887
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:42.784279 10887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:42.785408 10887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:42.794732 10896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:42.794795 10892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:42.794821 10893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:42.794905 10887 server_base.cc:1034] running on GCE node
I20260808 15:46:42.795837 10887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:42.797035 10887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:42.798235 10887 hybrid_clock.cc:648] HybridClock initialized: now 1786204002798222 us; error 37 us; skew 500 ppm
Aug 08 15:46:42 dist-test-slave-8tdl krb5kdc[10872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204002, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:42.801155 10887 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:46:42.802119 10887 webserver.cc:460] Webserver started at http://127.8.39.126:33677/ using document root <none> and password file <none>
I20260808 15:46:42.802654 10887 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:42.802773 10887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:42.802958 10887 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:42.805003 10887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "c92e6034f3b5483aa9152e2f92aa280a"
format_stamp: "Formatted at 2026-08-08 15:46:42 on dist-test-slave-8tdl"
server_key: "6143abe88364a7af9887737fe4c5e17b"
server_key_iv: "9813c5e6d0ce2a300f2e8e3ee68c3fac"
server_key_version: "encryptionkey@0"
I20260808 15:46:42.805518 10887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "c92e6034f3b5483aa9152e2f92aa280a"
format_stamp: "Formatted at 2026-08-08 15:46:42 on dist-test-slave-8tdl"
server_key: "6143abe88364a7af9887737fe4c5e17b"
server_key_iv: "9813c5e6d0ce2a300f2e8e3ee68c3fac"
server_key_version: "encryptionkey@0"
I20260808 15:46:42.809321 10887 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 15:46:42.811785 10903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:42.813066 10887 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:46:42.813169 10887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "c92e6034f3b5483aa9152e2f92aa280a"
format_stamp: "Formatted at 2026-08-08 15:46:42 on dist-test-slave-8tdl"
server_key: "6143abe88364a7af9887737fe4c5e17b"
server_key_iv: "9813c5e6d0ce2a300f2e8e3ee68c3fac"
server_key_version: "encryptionkey@0"
I20260808 15:46:42.813258 10887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:42.831100 10887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:42.834177 10887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:42.834340 10887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:42.841807 10887 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:43009
I20260808 15:46:42.841835 10959 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:43009 every 8 connection(s)
I20260808 15:46:42.842835 10887 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:46:42.845662 10960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:42.847330 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 10887
I20260808 15:46:42.847424 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:46:42.847687 8349 external_mini_cluster.cc:1428] Setting key 4b6981c2a94e8d85b2ad5955ceefcb51
I20260808 15:46:42.852414 10960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c92e6034f3b5483aa9152e2f92aa280a: Bootstrap starting.
I20260808 15:46:42.855191 10960 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c92e6034f3b5483aa9152e2f92aa280a: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:42.856204 10960 log.cc:824] T 00000000000000000000000000000000 P c92e6034f3b5483aa9152e2f92aa280a: Log is configured to *not* fsync() on all Append() calls
Aug 08 15:46:42 dist-test-slave-8tdl krb5kdc[10872](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:42.858850 10960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c92e6034f3b5483aa9152e2f92aa280a: No bootstrap required, opened a new log
I20260808 15:46:42.863302 10963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:42.849261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51402 (local address 127.8.39.126:43009)
0808 15:46:42.849674 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:42.849690 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:42.849725 (+ 35us) server_negotiation.cc:407] Connection header received
0808 15:46:42.850399 (+ 674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:42.850417 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:42.850768 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:42.851044 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:42.852013 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:42.853023 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:42.854205 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:42.854721 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:42.854881 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:42.857979 (+ 3098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:42.857994 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:42.858010 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:42.858041 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:42.860059 (+ 2018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:42.860509 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:42.860515 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:42.860521 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:42.860663 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:42.860918 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:42.860922 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:42.860924 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:42.861545 (+ 621us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:42.861741 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:42.861945 (+ 204us) server_negotiation.cc:299] Negotiation successful
0808 15:46:42.862260 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":138,"threads_started":1}
I20260808 15:46:42.863737 10960 raft_consensus.cc:348] T 00000000000000000000000000000000 P c92e6034f3b5483aa9152e2f92aa280a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c92e6034f3b5483aa9152e2f92aa280a" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43009 } }
I20260808 15:46:42.864005 10960 raft_consensus.cc:374] T 00000000000000000000000000000000 P c92e6034f3b5483aa9152e2f92aa280a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:42.864069 10960 raft_consensus.cc:729] T 00000000000000000000000000000000 P c92e6034f3b5483aa9152e2f92aa280a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c92e6034f3b5483aa9152e2f92aa280a, State: Initialized, Role: FOLLOWER
I20260808 15:46:42.864527 10960 consensus_queue.cc:260] T 00000000000000000000000000000000 P c92e6034f3b5483aa9152e2f92aa280a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c92e6034f3b5483aa9152e2f92aa280a" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43009 } }
I20260808 15:46:42.864655 10960 raft_consensus.cc:388] T 00000000000000000000000000000000 P c92e6034f3b5483aa9152e2f92aa280a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:46:42.864737 10960 raft_consensus.cc:482] T 00000000000000000000000000000000 P c92e6034f3b5483aa9152e2f92aa280a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:46:42.864826 10960 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c92e6034f3b5483aa9152e2f92aa280a [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:42.865988 10960 raft_consensus.cc:504] T 00000000000000000000000000000000 P c92e6034f3b5483aa9152e2f92aa280a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c92e6034f3b5483aa9152e2f92aa280a" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43009 } }
I20260808 15:46:42.866325 10960 leader_election.cc:302] T 00000000000000000000000000000000 P c92e6034f3b5483aa9152e2f92aa280a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c92e6034f3b5483aa9152e2f92aa280a; no voters:
I20260808 15:46:42.866650 10960 leader_election.cc:288] T 00000000000000000000000000000000 P c92e6034f3b5483aa9152e2f92aa280a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:46:42.866842 10965 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c92e6034f3b5483aa9152e2f92aa280a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:42.867079 10965 raft_consensus.cc:686] T 00000000000000000000000000000000 P c92e6034f3b5483aa9152e2f92aa280a [term 1 LEADER]: Becoming Leader. State: Replica: c92e6034f3b5483aa9152e2f92aa280a, State: Running, Role: LEADER
I20260808 15:46:42.867381 10965 consensus_queue.cc:237] T 00000000000000000000000000000000 P c92e6034f3b5483aa9152e2f92aa280a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c92e6034f3b5483aa9152e2f92aa280a" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43009 } }
I20260808 15:46:42.867888 10960 sys_catalog.cc:564] T 00000000000000000000000000000000 P c92e6034f3b5483aa9152e2f92aa280a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:46:42.869124 10966 sys_catalog.cc:455] T 00000000000000000000000000000000 P c92e6034f3b5483aa9152e2f92aa280a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c92e6034f3b5483aa9152e2f92aa280a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c92e6034f3b5483aa9152e2f92aa280a" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43009 } } }
I20260808 15:46:42.869271 10966 sys_catalog.cc:458] T 00000000000000000000000000000000 P c92e6034f3b5483aa9152e2f92aa280a [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:42.869571 10967 sys_catalog.cc:455] T 00000000000000000000000000000000 P c92e6034f3b5483aa9152e2f92aa280a [sys.catalog]: SysCatalogTable state changed. Reason: New leader c92e6034f3b5483aa9152e2f92aa280a. Latest consensus state: current_term: 1 leader_uuid: "c92e6034f3b5483aa9152e2f92aa280a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c92e6034f3b5483aa9152e2f92aa280a" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43009 } } }
I20260808 15:46:42.869663 10967 sys_catalog.cc:458] T 00000000000000000000000000000000 P c92e6034f3b5483aa9152e2f92aa280a [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:42.869753 10974 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:46:42.872768 10974 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:46:42.878504 10974 catalog_manager.cc:1347] Generated new cluster ID: 798087a09fe34c3499e22365529fdbfd
I20260808 15:46:42.878580 10974 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:46:42.907557 10974 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:46:42.908968 10974 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:46:42.922438 10974 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c92e6034f3b5483aa9152e2f92aa280a: Generated new TSK 0
I20260808 15:46:42.923300 10974 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.39.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
I20260808 15:46:42.961678 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:0
--local_ip_for_outbound_sockets=127.8.39.65
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:43009
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:37209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:43.092124 10989 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:43.092383 10989 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:43.092427 10989 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:43.096405 10989 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:43.096465 10989 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:43.096524 10989 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:46:43.101806 10989 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:37209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:43009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10989
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:43.102885 10989 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:43.103857 10989 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:43.113252 10995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:43.113320 10997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:43.113320 10994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:43.113605 10989 server_base.cc:1034] running on GCE node
I20260808 15:46:43.113999 10989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:43.114629 10989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:43.115849 10989 hybrid_clock.cc:648] HybridClock initialized: now 1786204003115831 us; error 37 us; skew 500 ppm
Aug 08 15:46:43 dist-test-slave-8tdl krb5kdc[10872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204003, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:43.118927 10989 init.cc:377] Logged in from keytab as kudu/127.8.39.65@KRBTEST.COM (short username kudu)
I20260808 15:46:43.119773 10989 webserver.cc:460] Webserver started at http://127.8.39.65:45145/ using document root <none> and password file <none>
I20260808 15:46:43.120321 10989 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:43.120381 10989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:43.120592 10989 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:43.122664 10989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/data/instance:
uuid: "2d0380a5d59e4131b6e50935d63d63c2"
format_stamp: "Formatted at 2026-08-08 15:46:43 on dist-test-slave-8tdl"
server_key: "4e76204194a8329405663a51f5986e23"
server_key_iv: "057b9fef62b2a0f5ec529269bef67a71"
server_key_version: "encryptionkey@0"
I20260808 15:46:43.123298 10989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance:
uuid: "2d0380a5d59e4131b6e50935d63d63c2"
format_stamp: "Formatted at 2026-08-08 15:46:43 on dist-test-slave-8tdl"
server_key: "4e76204194a8329405663a51f5986e23"
server_key_iv: "057b9fef62b2a0f5ec529269bef67a71"
server_key_version: "encryptionkey@0"
I20260808 15:46:43.127104 10989 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 15:46:43.129576 11005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:43.130879 10989 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:46:43.131021 10989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "2d0380a5d59e4131b6e50935d63d63c2"
format_stamp: "Formatted at 2026-08-08 15:46:43 on dist-test-slave-8tdl"
server_key: "4e76204194a8329405663a51f5986e23"
server_key_iv: "057b9fef62b2a0f5ec529269bef67a71"
server_key_version: "encryptionkey@0"
I20260808 15:46:43.131135 10989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:43.147543 10989 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:43.150785 10989 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:43.150981 10989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:43.151582 10989 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:46:43.152417 10989 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:43.152467 10989 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:43.152531 10989 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:43.152562 10989 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:43.161536 10989 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:33439
I20260808 15:46:43.161576 11126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:33439 every 8 connection(s)
I20260808 15:46:43.162441 10989 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:46:43.170061 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 10989
I20260808 15:46:43.170197 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance
I20260808 15:46:43.170518 8349 external_mini_cluster.cc:1428] Setting key 645c0a6bbe8218be2f4c107bdfb24409
Aug 08 15:46:43 dist-test-slave-8tdl krb5kdc[10872](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204003, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:43.177590 10963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:43.164274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:40157 (local address 127.8.39.126:43009)
0808 15:46:43.164426 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:43.164431 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:43.165228 (+ 797us) server_negotiation.cc:407] Connection header received
0808 15:46:43.166514 (+ 1286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:43.166518 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:43.166578 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:43.166658 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:43.167825 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:43.168393 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:43.169621 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:43.169986 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:43.170111 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:43.173146 (+ 3035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:43.173153 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:43.173159 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:43.173193 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:43.175158 (+ 1965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:43.175734 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:43.175738 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:43.175740 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:43.175832 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:43.176274 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:43.176277 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:43.176278 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:43.176474 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:43.176581 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:43.177251 (+ 670us) server_negotiation.cc:299] Negotiation successful
0808 15:46:43.177365 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 15:46:43.178864 11129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:43.164631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43009 (local address 127.8.39.65:40157)
0808 15:46:43.165073 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:43.165117 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:43.166295 (+ 1178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:43.166839 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:43.166846 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:43.167195 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:43.167668 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:43.167681 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:43.168555 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:43.168557 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:43.169487 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:43.169497 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:43.170242 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:43.170247 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:43.170431 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:43.171196 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:43.171220 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:43.172951 (+ 1731us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:43.175293 (+ 2342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:43.175300 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:43.175317 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:43.175618 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:43.175937 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:43.175944 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:43.175949 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:43.176156 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:43.176623 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:43.176633 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:43.176991 (+ 358us) client_negotiation.cc:769] Sending connection context
0808 15:46:43.177216 (+ 225us) client_negotiation.cc:240] Negotiation successful
0808 15:46:43.177661 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":111,"threads_started":1}
I20260808 15:46:43.180833 11127 heartbeater.cc:347] Connected to a master server at 127.8.39.126:43009
I20260808 15:46:43.181160 11127 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:43.181845 11127 heartbeater.cc:511] Master 127.8.39.126:43009 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.8.39.66@KRBTEST.COM; defaulting to no policy
I20260808 15:46:43.183650 10921 ts_manager.cc:194] Registered new tserver with Master: 2d0380a5d59e4131b6e50935d63d63c2 (127.8.39.65:33439)
I20260808 15:46:43.184841 10921 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.65@KRBTEST.COM'} at 127.8.39.65:40157
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
I20260808 15:46:43.202021 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:0
--local_ip_for_outbound_sockets=127.8.39.66
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:43009
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:37209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:43.316110 11132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:43.316417 11132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:43.316502 11132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:43.320767 11132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:43.320851 11132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:43.320935 11132 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:46:43.326467 11132 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:37209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:43009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11132
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:43.327682 11132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:43.328794 11132 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:43.338697 11137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:43.338765 11132 server_base.cc:1034] running on GCE node
W20260808 15:46:43.338778 11138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:43.338707 11140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:43.339350 11132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:43.339927 11132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:43.341102 11132 hybrid_clock.cc:648] HybridClock initialized: now 1786204003341068 us; error 46 us; skew 500 ppm
Aug 08 15:46:43 dist-test-slave-8tdl krb5kdc[10872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204003, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:43.344074 11132 init.cc:377] Logged in from keytab as kudu/127.8.39.66@KRBTEST.COM (short username kudu)
I20260808 15:46:43.344925 11132 webserver.cc:460] Webserver started at http://127.8.39.66:45019/ using document root <none> and password file <none>
I20260808 15:46:43.345497 11132 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:43.345589 11132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:43.345819 11132 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:43.347955 11132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/data/instance:
uuid: "4b9254dc4d5b499f888b242cfcb09194"
format_stamp: "Formatted at 2026-08-08 15:46:43 on dist-test-slave-8tdl"
server_key: "fc5ccfa4515f504dbefb71673d4afdb4"
server_key_iv: "0e1b50e71e1918b9a76e1d945462ce29"
server_key_version: "encryptionkey@0"
I20260808 15:46:43.348544 11132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance:
uuid: "4b9254dc4d5b499f888b242cfcb09194"
format_stamp: "Formatted at 2026-08-08 15:46:43 on dist-test-slave-8tdl"
server_key: "fc5ccfa4515f504dbefb71673d4afdb4"
server_key_iv: "0e1b50e71e1918b9a76e1d945462ce29"
server_key_version: "encryptionkey@0"
I20260808 15:46:43.352737 11132 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 15:46:43.355223 11148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:43.356389 11132 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:46:43.356521 11132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "4b9254dc4d5b499f888b242cfcb09194"
format_stamp: "Formatted at 2026-08-08 15:46:43 on dist-test-slave-8tdl"
server_key: "fc5ccfa4515f504dbefb71673d4afdb4"
server_key_iv: "0e1b50e71e1918b9a76e1d945462ce29"
server_key_version: "encryptionkey@0"
I20260808 15:46:43.356629 11132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:43.385223 11132 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:43.388243 11132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:43.388458 11132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:43.389101 11132 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:46:43.389938 11132 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:43.390007 11132 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:43.390079 11132 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:43.390128 11132 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:43.399367 11132 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:37509
I20260808 15:46:43.399406 11267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:37509 every 8 connection(s)
I20260808 15:46:43.400326 11132 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:46:43.409446 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 11132
I20260808 15:46:43.409569 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance
I20260808 15:46:43.409840 8349 external_mini_cluster.cc:1428] Setting key d676e58e7b757a6794d15b4d1760d79e
Aug 08 15:46:43 dist-test-slave-8tdl krb5kdc[10872](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204003, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:43.414952 10963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:43.402186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:56319 (local address 127.8.39.126:43009)
0808 15:46:43.402331 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:43.402335 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:43.403202 (+ 867us) server_negotiation.cc:407] Connection header received
0808 15:46:43.404480 (+ 1278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:43.404484 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:43.404546 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:43.404634 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:43.405799 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:43.406347 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:43.407514 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:43.407748 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:43.407862 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:43.410650 (+ 2788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:43.410659 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:43.410661 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:43.410727 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:43.412480 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:43.413024 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:43.413029 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:43.413034 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:43.413130 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:43.413559 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:43.413565 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:43.413570 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:43.413827 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:43.413917 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:43.414627 (+ 710us) server_negotiation.cc:299] Negotiation successful
0808 15:46:43.414812 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 15:46:43.416141 11270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:43.402525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43009 (local address 127.8.39.66:56319)
0808 15:46:43.403043 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:43.403086 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:43.404261 (+ 1175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:43.404802 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:43.404808 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:43.405163 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:43.405636 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:43.405648 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:43.406492 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:43.406496 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:43.407373 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:43.407382 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:43.407904 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:43.407909 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:43.408075 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:43.408683 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:43.408699 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:43.410454 (+ 1755us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:43.412608 (+ 2154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:43.412613 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:43.412624 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:43.412911 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:43.413254 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:43.413259 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:43.413263 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:43.413461 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:43.413949 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:43.413959 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:43.414301 (+ 342us) client_negotiation.cc:769] Sending connection context
0808 15:46:43.414560 (+ 259us) client_negotiation.cc:240] Negotiation successful
0808 15:46:43.414989 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":181,"threads_started":1}
I20260808 15:46:43.417531 11268 heartbeater.cc:347] Connected to a master server at 127.8.39.126:43009
I20260808 15:46:43.417806 11268 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:43.418416 11268 heartbeater.cc:511] Master 127.8.39.126:43009 requested a full tablet report, sending...
I20260808 15:46:43.419696 10921 ts_manager.cc:194] Registered new tserver with Master: 4b9254dc4d5b499f888b242cfcb09194 (127.8.39.66:37509)
I20260808 15:46:43.420559 10921 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.66@KRBTEST.COM'} at 127.8.39.66:56319
WARNING: no policy specified for kudu/127.8.39.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
I20260808 15:46:43.441614 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:0
--local_ip_for_outbound_sockets=127.8.39.67
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:43009
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:37209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:43.553659 11273 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:43.553958 11273 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:43.554036 11273 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:43.558665 11273 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:43.558854 11273 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:43.558954 11273 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:46:43.564446 11273 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:37209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:43009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11273
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:43.565517 11273 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:43.566547 11273 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:43.576393 11282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:43.576404 11279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:43.576395 11280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:43.577031 11273 server_base.cc:1034] running on GCE node
I20260808 15:46:43.577467 11273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:43.578122 11273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:43.579312 11273 hybrid_clock.cc:648] HybridClock initialized: now 1786204003579287 us; error 50 us; skew 500 ppm
Aug 08 15:46:43 dist-test-slave-8tdl krb5kdc[10872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204003, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:43.582113 11273 init.cc:377] Logged in from keytab as kudu/127.8.39.67@KRBTEST.COM (short username kudu)
I20260808 15:46:43.583053 11273 webserver.cc:460] Webserver started at http://127.8.39.67:41355/ using document root <none> and password file <none>
I20260808 15:46:43.583577 11273 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:43.583636 11273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:43.583802 11273 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:43.585824 11273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/data/instance:
uuid: "af2a0a912a24417b8ae3d6fa74f3642d"
format_stamp: "Formatted at 2026-08-08 15:46:43 on dist-test-slave-8tdl"
server_key: "33822405fbbf267d36f4eee833537e6e"
server_key_iv: "8433023c0bf9242f155aecbdaf5b5874"
server_key_version: "encryptionkey@0"
I20260808 15:46:43.586364 11273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance:
uuid: "af2a0a912a24417b8ae3d6fa74f3642d"
format_stamp: "Formatted at 2026-08-08 15:46:43 on dist-test-slave-8tdl"
server_key: "33822405fbbf267d36f4eee833537e6e"
server_key_iv: "8433023c0bf9242f155aecbdaf5b5874"
server_key_version: "encryptionkey@0"
I20260808 15:46:43.590191 11273 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 15:46:43.592813 11289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:43.594038 11273 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:46:43.594134 11273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "af2a0a912a24417b8ae3d6fa74f3642d"
format_stamp: "Formatted at 2026-08-08 15:46:43 on dist-test-slave-8tdl"
server_key: "33822405fbbf267d36f4eee833537e6e"
server_key_iv: "8433023c0bf9242f155aecbdaf5b5874"
server_key_version: "encryptionkey@0"
I20260808 15:46:43.594218 11273 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:43.612679 11273 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:43.615692 11273 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:43.615854 11273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:43.616403 11273 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:46:43.617260 11273 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:43.617311 11273 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:43.617352 11273 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:43.617367 11273 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:43.626763 11273 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:35057
I20260808 15:46:43.626780 11411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:35057 every 8 connection(s)
I20260808 15:46:43.627681 11273 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:46:43.628930 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 11273
I20260808 15:46:43.629052 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance
I20260808 15:46:43.629379 8349 external_mini_cluster.cc:1428] Setting key 19a80e2fd1950c571cdec4c219795444
Aug 08 15:46:43 dist-test-slave-8tdl krb5kdc[10872](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204003, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:43.643294 10963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:43.629671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:50127 (local address 127.8.39.126:43009)
0808 15:46:43.629804 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:43.629815 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:43.631014 (+ 1199us) server_negotiation.cc:407] Connection header received
0808 15:46:43.632665 (+ 1651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:43.632668 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:43.632715 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:43.632783 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:43.634062 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:43.634768 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:43.636056 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:43.636329 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:43.636453 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:43.639237 (+ 2784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:43.639240 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:43.639242 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:43.639266 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:43.640546 (+ 1280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:43.641076 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:43.641079 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:43.641080 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:43.641157 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:43.641654 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:43.641659 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:43.641661 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:43.641952 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:43.642110 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:43.642970 (+ 860us) server_negotiation.cc:299] Negotiation successful
0808 15:46:43.643116 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 15:46:43.644260 11414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:43.630129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43009 (local address 127.8.39.67:50127)
0808 15:46:43.630812 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:43.630880 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:43.632459 (+ 1579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:43.632927 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:43.632934 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:43.633338 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:43.633896 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:43.633918 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:43.634917 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:43.634922 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:43.635915 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:43.635925 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:43.636499 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:43.636504 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:43.636698 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:43.637281 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:43.637299 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:43.639059 (+ 1760us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:43.640660 (+ 1601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:43.640666 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:43.640677 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:43.640981 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:43.641295 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:43.641301 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:43.641304 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:43.641518 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:43.642392 (+ 874us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:43.642398 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:43.642639 (+ 241us) client_negotiation.cc:769] Sending connection context
0808 15:46:43.642930 (+ 291us) client_negotiation.cc:240] Negotiation successful
0808 15:46:43.643271 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":168,"threads_started":1}
I20260808 15:46:43.645377 11412 heartbeater.cc:347] Connected to a master server at 127.8.39.126:43009
I20260808 15:46:43.645623 11412 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:43.646135 11412 heartbeater.cc:511] Master 127.8.39.126:43009 requested a full tablet report, sending...
I20260808 15:46:43.647221 10921 ts_manager.cc:194] Registered new tserver with Master: af2a0a912a24417b8ae3d6fa74f3642d (127.8.39.67:35057)
I20260808 15:46:43.647816 10921 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.67@KRBTEST.COM'} at 127.8.39.67:50127
I20260808 15:46:43.655953 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 15:46:43.672144 10963 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:46:43.670456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51404 (local address 127.8.39.126:43009)
0808 15:46:43.670605 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:43.670608 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:43.670779 (+ 171us) server_negotiation.cc:407] Connection header received
0808 15:46:43.670932 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:43.670935 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:43.670988 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:43.671063 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:43.671947 (+ 884us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51404: BlockingRecv error: recv got EOF from 127.0.0.1:51404 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 15:46:43.673444 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 10989
I20260808 15:46:43.682199 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 11132
I20260808 15:46:43.690269 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 11273
I20260808 15:46:43.697912 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 10887
2026-08-08T15:46:43Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2293 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:46:43 dist-test-slave-8tdl krb5kdc[11425](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:46:43 dist-test-slave-8tdl krb5kdc[11425](info): set up 2 sockets
Aug 08 15:46:43 dist-test-slave-8tdl krb5kdc[11425](info): commencing operation
krb5kdc: starting...
W20260808 15:46:44.815768 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.094s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:46:44 dist-test-slave-8tdl krb5kdc[11425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:46:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:46:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:46:44.953706 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:43089
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:34777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:43089
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:45.067551 11440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:45.067827 11440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:45.067871 11440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:45.071991 11440 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:46:45.072057 11440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:45.072077 11440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:45.072095 11440 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:46:45.072110 11440 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:46:45.077797 11440 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:34777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:43089
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:43089
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11440
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:45.078992 11440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:45.080061 11440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:45.089059 11446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:45.089040 11449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:45.089071 11447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:45.089586 11440 server_base.cc:1034] running on GCE node
I20260808 15:46:45.090166 11440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:45.091369 11440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:45.092555 11440 hybrid_clock.cc:648] HybridClock initialized: now 1786204005092532 us; error 45 us; skew 500 ppm
Aug 08 15:46:45 dist-test-slave-8tdl krb5kdc[11425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204005, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:45.099165 11440 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:46:45.100087 11440 webserver.cc:460] Webserver started at http://127.8.39.126:43443/ using document root <none> and password file <none>
I20260808 15:46:45.100625 11440 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:45.100685 11440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:45.100867 11440 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:45.103048 11440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "64a578974aa248ae99e82326807d96ab"
format_stamp: "Formatted at 2026-08-08 15:46:45 on dist-test-slave-8tdl"
server_key: "6cea431e02861b1b51eea86205166d9d"
server_key_iv: "2d7e9b0e74403405f8481d9c50706e39"
server_key_version: "encryptionkey@0"
I20260808 15:46:45.103590 11440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "64a578974aa248ae99e82326807d96ab"
format_stamp: "Formatted at 2026-08-08 15:46:45 on dist-test-slave-8tdl"
server_key: "6cea431e02861b1b51eea86205166d9d"
server_key_iv: "2d7e9b0e74403405f8481d9c50706e39"
server_key_version: "encryptionkey@0"
I20260808 15:46:45.107481 11440 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 15:46:45.109990 11456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:45.111495 11440 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:46:45.111653 11440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "64a578974aa248ae99e82326807d96ab"
format_stamp: "Formatted at 2026-08-08 15:46:45 on dist-test-slave-8tdl"
server_key: "6cea431e02861b1b51eea86205166d9d"
server_key_iv: "2d7e9b0e74403405f8481d9c50706e39"
server_key_version: "encryptionkey@0"
I20260808 15:46:45.111780 11440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:45.131127 11440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:45.135036 11440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:45.135278 11440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:45.143242 11440 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:43089
I20260808 15:46:45.143564 11513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:43089 every 8 connection(s)
I20260808 15:46:45.144356 11440 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:46:45.147189 11514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:45.151556 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 11440
I20260808 15:46:45.151714 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:46:45.152047 8349 external_mini_cluster.cc:1428] Setting key 46c0693428ac31317bc482482f3c47b7
I20260808 15:46:45.152895 11514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64a578974aa248ae99e82326807d96ab: Bootstrap starting.
I20260808 15:46:45.155479 11514 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 64a578974aa248ae99e82326807d96ab: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:45.156368 11514 log.cc:824] T 00000000000000000000000000000000 P 64a578974aa248ae99e82326807d96ab: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:45.158543 11514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64a578974aa248ae99e82326807d96ab: No bootstrap required, opened a new log
Aug 08 15:46:45 dist-test-slave-8tdl krb5kdc[11425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:45.162809 11514 raft_consensus.cc:348] T 00000000000000000000000000000000 P 64a578974aa248ae99e82326807d96ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64a578974aa248ae99e82326807d96ab" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43089 } }
I20260808 15:46:45.163133 11514 raft_consensus.cc:374] T 00000000000000000000000000000000 P 64a578974aa248ae99e82326807d96ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:45.163192 11514 raft_consensus.cc:729] T 00000000000000000000000000000000 P 64a578974aa248ae99e82326807d96ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64a578974aa248ae99e82326807d96ab, State: Initialized, Role: FOLLOWER
I20260808 15:46:45.163753 11514 consensus_queue.cc:260] T 00000000000000000000000000000000 P 64a578974aa248ae99e82326807d96ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64a578974aa248ae99e82326807d96ab" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43089 } }
I20260808 15:46:45.163934 11514 raft_consensus.cc:388] T 00000000000000000000000000000000 P 64a578974aa248ae99e82326807d96ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:46:45.164008 11514 raft_consensus.cc:482] T 00000000000000000000000000000000 P 64a578974aa248ae99e82326807d96ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:46:45.164134 11514 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 64a578974aa248ae99e82326807d96ab [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:45.165406 11514 raft_consensus.cc:504] T 00000000000000000000000000000000 P 64a578974aa248ae99e82326807d96ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64a578974aa248ae99e82326807d96ab" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43089 } }
I20260808 15:46:45.165788 11514 leader_election.cc:302] T 00000000000000000000000000000000 P 64a578974aa248ae99e82326807d96ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64a578974aa248ae99e82326807d96ab; no voters:
I20260808 15:46:45.166204 11514 leader_election.cc:288] T 00000000000000000000000000000000 P 64a578974aa248ae99e82326807d96ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:46:45.166443 11519 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 64a578974aa248ae99e82326807d96ab [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:45.166760 11519 raft_consensus.cc:686] T 00000000000000000000000000000000 P 64a578974aa248ae99e82326807d96ab [term 1 LEADER]: Becoming Leader. State: Replica: 64a578974aa248ae99e82326807d96ab, State: Running, Role: LEADER
I20260808 15:46:45.167147 11519 consensus_queue.cc:237] T 00000000000000000000000000000000 P 64a578974aa248ae99e82326807d96ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64a578974aa248ae99e82326807d96ab" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43089 } }
I20260808 15:46:45.167626 11514 sys_catalog.cc:564] T 00000000000000000000000000000000 P 64a578974aa248ae99e82326807d96ab [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:46:45.168522 11519 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64a578974aa248ae99e82326807d96ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 64a578974aa248ae99e82326807d96ab. Latest consensus state: current_term: 1 leader_uuid: "64a578974aa248ae99e82326807d96ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64a578974aa248ae99e82326807d96ab" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43089 } } }
I20260808 15:46:45.168643 11519 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64a578974aa248ae99e82326807d96ab [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:45.169036 11528 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:46:45.168993 11520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64a578974aa248ae99e82326807d96ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "64a578974aa248ae99e82326807d96ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64a578974aa248ae99e82326807d96ab" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43089 } } }
I20260808 15:46:45.169150 11520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64a578974aa248ae99e82326807d96ab [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:45.169657 11517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:45.153574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43588 (local address 127.8.39.126:43089)
0808 15:46:45.154062 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:45.154084 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:45.154126 (+ 42us) server_negotiation.cc:407] Connection header received
0808 15:46:45.154999 (+ 873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:45.155021 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:45.155423 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:45.155802 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:45.156680 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:45.158021 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:45.159138 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:45.159818 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:45.159986 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:45.162897 (+ 2911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:45.162903 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:45.162921 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:45.162955 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:45.165340 (+ 2385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:45.165901 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:45.165907 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:45.165913 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:45.166061 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:45.166656 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:45.166662 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:45.166667 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:45.167332 (+ 665us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:45.167535 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:45.167975 (+ 440us) server_negotiation.cc:299] Negotiation successful
0808 15:46:45.168297 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":132,"threads_started":1}
I20260808 15:46:45.172425 11528 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:46:45.173069 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:46:45.179404 11528 catalog_manager.cc:1347] Generated new cluster ID: c698e325c5764c94858f32e75bde0f93
I20260808 15:46:45.179479 11528 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:46:45.193698 11528 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:46:45.194671 11517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:45.188759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43602 (local address 127.8.39.126:43089)
0808 15:46:45.188995 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:45.189003 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:45.189541 (+ 538us) server_negotiation.cc:407] Connection header received
0808 15:46:45.189718 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:45.189721 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:45.189766 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:45.189853 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:45.190425 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:45.191148 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:45.192101 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:45.192417 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:45.192521 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:45.193582 (+ 1061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:45.193585 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:45.193588 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:46:45.194181 (+ 593us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:45.194212 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:46:45.194229 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:45.194334 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:45.194452 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 15:46:45.194514 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":108,"server-negotiator.queue_time_us":90}
I20260808 15:46:45.194989 11528 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:46:45.212236 11528 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 64a578974aa248ae99e82326807d96ab: Generated new TSK 0
I20260808 15:46:45.213191 11528 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:46:45.218753 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 11440
2026-08-08T15:46:45Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1520 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:46:45 dist-test-slave-8tdl krb5kdc[11548](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:46:45 dist-test-slave-8tdl krb5kdc[11548](info): set up 2 sockets
Aug 08 15:46:45 dist-test-slave-8tdl krb5kdc[11548](info): commencing operation
krb5kdc: starting...
W20260808 15:46:46.400846 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.159s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260808 15:46:46.566498 8349 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.165s user 0.000s sys 0.003s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260808 15:46:46.734166 8349 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.168s user 0.000s sys 0.002s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260808 15:46:46.848057 8349 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.114s user 0.000s sys 0.003s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/test-user.keytab.
W20260808 15:46:47.215101 8349 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.367s user 0.000s sys 0.003s
Aug 08 15:46:47 dist-test-slave-8tdl krb5kdc[11548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204007, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:46:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:46:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:46:47.267599 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:39911
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:35877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:39911
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:47.384851 11562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:47.385141 11562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:47.385185 11562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:47.389209 11562 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:46:47.389272 11562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:47.389292 11562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:47.389308 11562 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:46:47.389323 11562 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:46:47.394562 11562 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:35877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:39911
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:39911
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11562
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:47.395640 11562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:47.396610 11562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:47.405354 11569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:47.405381 11572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:47.405400 11568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:47.405653 11562 server_base.cc:1034] running on GCE node
I20260808 15:46:47.406373 11562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:47.407639 11562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:47.408819 11562 hybrid_clock.cc:648] HybridClock initialized: now 1786204007408792 us; error 43 us; skew 500 ppm
Aug 08 15:46:47 dist-test-slave-8tdl krb5kdc[11548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204007, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:47.411895 11562 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:46:47.412788 11562 webserver.cc:460] Webserver started at http://127.8.39.126:35709/ using document root <none> and password file <none>
I20260808 15:46:47.413347 11562 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:47.413439 11562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:47.413708 11562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:47.415834 11562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "24f2c38f24324f44bc2f7ea8a23adaf0"
format_stamp: "Formatted at 2026-08-08 15:46:47 on dist-test-slave-8tdl"
server_key: "a61d1bc20cc2feeae4ee2a0c9f6d2b00"
server_key_iv: "7ab633849a4fdd98ca1bc7b661494c23"
server_key_version: "encryptionkey@0"
I20260808 15:46:47.416425 11562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "24f2c38f24324f44bc2f7ea8a23adaf0"
format_stamp: "Formatted at 2026-08-08 15:46:47 on dist-test-slave-8tdl"
server_key: "a61d1bc20cc2feeae4ee2a0c9f6d2b00"
server_key_iv: "7ab633849a4fdd98ca1bc7b661494c23"
server_key_version: "encryptionkey@0"
I20260808 15:46:47.420383 11562 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 15:46:47.423084 11580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:47.424440 11562 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 15:46:47.424600 11562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "24f2c38f24324f44bc2f7ea8a23adaf0"
format_stamp: "Formatted at 2026-08-08 15:46:47 on dist-test-slave-8tdl"
server_key: "a61d1bc20cc2feeae4ee2a0c9f6d2b00"
server_key_iv: "7ab633849a4fdd98ca1bc7b661494c23"
server_key_version: "encryptionkey@0"
I20260808 15:46:47.424726 11562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:47.455004 11562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:47.458381 11562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:47.458623 11562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:47.466156 11562 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:39911
I20260808 15:46:47.466462 11634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:39911 every 8 connection(s)
I20260808 15:46:47.467198 11562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:46:47.469986 11635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:47.475692 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 11562
I20260808 15:46:47.475819 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:46:47.475868 11635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24f2c38f24324f44bc2f7ea8a23adaf0: Bootstrap starting.
I20260808 15:46:47.476137 8349 external_mini_cluster.cc:1428] Setting key 8c3731e826e8d4c0cec40026b547012a
I20260808 15:46:47.478545 11635 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 24f2c38f24324f44bc2f7ea8a23adaf0: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:47.479341 11635 log.cc:824] T 00000000000000000000000000000000 P 24f2c38f24324f44bc2f7ea8a23adaf0: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:47.481417 11635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24f2c38f24324f44bc2f7ea8a23adaf0: No bootstrap required, opened a new log
Aug 08 15:46:47 dist-test-slave-8tdl krb5kdc[11548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204007, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:47.484982 11635 raft_consensus.cc:348] T 00000000000000000000000000000000 P 24f2c38f24324f44bc2f7ea8a23adaf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24f2c38f24324f44bc2f7ea8a23adaf0" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 39911 } }
I20260808 15:46:47.485250 11635 raft_consensus.cc:374] T 00000000000000000000000000000000 P 24f2c38f24324f44bc2f7ea8a23adaf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:47.485324 11635 raft_consensus.cc:729] T 00000000000000000000000000000000 P 24f2c38f24324f44bc2f7ea8a23adaf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24f2c38f24324f44bc2f7ea8a23adaf0, State: Initialized, Role: FOLLOWER
I20260808 15:46:47.485867 11635 consensus_queue.cc:260] T 00000000000000000000000000000000 P 24f2c38f24324f44bc2f7ea8a23adaf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24f2c38f24324f44bc2f7ea8a23adaf0" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 39911 } }
I20260808 15:46:47.486006 11635 raft_consensus.cc:388] T 00000000000000000000000000000000 P 24f2c38f24324f44bc2f7ea8a23adaf0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:46:47.486075 11635 raft_consensus.cc:482] T 00000000000000000000000000000000 P 24f2c38f24324f44bc2f7ea8a23adaf0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:46:47.486196 11635 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 24f2c38f24324f44bc2f7ea8a23adaf0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:47.487180 11635 raft_consensus.cc:504] T 00000000000000000000000000000000 P 24f2c38f24324f44bc2f7ea8a23adaf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24f2c38f24324f44bc2f7ea8a23adaf0" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 39911 } }
I20260808 15:46:47.487519 11635 leader_election.cc:302] T 00000000000000000000000000000000 P 24f2c38f24324f44bc2f7ea8a23adaf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 24f2c38f24324f44bc2f7ea8a23adaf0; no voters:
I20260808 15:46:47.487857 11635 leader_election.cc:288] T 00000000000000000000000000000000 P 24f2c38f24324f44bc2f7ea8a23adaf0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:46:47.487941 11641 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 24f2c38f24324f44bc2f7ea8a23adaf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:47.488122 11641 raft_consensus.cc:686] T 00000000000000000000000000000000 P 24f2c38f24324f44bc2f7ea8a23adaf0 [term 1 LEADER]: Becoming Leader. State: Replica: 24f2c38f24324f44bc2f7ea8a23adaf0, State: Running, Role: LEADER
I20260808 15:46:47.488482 11641 consensus_queue.cc:237] T 00000000000000000000000000000000 P 24f2c38f24324f44bc2f7ea8a23adaf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24f2c38f24324f44bc2f7ea8a23adaf0" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 39911 } }
I20260808 15:46:47.489174 11635 sys_catalog.cc:564] T 00000000000000000000000000000000 P 24f2c38f24324f44bc2f7ea8a23adaf0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:46:47.489671 11641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24f2c38f24324f44bc2f7ea8a23adaf0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 24f2c38f24324f44bc2f7ea8a23adaf0. Latest consensus state: current_term: 1 leader_uuid: "24f2c38f24324f44bc2f7ea8a23adaf0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24f2c38f24324f44bc2f7ea8a23adaf0" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 39911 } } }
I20260808 15:46:47.490458 11641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24f2c38f24324f44bc2f7ea8a23adaf0 [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:47.490346 11642 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24f2c38f24324f44bc2f7ea8a23adaf0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "24f2c38f24324f44bc2f7ea8a23adaf0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24f2c38f24324f44bc2f7ea8a23adaf0" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 39911 } } }
I20260808 15:46:47.490805 11642 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24f2c38f24324f44bc2f7ea8a23adaf0 [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:47.492138 11638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:47.477531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38822 (local address 127.8.39.126:39911)
0808 15:46:47.477993 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:47.478011 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:47.478047 (+ 36us) server_negotiation.cc:407] Connection header received
0808 15:46:47.478808 (+ 761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:47.478827 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:47.479173 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:47.479482 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:47.480364 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:47.481432 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:47.482353 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:47.482911 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:47.483104 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:47.485799 (+ 2695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:47.485804 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:47.485816 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:47.485842 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:47.488170 (+ 2328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:47.488717 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:47.488728 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:47.488732 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:47.488841 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:47.489170 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:47.489173 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:47.489175 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:47.489700 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:47.490604 (+ 904us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:47.490784 (+ 180us) server_negotiation.cc:299] Negotiation successful
0808 15:46:47.491092 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":127,"threads_started":1}
W20260808 15:46:47.494580 11657 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 24f2c38f24324f44bc2f7ea8a23adaf0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:46:47.494663 11657 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:46:47.494761 11650 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:46:47.495500 11650 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:46:47.501032 11650 catalog_manager.cc:1347] Generated new cluster ID: 96cfb6bc58c54571a2bde49f3135a7b9
I20260808 15:46:47.501106 11650 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:46:47.523452 11650 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:46:47.524945 11650 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:46:47.540031 11650 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 24f2c38f24324f44bc2f7ea8a23adaf0: Generated new TSK 0
I20260808 15:46:47.540789 11650 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.39.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
I20260808 15:46:47.577740 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:0
--local_ip_for_outbound_sockets=127.8.39.65
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:39911
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:35877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:47.692937 11662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:47.693212 11662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:47.693256 11662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:47.697419 11662 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:47.697489 11662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:47.697548 11662 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:46:47.702872 11662 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:35877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:39911
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11662
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:47.703994 11662 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:47.704973 11662 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:47.714849 11668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:47.714881 11669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:47.714916 11671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:47.715139 11662 server_base.cc:1034] running on GCE node
I20260808 15:46:47.715591 11662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:47.716257 11662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:47.717450 11662 hybrid_clock.cc:648] HybridClock initialized: now 1786204007717432 us; error 32 us; skew 500 ppm
Aug 08 15:46:47 dist-test-slave-8tdl krb5kdc[11548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204007, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:47.720378 11662 init.cc:377] Logged in from keytab as kudu/127.8.39.65@KRBTEST.COM (short username kudu)
I20260808 15:46:47.721704 11662 webserver.cc:460] Webserver started at http://127.8.39.65:37339/ using document root <none> and password file <none>
I20260808 15:46:47.722544 11662 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:47.722645 11662 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:47.722909 11662 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:47.725435 11662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/data/instance:
uuid: "5f24a20d62884f70bcfc58b42ca70ff2"
format_stamp: "Formatted at 2026-08-08 15:46:47 on dist-test-slave-8tdl"
server_key: "e1de52e384a124526cc121b027b656d7"
server_key_iv: "3dff75f13dbf1aabf1a2fc7ec95bbdc4"
server_key_version: "encryptionkey@0"
I20260808 15:46:47.726151 11662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance:
uuid: "5f24a20d62884f70bcfc58b42ca70ff2"
format_stamp: "Formatted at 2026-08-08 15:46:47 on dist-test-slave-8tdl"
server_key: "e1de52e384a124526cc121b027b656d7"
server_key_iv: "3dff75f13dbf1aabf1a2fc7ec95bbdc4"
server_key_version: "encryptionkey@0"
I20260808 15:46:47.730538 11662 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 15:46:47.733146 11678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:47.734550 11662 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:46:47.734750 11662 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "5f24a20d62884f70bcfc58b42ca70ff2"
format_stamp: "Formatted at 2026-08-08 15:46:47 on dist-test-slave-8tdl"
server_key: "e1de52e384a124526cc121b027b656d7"
server_key_iv: "3dff75f13dbf1aabf1a2fc7ec95bbdc4"
server_key_version: "encryptionkey@0"
I20260808 15:46:47.734890 11662 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:47.760514 11662 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:47.764140 11662 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:47.764381 11662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:47.765089 11662 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:46:47.766017 11662 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:47.766072 11662 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:47.766114 11662 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:47.766175 11662 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:47.776369 11662 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:43973
I20260808 15:46:47.776391 11798 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:43973 every 8 connection(s)
I20260808 15:46:47.777415 11662 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:46:47.785430 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 11662
I20260808 15:46:47.785569 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance
I20260808 15:46:47.785939 8349 external_mini_cluster.cc:1428] Setting key cbf478c9ae8b0e7846eb0b9a0d9c7cfd
Aug 08 15:46:47 dist-test-slave-8tdl krb5kdc[11548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204007, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:47.793023 11638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:47.779413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:41775 (local address 127.8.39.126:39911)
0808 15:46:47.779628 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:47.779634 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:47.780536 (+ 902us) server_negotiation.cc:407] Connection header received
0808 15:46:47.781996 (+ 1460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:47.781999 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:47.782052 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:47.782136 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:47.783383 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:47.783994 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:47.785172 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:47.785583 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:47.785719 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:47.788663 (+ 2944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:47.788666 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:47.788669 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:47.788706 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:47.790591 (+ 1885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:47.791277 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:47.791282 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:47.791284 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:47.791383 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:47.791793 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:47.791796 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:47.791798 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:47.792012 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:47.792129 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:47.792693 (+ 564us) server_negotiation.cc:299] Negotiation successful
0808 15:46:47.792831 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260808 15:46:47.793910 11801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:47.779872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:39911 (local address 127.8.39.65:41775)
0808 15:46:47.780367 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:47.780413 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:47.781775 (+ 1362us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:47.782299 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:47.782306 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:47.782762 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:47.783232 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:47.783244 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:47.784116 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:47.784119 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:47.785017 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:47.785026 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:47.785756 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:47.785759 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:47.785897 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:47.786657 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:47.786718 (+ 61us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:47.788484 (+ 1766us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:47.790785 (+ 2301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:47.790792 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:47.790809 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:47.791156 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:47.791507 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:47.791510 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:47.791512 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:47.791675 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:47.792130 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:47.792138 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:47.792423 (+ 285us) client_negotiation.cc:769] Sending connection context
0808 15:46:47.792633 (+ 210us) client_negotiation.cc:240] Negotiation successful
0808 15:46:47.793010 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":122,"threads_started":1}
I20260808 15:46:47.795420 11799 heartbeater.cc:347] Connected to a master server at 127.8.39.126:39911
I20260808 15:46:47.795708 11799 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:47.796339 11799 heartbeater.cc:511] Master 127.8.39.126:39911 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.8.39.66@KRBTEST.COM; defaulting to no policy
I20260808 15:46:47.798012 11597 ts_manager.cc:194] Registered new tserver with Master: 5f24a20d62884f70bcfc58b42ca70ff2 (127.8.39.65:43973)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.66@KRBTEST.COM" created.
I20260808 15:46:47.799355 11597 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.65@KRBTEST.COM'} at 127.8.39.65:41775
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
I20260808 15:46:47.817809 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:0
--local_ip_for_outbound_sockets=127.8.39.66
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:39911
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:35877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:47.931384 11804 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:47.931646 11804 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:47.931723 11804 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:47.935791 11804 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:47.935850 11804 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:47.935966 11804 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:46:47.941576 11804 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:35877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:39911
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11804
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:47.942795 11804 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:47.943902 11804 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:47.953922 11813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:47.953943 11809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:47.954056 11810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:47.954417 11804 server_base.cc:1034] running on GCE node
I20260808 15:46:47.955065 11804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:47.955746 11804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:47.956972 11804 hybrid_clock.cc:648] HybridClock initialized: now 1786204007956934 us; error 54 us; skew 500 ppm
Aug 08 15:46:47 dist-test-slave-8tdl krb5kdc[11548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204007, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:47.960145 11804 init.cc:377] Logged in from keytab as kudu/127.8.39.66@KRBTEST.COM (short username kudu)
I20260808 15:46:47.961150 11804 webserver.cc:460] Webserver started at http://127.8.39.66:38825/ using document root <none> and password file <none>
I20260808 15:46:47.961763 11804 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:47.961876 11804 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:47.962124 11804 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:47.964393 11804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/data/instance:
uuid: "8f3f6a1f798a4f0bb2fe9a294216a53c"
format_stamp: "Formatted at 2026-08-08 15:46:47 on dist-test-slave-8tdl"
server_key: "6085306f9b5a3979bdcff48e46567073"
server_key_iv: "758ff9c6d9d6690360d969fa79f6dd78"
server_key_version: "encryptionkey@0"
I20260808 15:46:47.965019 11804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance:
uuid: "8f3f6a1f798a4f0bb2fe9a294216a53c"
format_stamp: "Formatted at 2026-08-08 15:46:47 on dist-test-slave-8tdl"
server_key: "6085306f9b5a3979bdcff48e46567073"
server_key_iv: "758ff9c6d9d6690360d969fa79f6dd78"
server_key_version: "encryptionkey@0"
I20260808 15:46:47.969054 11804 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260808 15:46:47.971747 11820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:47.973088 11804 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:46:47.973269 11804 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "8f3f6a1f798a4f0bb2fe9a294216a53c"
format_stamp: "Formatted at 2026-08-08 15:46:47 on dist-test-slave-8tdl"
server_key: "6085306f9b5a3979bdcff48e46567073"
server_key_iv: "758ff9c6d9d6690360d969fa79f6dd78"
server_key_version: "encryptionkey@0"
I20260808 15:46:47.973413 11804 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:47.996943 11804 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:48.000764 11804 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:48.001017 11804 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:48.001695 11804 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:46:48.002848 11804 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:48.003028 11804 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:48.003140 11804 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:48.003196 11804 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:48.013314 11804 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:44141
I20260808 15:46:48.013334 11940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:44141 every 8 connection(s)
I20260808 15:46:48.014353 11804 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:46:48.015336 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 11804
I20260808 15:46:48.015466 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance
I20260808 15:46:48.015725 8349 external_mini_cluster.cc:1428] Setting key 4aaf1a45b170135397e5dea46c7c5a59
Aug 08 15:46:48 dist-test-slave-8tdl krb5kdc[11548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204007, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.39.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.67@KRBTEST.COM" created.
I20260808 15:46:48.031503 11638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:48.017602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:48861 (local address 127.8.39.126:39911)
0808 15:46:48.017760 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:48.017765 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:48.018938 (+ 1173us) server_negotiation.cc:407] Connection header received
0808 15:46:48.020535 (+ 1597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:48.020538 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:48.020594 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:48.020704 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:48.021853 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:48.022382 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:48.023580 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:48.023801 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:48.023915 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:48.026972 (+ 3057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:48.026980 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:48.026983 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:48.027009 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:48.028717 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:48.029367 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:48.029371 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:48.029372 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:48.029453 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:48.030028 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:48.030032 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:48.030035 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:48.030294 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:48.030403 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:48.031085 (+ 682us) server_negotiation.cc:299] Negotiation successful
0808 15:46:48.031231 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 15:46:48.032313 11943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:48.018186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:39911 (local address 127.8.39.66:48861)
0808 15:46:48.018766 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:48.018829 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:48.020309 (+ 1480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:48.020871 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:48.020878 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:48.021233 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:48.021709 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:48.021722 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:48.022520 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:48.022523 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:48.023446 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:48.023456 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:48.023955 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:48.023960 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:48.024134 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:48.024807 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:48.024823 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:48.026778 (+ 1955us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:48.028964 (+ 2186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:48.028969 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:48.028982 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:48.029265 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:48.029553 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:48.029560 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:48.029566 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:48.029779 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:48.030418 (+ 639us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:48.030424 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:48.030753 (+ 329us) client_negotiation.cc:769] Sending connection context
0808 15:46:48.030991 (+ 238us) client_negotiation.cc:240] Negotiation successful
0808 15:46:48.031289 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":119,"threads_started":1}
I20260808 15:46:48.033555 11941 heartbeater.cc:347] Connected to a master server at 127.8.39.126:39911
I20260808 15:46:48.033809 11941 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:48.034313 11941 heartbeater.cc:511] Master 127.8.39.126:39911 requested a full tablet report, sending...
I20260808 15:46:48.035509 11597 ts_manager.cc:194] Registered new tserver with Master: 8f3f6a1f798a4f0bb2fe9a294216a53c (127.8.39.66:44141)
I20260808 15:46:48.036114 11597 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.66@KRBTEST.COM'} at 127.8.39.66:48861
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
I20260808 15:46:48.048028 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:0
--local_ip_for_outbound_sockets=127.8.39.67
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:39911
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:35877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:48.163045 11946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:48.163345 11946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:48.163417 11946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:48.167484 11946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:48.167564 11946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:48.167659 11946 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:46:48.173046 11946 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:35877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:39911
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11946
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:48.174173 11946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:48.175251 11946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:48.184948 11952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:48.185120 11946 server_base.cc:1034] running on GCE node
W20260808 15:46:48.185029 11951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:48.184970 11954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:48.185751 11946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:48.186445 11946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:48.187650 11946 hybrid_clock.cc:648] HybridClock initialized: now 1786204008187613 us; error 50 us; skew 500 ppm
Aug 08 15:46:48 dist-test-slave-8tdl krb5kdc[11548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204008, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:48.190881 11946 init.cc:377] Logged in from keytab as kudu/127.8.39.67@KRBTEST.COM (short username kudu)
I20260808 15:46:48.191849 11946 webserver.cc:460] Webserver started at http://127.8.39.67:41491/ using document root <none> and password file <none>
I20260808 15:46:48.192445 11946 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:48.192541 11946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:48.192782 11946 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:48.195053 11946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/data/instance:
uuid: "f30ac00b56554ad392aca0186f4e4eba"
format_stamp: "Formatted at 2026-08-08 15:46:48 on dist-test-slave-8tdl"
server_key: "fb3b425c052a174c98167dd6595b22d6"
server_key_iv: "fb2ad32c61c9ac4c00a17eaf95eaae1e"
server_key_version: "encryptionkey@0"
I20260808 15:46:48.195676 11946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance:
uuid: "f30ac00b56554ad392aca0186f4e4eba"
format_stamp: "Formatted at 2026-08-08 15:46:48 on dist-test-slave-8tdl"
server_key: "fb3b425c052a174c98167dd6595b22d6"
server_key_iv: "fb2ad32c61c9ac4c00a17eaf95eaae1e"
server_key_version: "encryptionkey@0"
I20260808 15:46:48.200546 11946 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260808 15:46:48.203198 11961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:48.204563 11946 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:46:48.204710 11946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "f30ac00b56554ad392aca0186f4e4eba"
format_stamp: "Formatted at 2026-08-08 15:46:48 on dist-test-slave-8tdl"
server_key: "fb3b425c052a174c98167dd6595b22d6"
server_key_iv: "fb2ad32c61c9ac4c00a17eaf95eaae1e"
server_key_version: "encryptionkey@0"
I20260808 15:46:48.204838 11946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:48.217221 11946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:48.220633 11946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:48.220841 11946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:48.221448 11946 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:46:48.222343 11946 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:48.222433 11946 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:48.222509 11946 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:48.222561 11946 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:48.231981 11946 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:38607
I20260808 15:46:48.232012 12080 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:38607 every 8 connection(s)
I20260808 15:46:48.232870 11946 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:46:48.235519 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 11946
I20260808 15:46:48.235677 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance
I20260808 15:46:48.236044 8349 external_mini_cluster.cc:1428] Setting key d11168762f003d66b23c57fc737108fc
Aug 08 15:46:48 dist-test-slave-8tdl krb5kdc[11548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204008, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:48.248656 11638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:48.234878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:59659 (local address 127.8.39.126:39911)
0808 15:46:48.235017 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:48.235021 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:48.236232 (+ 1211us) server_negotiation.cc:407] Connection header received
0808 15:46:48.237863 (+ 1631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:48.237866 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:48.237926 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:48.238010 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:48.239616 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:48.240275 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:48.241478 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:48.241727 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:48.241819 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:48.244695 (+ 2876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:48.244698 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:48.244701 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:48.244726 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:48.246343 (+ 1617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:48.246962 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:48.246965 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:48.246966 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:48.247063 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:48.247439 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:48.247442 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:48.247443 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:48.247660 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:48.247746 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:48.248400 (+ 654us) server_negotiation.cc:299] Negotiation successful
0808 15:46:48.248528 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 15:46:48.249716 12083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:48.235386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:39911 (local address 127.8.39.67:59659)
0808 15:46:48.235989 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:48.236084 (+ 95us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:48.237651 (+ 1567us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:48.238310 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:48.238316 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:48.238839 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:48.239404 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:48.239420 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:48.240396 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:48.240399 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:48.241350 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:48.241360 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:48.241926 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:48.241932 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:48.242116 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:48.242840 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:48.242857 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:48.244531 (+ 1674us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:48.246477 (+ 1946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:48.246482 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:48.246494 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:48.246825 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:48.247166 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:48.247168 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:48.247169 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:48.247307 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:48.247797 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:48.247806 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:48.248127 (+ 321us) client_negotiation.cc:769] Sending connection context
0808 15:46:48.248313 (+ 186us) client_negotiation.cc:240] Negotiation successful
0808 15:46:48.248616 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":180,"threads_started":1}
I20260808 15:46:48.251003 12081 heartbeater.cc:347] Connected to a master server at 127.8.39.126:39911
I20260808 15:46:48.251271 12081 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:48.251866 12081 heartbeater.cc:511] Master 127.8.39.126:39911 requested a full tablet report, sending...
I20260808 15:46:48.252945 11596 ts_manager.cc:194] Registered new tserver with Master: f30ac00b56554ad392aca0186f4e4eba (127.8.39.67:38607)
I20260808 15:46:48.253516 11596 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.67@KRBTEST.COM'} at 127.8.39.67:59659
I20260808 15:46:48.262531 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 15:46:48 dist-test-slave-8tdl krb5kdc[11548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204008, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 15:46:48 dist-test-slave-8tdl krb5kdc[11548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204008, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:48.291735 11638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:48.281926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38836 (local address 127.8.39.126:39911)
0808 15:46:48.282122 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:48.282126 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:48.282225 (+ 99us) server_negotiation.cc:407] Connection header received
0808 15:46:48.282353 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:48.282355 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:48.282401 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:48.282497 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:48.283429 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:48.283971 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:48.284882 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:48.285107 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:48.285192 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:48.288171 (+ 2979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:48.288175 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:48.288177 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:48.288205 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:48.289755 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:48.290356 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:48.290359 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:48.290360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:48.290442 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:48.290757 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:48.290760 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:48.290761 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:48.291102 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:48.291209 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:48.291504 (+ 295us) server_negotiation.cc:299] Negotiation successful
0808 15:46:48.291603 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
W20260808 15:46:48.292233 11596 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:38836
I20260808 15:46:48.293407 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 11662
I20260808 15:46:48.300113 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 11804
I20260808 15:46:48.306020 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 11946
I20260808 15:46:48.312912 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 11562
2026-08-08T15:46:48Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3095 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:46:48 dist-test-slave-8tdl krb5kdc[12094](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:46:48 dist-test-slave-8tdl krb5kdc[12094](info): set up 2 sockets
Aug 08 15:46:48 dist-test-slave-8tdl krb5kdc[12094](info): commencing operation
krb5kdc: starting...
W20260808 15:46:49.387387 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.050s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:46:49 dist-test-slave-8tdl krb5kdc[12094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204009, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:46:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:46:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:46:49.521606 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:42303
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:41027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:42303
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:49.641678 12107 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:49.642004 12107 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:49.642084 12107 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:49.646165 12107 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:46:49.646268 12107 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:49.646307 12107 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:49.646345 12107 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:46:49.646375 12107 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:46:49.651793 12107 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:41027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:42303
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:42303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12107
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:49.652907 12107 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:49.653934 12107 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:49.662559 12116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:49.662567 12114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:49.662709 12107 server_base.cc:1034] running on GCE node
W20260808 15:46:49.662930 12113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:49.663546 12107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:49.664614 12107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:49.665776 12107 hybrid_clock.cc:648] HybridClock initialized: now 1786204009665767 us; error 73 us; skew 500 ppm
Aug 08 15:46:49 dist-test-slave-8tdl krb5kdc[12094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204009, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:49.668745 12107 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:46:49.669646 12107 webserver.cc:460] Webserver started at http://127.8.39.126:43139/ using document root <none> and password file <none>
I20260808 15:46:49.670229 12107 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:49.670293 12107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:49.670469 12107 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:49.672739 12107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "22634b73b38a4c05bf60c32d4e9c8268"
format_stamp: "Formatted at 2026-08-08 15:46:49 on dist-test-slave-8tdl"
server_key: "dce406f8b63437cd7ca8a6b16cb7a2a2"
server_key_iv: "b0cd5c26786796e50f7252358797e238"
server_key_version: "encryptionkey@0"
I20260808 15:46:49.673272 12107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "22634b73b38a4c05bf60c32d4e9c8268"
format_stamp: "Formatted at 2026-08-08 15:46:49 on dist-test-slave-8tdl"
server_key: "dce406f8b63437cd7ca8a6b16cb7a2a2"
server_key_iv: "b0cd5c26786796e50f7252358797e238"
server_key_version: "encryptionkey@0"
I20260808 15:46:49.677241 12107 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 15:46:49.679713 12123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:49.680986 12107 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:46:49.681097 12107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "22634b73b38a4c05bf60c32d4e9c8268"
format_stamp: "Formatted at 2026-08-08 15:46:49 on dist-test-slave-8tdl"
server_key: "dce406f8b63437cd7ca8a6b16cb7a2a2"
server_key_iv: "b0cd5c26786796e50f7252358797e238"
server_key_version: "encryptionkey@0"
I20260808 15:46:49.681247 12107 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:49.695550 12107 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:49.699033 12107 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:49.699246 12107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:49.706643 12107 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:42303
I20260808 15:46:49.706760 12181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:42303 every 8 connection(s)
I20260808 15:46:49.707690 12107 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:46:49.708915 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 12107
I20260808 15:46:49.709028 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:46:49.709360 8349 external_mini_cluster.cc:1428] Setting key f6ce2cd29c1e1de756828c9b469d8888
I20260808 15:46:49.710939 12182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:49.717772 12182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22634b73b38a4c05bf60c32d4e9c8268: Bootstrap starting.
Aug 08 15:46:49 dist-test-slave-8tdl krb5kdc[12094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204009, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:49.720433 12182 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 22634b73b38a4c05bf60c32d4e9c8268: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:49.721414 12182 log.cc:824] T 00000000000000000000000000000000 P 22634b73b38a4c05bf60c32d4e9c8268: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:49.724023 12182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22634b73b38a4c05bf60c32d4e9c8268: No bootstrap required, opened a new log
I20260808 15:46:49.725469 12185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:49.710830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33398 (local address 127.8.39.126:42303)
0808 15:46:49.711291 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:49.711312 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:49.711355 (+ 43us) server_negotiation.cc:407] Connection header received
0808 15:46:49.712185 (+ 830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:49.712207 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:49.712619 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:49.712972 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:49.713677 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:49.715214 (+ 1537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:49.716157 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:49.716881 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:49.717045 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:49.719675 (+ 2630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:49.719682 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:49.719697 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:49.719728 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:49.722085 (+ 2357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:49.722629 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:49.722635 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:49.722641 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:49.722795 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:49.723115 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:49.723118 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:49.723119 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:49.723628 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:49.723812 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:49.724247 (+ 435us) server_negotiation.cc:299] Negotiation successful
0808 15:46:49.724569 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":160,"threads_started":1}
I20260808 15:46:49.728404 12182 raft_consensus.cc:348] T 00000000000000000000000000000000 P 22634b73b38a4c05bf60c32d4e9c8268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22634b73b38a4c05bf60c32d4e9c8268" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42303 } }
I20260808 15:46:49.728673 12182 raft_consensus.cc:374] T 00000000000000000000000000000000 P 22634b73b38a4c05bf60c32d4e9c8268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:49.728729 12182 raft_consensus.cc:729] T 00000000000000000000000000000000 P 22634b73b38a4c05bf60c32d4e9c8268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22634b73b38a4c05bf60c32d4e9c8268, State: Initialized, Role: FOLLOWER
I20260808 15:46:49.729183 12182 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22634b73b38a4c05bf60c32d4e9c8268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22634b73b38a4c05bf60c32d4e9c8268" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42303 } }
I20260808 15:46:49.729313 12182 raft_consensus.cc:388] T 00000000000000000000000000000000 P 22634b73b38a4c05bf60c32d4e9c8268 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:46:49.729362 12182 raft_consensus.cc:482] T 00000000000000000000000000000000 P 22634b73b38a4c05bf60c32d4e9c8268 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:46:49.729446 12182 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 22634b73b38a4c05bf60c32d4e9c8268 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:49.730557 12182 raft_consensus.cc:504] T 00000000000000000000000000000000 P 22634b73b38a4c05bf60c32d4e9c8268 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22634b73b38a4c05bf60c32d4e9c8268" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42303 } }
I20260808 15:46:49.730916 12182 leader_election.cc:302] T 00000000000000000000000000000000 P 22634b73b38a4c05bf60c32d4e9c8268 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 22634b73b38a4c05bf60c32d4e9c8268; no voters:
I20260808 15:46:49.731262 12182 leader_election.cc:288] T 00000000000000000000000000000000 P 22634b73b38a4c05bf60c32d4e9c8268 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:46:49.731382 12187 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 22634b73b38a4c05bf60c32d4e9c8268 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:49.731593 12187 raft_consensus.cc:686] T 00000000000000000000000000000000 P 22634b73b38a4c05bf60c32d4e9c8268 [term 1 LEADER]: Becoming Leader. State: Replica: 22634b73b38a4c05bf60c32d4e9c8268, State: Running, Role: LEADER
I20260808 15:46:49.731892 12187 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22634b73b38a4c05bf60c32d4e9c8268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22634b73b38a4c05bf60c32d4e9c8268" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42303 } }
I20260808 15:46:49.732508 12182 sys_catalog.cc:564] T 00000000000000000000000000000000 P 22634b73b38a4c05bf60c32d4e9c8268 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:46:49.733078 12187 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22634b73b38a4c05bf60c32d4e9c8268 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22634b73b38a4c05bf60c32d4e9c8268. Latest consensus state: current_term: 1 leader_uuid: "22634b73b38a4c05bf60c32d4e9c8268" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22634b73b38a4c05bf60c32d4e9c8268" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42303 } } }
I20260808 15:46:49.733204 12187 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22634b73b38a4c05bf60c32d4e9c8268 [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:49.733711 12189 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22634b73b38a4c05bf60c32d4e9c8268 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "22634b73b38a4c05bf60c32d4e9c8268" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22634b73b38a4c05bf60c32d4e9c8268" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42303 } } }
I20260808 15:46:49.733882 12189 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22634b73b38a4c05bf60c32d4e9c8268 [sys.catalog]: This master's current role is: LEADER
W20260808 15:46:49.737931 12203 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 22634b73b38a4c05bf60c32d4e9c8268: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:46:49.738034 12203 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:46:49.738101 12192 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:46:49.739108 12192 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:46:49.745127 12192 catalog_manager.cc:1347] Generated new cluster ID: 75b732e7afbe4886a01f1b58047ccc6c
I20260808 15:46:49.745208 12192 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:46:49.755385 12192 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:46:49.756532 12192 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:46:49.768726 12192 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 22634b73b38a4c05bf60c32d4e9c8268: Generated new TSK 0
I20260808 15:46:49.769501 12192 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.39.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
I20260808 15:46:49.810776 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:0
--local_ip_for_outbound_sockets=127.8.39.65
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:42303
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:41027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:49.932569 12209 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:49.932847 12209 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:49.932891 12209 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:49.937248 12209 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:49.937316 12209 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:49.937376 12209 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:46:49.942915 12209 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:41027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:42303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12209
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:49.944070 12209 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:49.945075 12209 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:49.955022 12215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:49.955089 12218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:49.955022 12216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:49.955435 12209 server_base.cc:1034] running on GCE node
I20260808 15:46:49.955878 12209 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:49.956614 12209 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:49.957816 12209 hybrid_clock.cc:648] HybridClock initialized: now 1786204009957785 us; error 54 us; skew 500 ppm
Aug 08 15:46:49 dist-test-slave-8tdl krb5kdc[12094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204009, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:49.960704 12209 init.cc:377] Logged in from keytab as kudu/127.8.39.65@KRBTEST.COM (short username kudu)
I20260808 15:46:49.961650 12209 webserver.cc:460] Webserver started at http://127.8.39.65:45291/ using document root <none> and password file <none>
I20260808 15:46:49.962241 12209 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:49.962339 12209 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:49.962590 12209 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:49.964797 12209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-0/data/instance:
uuid: "307fdeae065a448c9f6ecfdec498ec32"
format_stamp: "Formatted at 2026-08-08 15:46:49 on dist-test-slave-8tdl"
server_key: "77ff0a05804eee1f52894a04eaac3c71"
server_key_iv: "740982efd693d1e3d2bf2ce578a381e4"
server_key_version: "encryptionkey@0"
I20260808 15:46:49.965440 12209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance:
uuid: "307fdeae065a448c9f6ecfdec498ec32"
format_stamp: "Formatted at 2026-08-08 15:46:49 on dist-test-slave-8tdl"
server_key: "77ff0a05804eee1f52894a04eaac3c71"
server_key_iv: "740982efd693d1e3d2bf2ce578a381e4"
server_key_version: "encryptionkey@0"
I20260808 15:46:49.969537 12209 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 15:46:49.972179 12225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:49.973439 12209 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:46:49.973588 12209 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "307fdeae065a448c9f6ecfdec498ec32"
format_stamp: "Formatted at 2026-08-08 15:46:49 on dist-test-slave-8tdl"
server_key: "77ff0a05804eee1f52894a04eaac3c71"
server_key_iv: "740982efd693d1e3d2bf2ce578a381e4"
server_key_version: "encryptionkey@0"
I20260808 15:46:49.973709 12209 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:49.997957 12209 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:50.001420 12209 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:50.001657 12209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:50.002354 12209 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:46:50.003353 12209 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:50.003429 12209 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:50.003504 12209 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:50.003556 12209 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:50.012861 12209 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:45299
I20260808 15:46:50.012885 12350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:45299 every 8 connection(s)
I20260808 15:46:50.013891 12209 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:46:50.019235 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 12209
I20260808 15:46:50.019342 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance
I20260808 15:46:50.019656 8349 external_mini_cluster.cc:1428] Setting key 5dd5202faa64c43578a3602ec086165b
Aug 08 15:46:50 dist-test-slave-8tdl krb5kdc[12094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204009, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:50.028975 12185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:50.015986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:57853 (local address 127.8.39.126:42303)
0808 15:46:50.016151 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:50.016155 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:50.016985 (+ 830us) server_negotiation.cc:407] Connection header received
0808 15:46:50.018462 (+ 1477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:50.018466 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:50.018526 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:50.018632 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:50.019950 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:50.020600 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:50.021768 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:50.022015 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:50.022134 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:50.024982 (+ 2848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:50.024985 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:50.024988 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:50.025020 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:50.026765 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:50.027312 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:50.027316 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:50.027318 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:50.027410 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:50.027770 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:50.027773 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:50.027775 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:50.028020 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:50.028133 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:50.028636 (+ 503us) server_negotiation.cc:299] Negotiation successful
0808 15:46:50.028783 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
WARNING: no policy specified for kudu/127.8.39.66@KRBTEST.COM; defaulting to no policy
I20260808 15:46:50.029830 12353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:50.016368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:42303 (local address 127.8.39.65:57853)
0808 15:46:50.016828 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:50.016871 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:50.018229 (+ 1358us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:50.018830 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:50.018836 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:50.019203 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:50.019797 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:50.019813 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:50.020738 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:50.020742 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:50.021633 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:50.021642 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:50.022178 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:50.022182 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:50.022358 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:50.023052 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:50.023069 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:50.024797 (+ 1728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:50.026910 (+ 2113us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:50.026916 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:50.026932 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:50.027200 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:50.027506 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:50.027510 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:50.027512 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:50.027664 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:50.028133 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:50.028140 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:50.028399 (+ 259us) client_negotiation.cc:769] Sending connection context
0808 15:46:50.028594 (+ 195us) client_negotiation.cc:240] Negotiation successful
0808 15:46:50.028933 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":126,"threads_started":1}
I20260808 15:46:50.031162 12351 heartbeater.cc:347] Connected to a master server at 127.8.39.126:42303
I20260808 15:46:50.031451 12351 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:50.031997 12351 heartbeater.cc:511] Master 127.8.39.126:42303 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.66@KRBTEST.COM" created.
I20260808 15:46:50.033950 12141 ts_manager.cc:194] Registered new tserver with Master: 307fdeae065a448c9f6ecfdec498ec32 (127.8.39.65:45299)
I20260808 15:46:50.035228 12141 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.65@KRBTEST.COM'} at 127.8.39.65:57853
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
I20260808 15:46:50.050514 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:0
--local_ip_for_outbound_sockets=127.8.39.66
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:42303
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:41027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:50.165807 12356 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:50.166106 12356 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:50.166152 12356 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:50.170436 12356 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:50.170526 12356 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:50.170625 12356 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:46:50.176311 12356 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:41027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:42303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12356
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:50.177583 12356 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:50.178714 12356 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:50.189052 12365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:50.189070 12363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:50.189153 12356 server_base.cc:1034] running on GCE node
W20260808 15:46:50.189054 12362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:50.189868 12356 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:50.190634 12356 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:50.191882 12356 hybrid_clock.cc:648] HybridClock initialized: now 1786204010191835 us; error 61 us; skew 500 ppm
Aug 08 15:46:50 dist-test-slave-8tdl krb5kdc[12094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204010, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:50.200568 12356 init.cc:377] Logged in from keytab as kudu/127.8.39.66@KRBTEST.COM (short username kudu)
I20260808 15:46:50.201671 12356 webserver.cc:460] Webserver started at http://127.8.39.66:36307/ using document root <none> and password file <none>
I20260808 15:46:50.202271 12356 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:50.202340 12356 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:50.202579 12356 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:50.204759 12356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-1/data/instance:
uuid: "86afd126dadc417d9c667fb3adead578"
format_stamp: "Formatted at 2026-08-08 15:46:50 on dist-test-slave-8tdl"
server_key: "d8b0ff1dea31d8ce2880ddf53aff7c65"
server_key_iv: "f6a50125f3288fdba470296064ef6b1e"
server_key_version: "encryptionkey@0"
I20260808 15:46:50.205430 12356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance:
uuid: "86afd126dadc417d9c667fb3adead578"
format_stamp: "Formatted at 2026-08-08 15:46:50 on dist-test-slave-8tdl"
server_key: "d8b0ff1dea31d8ce2880ddf53aff7c65"
server_key_iv: "f6a50125f3288fdba470296064ef6b1e"
server_key_version: "encryptionkey@0"
I20260808 15:46:50.210415 12356 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260808 15:46:50.212949 12372 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:50.214313 12356 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:46:50.214461 12356 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "86afd126dadc417d9c667fb3adead578"
format_stamp: "Formatted at 2026-08-08 15:46:50 on dist-test-slave-8tdl"
server_key: "d8b0ff1dea31d8ce2880ddf53aff7c65"
server_key_iv: "f6a50125f3288fdba470296064ef6b1e"
server_key_version: "encryptionkey@0"
I20260808 15:46:50.214596 12356 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:50.238427 12356 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:50.242059 12356 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:50.242291 12356 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:50.243103 12356 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:46:50.244081 12356 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:50.244134 12356 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:50.244176 12356 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:50.244197 12356 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:50.253731 12356 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:43467
I20260808 15:46:50.253748 12491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:43467 every 8 connection(s)
I20260808 15:46:50.254648 12356 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:46:50.258809 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 12356
I20260808 15:46:50.258930 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance
I20260808 15:46:50.259275 8349 external_mini_cluster.cc:1428] Setting key f29ad537c01bf2e402aaf7df10d5564f
Aug 08 15:46:50 dist-test-slave-8tdl krb5kdc[12094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204010, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.39.67@KRBTEST.COM; defaulting to no policy
I20260808 15:46:50.269531 12185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:50.256572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:42881 (local address 127.8.39.126:42303)
0808 15:46:50.256711 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:50.256715 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:50.257513 (+ 798us) server_negotiation.cc:407] Connection header received
0808 15:46:50.259101 (+ 1588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:50.259104 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:50.259156 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:50.259234 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:50.260675 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:50.261251 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:50.262438 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:50.262741 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:50.262862 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:50.265654 (+ 2792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:50.265658 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:50.265660 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:50.265684 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:50.267216 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:50.267772 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:50.267776 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:50.267777 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:50.267855 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:50.268229 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:50.268234 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:50.268236 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:50.268505 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:50.268621 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:50.269212 (+ 591us) server_negotiation.cc:299] Negotiation successful
0808 15:46:50.269346 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 15:46:50.270473 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:50.256881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:42303 (local address 127.8.39.66:42881)
0808 15:46:50.257341 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:50.257383 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:50.258829 (+ 1446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:50.259447 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:50.259456 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:50.259888 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:50.260518 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:50.260537 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:50.261396 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:50.261399 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:50.262295 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:50.262304 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:50.262904 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:50.262908 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:50.263087 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:50.263751 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:50.263767 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:50.265474 (+ 1707us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:50.267347 (+ 1873us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:50.267353 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:50.267369 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:50.267645 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:50.267968 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:50.267971 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:50.267973 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:50.268126 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:50.268620 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:50.268628 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:50.268933 (+ 305us) client_negotiation.cc:769] Sending connection context
0808 15:46:50.269171 (+ 238us) client_negotiation.cc:240] Negotiation successful
0808 15:46:50.269509 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":133,"threads_started":1}
I20260808 15:46:50.271750 12492 heartbeater.cc:347] Connected to a master server at 127.8.39.126:42303
I20260808 15:46:50.272063 12492 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.67@KRBTEST.COM" created.
I20260808 15:46:50.272624 12492 heartbeater.cc:511] Master 127.8.39.126:42303 requested a full tablet report, sending...
I20260808 15:46:50.273764 12141 ts_manager.cc:194] Registered new tserver with Master: 86afd126dadc417d9c667fb3adead578 (127.8.39.66:43467)
I20260808 15:46:50.274480 12141 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.66@KRBTEST.COM'} at 127.8.39.66:42881
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
I20260808 15:46:50.291040 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:0
--local_ip_for_outbound_sockets=127.8.39.67
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:42303
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:41027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:50.412160 12497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:50.412432 12497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:50.412480 12497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:50.417024 12497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:50.417096 12497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:50.417186 12497 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:46:50.422889 12497 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:41027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:42303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12497
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:50.423972 12497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:50.425015 12497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:50.434798 12503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:50.434763 12504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:50.435039 12497 server_base.cc:1034] running on GCE node
W20260808 15:46:50.434748 12506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:50.435537 12497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:50.436232 12497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:50.437443 12497 hybrid_clock.cc:648] HybridClock initialized: now 1786204010437419 us; error 32 us; skew 500 ppm
Aug 08 15:46:50 dist-test-slave-8tdl krb5kdc[12094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204010, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:50.444264 12497 init.cc:377] Logged in from keytab as kudu/127.8.39.67@KRBTEST.COM (short username kudu)
I20260808 15:46:50.445196 12497 webserver.cc:460] Webserver started at http://127.8.39.67:39909/ using document root <none> and password file <none>
I20260808 15:46:50.445739 12497 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:50.445801 12497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:50.445981 12497 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:50.448182 12497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-2/data/instance:
uuid: "b76478866e8d4c21aa17ad94acd90ad2"
format_stamp: "Formatted at 2026-08-08 15:46:50 on dist-test-slave-8tdl"
server_key: "f0911e27536962e3c4f5ffd530a02024"
server_key_iv: "b667492744a6c0be4cd0c9665a1ad080"
server_key_version: "encryptionkey@0"
I20260808 15:46:50.448710 12497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance:
uuid: "b76478866e8d4c21aa17ad94acd90ad2"
format_stamp: "Formatted at 2026-08-08 15:46:50 on dist-test-slave-8tdl"
server_key: "f0911e27536962e3c4f5ffd530a02024"
server_key_iv: "b667492744a6c0be4cd0c9665a1ad080"
server_key_version: "encryptionkey@0"
I20260808 15:46:50.452630 12497 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 15:46:50.455790 12513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:50.457513 12497 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 15:46:50.457682 12497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "b76478866e8d4c21aa17ad94acd90ad2"
format_stamp: "Formatted at 2026-08-08 15:46:50 on dist-test-slave-8tdl"
server_key: "f0911e27536962e3c4f5ffd530a02024"
server_key_iv: "b667492744a6c0be4cd0c9665a1ad080"
server_key_version: "encryptionkey@0"
I20260808 15:46:50.457808 12497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:50.475172 12497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:50.480062 12497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:50.480319 12497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:50.481072 12497 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:46:50.482179 12497 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:50.482252 12497 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:50.482323 12497 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:50.482357 12497 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:50.494894 12497 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:42559
I20260808 15:46:50.494918 12633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:42559 every 8 connection(s)
I20260808 15:46:50.496097 12497 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:46:50.499001 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 12497
I20260808 15:46:50.499157 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance
I20260808 15:46:50.499516 8349 external_mini_cluster.cc:1428] Setting key dabb340d794348c9eedfd5ff1a8a0a0e
Aug 08 15:46:50 dist-test-slave-8tdl krb5kdc[12094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204010, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:50.514019 12185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:50.498367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:45057 (local address 127.8.39.126:42303)
0808 15:46:50.498532 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:50.498537 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:50.499687 (+ 1150us) server_negotiation.cc:407] Connection header received
0808 15:46:50.501574 (+ 1887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:50.501578 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:50.501650 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:50.501733 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:50.503171 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:50.503718 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:50.504969 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:50.505272 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:50.505371 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:50.509000 (+ 3629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:50.509004 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:50.509010 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:50.509044 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:50.511145 (+ 2101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:50.511870 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:50.511873 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:50.511889 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:50.511991 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:50.512600 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:50.512603 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:50.512605 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:50.512856 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:50.512961 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:50.513700 (+ 739us) server_negotiation.cc:299] Negotiation successful
0808 15:46:50.513841 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 15:46:50.515210 12636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:50.498913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:42303 (local address 127.8.39.67:45057)
0808 15:46:50.499498 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:50.499560 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:50.501251 (+ 1691us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:50.502059 (+ 808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:50.502066 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:50.502431 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:50.503022 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:50.503036 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:50.503848 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:50.503852 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:50.504843 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:50.504853 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:50.505562 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:50.505568 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:50.505789 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:50.506567 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:50.506595 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:50.508778 (+ 2183us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:50.511332 (+ 2554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:50.511340 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:50.511358 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:50.511754 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:50.512090 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:50.512093 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:50.512095 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:50.512487 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:50.513023 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:50.513030 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:50.513404 (+ 374us) client_negotiation.cc:769] Sending connection context
0808 15:46:50.513617 (+ 213us) client_negotiation.cc:240] Negotiation successful
0808 15:46:50.514045 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":157,"threads_started":1}
I20260808 15:46:50.516456 12634 heartbeater.cc:347] Connected to a master server at 127.8.39.126:42303
I20260808 15:46:50.516709 12634 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:50.517277 12634 heartbeater.cc:511] Master 127.8.39.126:42303 requested a full tablet report, sending...
I20260808 15:46:50.518362 12141 ts_manager.cc:194] Registered new tserver with Master: b76478866e8d4c21aa17ad94acd90ad2 (127.8.39.67:42559)
I20260808 15:46:50.519102 12141 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.67@KRBTEST.COM'} at 127.8.39.67:45057
I20260808 15:46:50.525666 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 15:46:50 dist-test-slave-8tdl krb5kdc[12094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 15:46:50 dist-test-slave-8tdl krb5kdc[12094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.65@KRBTEST.COM
I20260808 15:46:50.554103 12642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:50.544204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43942 (local address 127.8.39.65:45299)
0808 15:46:50.544614 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:50.544625 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:50.544655 (+ 30us) server_negotiation.cc:407] Connection header received
0808 15:46:50.544721 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:50.544726 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:50.544927 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:50.545060 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:50.545892 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:50.546767 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:50.547660 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:50.548159 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:50.548268 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:50.550788 (+ 2520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:50.550798 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:50.550812 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:50.550838 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:50.552412 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:50.552824 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:50.552829 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:50.552831 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:50.552909 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:50.553154 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:50.553157 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:50.553158 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:50.553397 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:50.553561 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:50.553798 (+ 237us) server_negotiation.cc:299] Negotiation successful
0808 15:46:50.553923 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":114,"threads_started":1}
Aug 08 15:46:50 dist-test-slave-8tdl krb5kdc[12094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:50.565776 12185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:50.557300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33400 (local address 127.8.39.126:42303)
0808 15:46:50.557541 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:50.557546 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:50.557612 (+ 66us) server_negotiation.cc:407] Connection header received
0808 15:46:50.557780 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:50.557782 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:50.557823 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:50.557906 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:50.558514 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:50.559104 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:50.559874 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:50.560101 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:50.560211 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:50.562500 (+ 2289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:50.562503 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:50.562505 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:50.562528 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:50.564043 (+ 1515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:50.564469 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:50.564474 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:50.564476 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:50.564560 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:50.564846 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:50.564849 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:50.564851 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:50.565072 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:50.565212 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:50.565471 (+ 259us) server_negotiation.cc:299] Negotiation successful
0808 15:46:50.565604 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154}
W20260808 15:46:50.566185 12141 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33400
I20260808 15:46:50.566890 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 12209
I20260808 15:46:50.575902 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 12356
I20260808 15:46:50.582429 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 12497
I20260808 15:46:50.588680 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 12107
2026-08-08T15:46:50Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2274 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:46:50 dist-test-slave-8tdl krb5kdc[12647](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:46:50 dist-test-slave-8tdl krb5kdc[12647](info): set up 2 sockets
Aug 08 15:46:50 dist-test-slave-8tdl krb5kdc[12647](info): commencing operation
krb5kdc: starting...
W20260808 15:46:51.680023 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.067s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:46:51 dist-test-slave-8tdl krb5kdc[12647](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204011, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:46:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:46:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:46:51.821501 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:34351
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:40553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:34351
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:51.938547 12661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:51.938845 12661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:51.938899 12661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:51.942890 12661 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:46:51.942946 12661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:51.942966 12661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:51.942983 12661 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:46:51.942998 12661 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:46:51.948487 12661 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:40553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:34351
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:34351
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12661
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:51.949524 12661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:51.950497 12661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:51.958956 12670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:51.958930 12666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:51.958963 12667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:51.959321 12661 server_base.cc:1034] running on GCE node
I20260808 15:46:51.959854 12661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:51.961040 12661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:51.962241 12661 hybrid_clock.cc:648] HybridClock initialized: now 1786204011962225 us; error 31 us; skew 500 ppm
Aug 08 15:46:51 dist-test-slave-8tdl krb5kdc[12647](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204011, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:51.965142 12661 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:46:51.965835 12661 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:51.965899 12661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:51.966069 12661 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:51.968204 12661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "39081855aa8b406ca207595d9726af1d"
format_stamp: "Formatted at 2026-08-08 15:46:51 on dist-test-slave-8tdl"
server_key: "5daff5b32eefede9d6b099e8cada76a6"
server_key_iv: "758d9ad7c19a7fca43a68c3a34ec037e"
server_key_version: "encryptionkey@0"
I20260808 15:46:51.968720 12661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "39081855aa8b406ca207595d9726af1d"
format_stamp: "Formatted at 2026-08-08 15:46:51 on dist-test-slave-8tdl"
server_key: "5daff5b32eefede9d6b099e8cada76a6"
server_key_iv: "758d9ad7c19a7fca43a68c3a34ec037e"
server_key_version: "encryptionkey@0"
I20260808 15:46:51.972473 12661 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 15:46:51.974887 12676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:51.976106 12661 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:46:51.976233 12661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "39081855aa8b406ca207595d9726af1d"
format_stamp: "Formatted at 2026-08-08 15:46:51 on dist-test-slave-8tdl"
server_key: "5daff5b32eefede9d6b099e8cada76a6"
server_key_iv: "758d9ad7c19a7fca43a68c3a34ec037e"
server_key_version: "encryptionkey@0"
I20260808 15:46:51.976337 12661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:51.991122 12661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:51.994385 12661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:51.994619 12661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:52.001969 12661 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:34351
I20260808 15:46:52.002256 12730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:34351 every 8 connection(s)
I20260808 15:46:52.002770 12661 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:46:52.005731 12731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:52.008896 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 12661
I20260808 15:46:52.009054 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:46:52.009403 8349 external_mini_cluster.cc:1428] Setting key 7785df9904c5c7c3fc9ab3c2e0f05c8c
I20260808 15:46:52.012916 12731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39081855aa8b406ca207595d9726af1d: Bootstrap starting.
I20260808 15:46:52.015424 12731 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 39081855aa8b406ca207595d9726af1d: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:52.016238 12731 log.cc:824] T 00000000000000000000000000000000 P 39081855aa8b406ca207595d9726af1d: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:52.018596 12731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39081855aa8b406ca207595d9726af1d: No bootstrap required, opened a new log
Aug 08 15:46:52 dist-test-slave-8tdl krb5kdc[12647](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204011, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:52.023435 12731 raft_consensus.cc:348] T 00000000000000000000000000000000 P 39081855aa8b406ca207595d9726af1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39081855aa8b406ca207595d9726af1d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 34351 } }
I20260808 15:46:52.023738 12731 raft_consensus.cc:374] T 00000000000000000000000000000000 P 39081855aa8b406ca207595d9726af1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:52.023835 12731 raft_consensus.cc:729] T 00000000000000000000000000000000 P 39081855aa8b406ca207595d9726af1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39081855aa8b406ca207595d9726af1d, State: Initialized, Role: FOLLOWER
I20260808 15:46:52.024339 12731 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39081855aa8b406ca207595d9726af1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39081855aa8b406ca207595d9726af1d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 34351 } }
I20260808 15:46:52.024510 12731 raft_consensus.cc:388] T 00000000000000000000000000000000 P 39081855aa8b406ca207595d9726af1d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:46:52.024593 12731 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39081855aa8b406ca207595d9726af1d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:46:52.024679 12731 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 39081855aa8b406ca207595d9726af1d [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:52.025179 12734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:52.011136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41680 (local address 127.8.39.126:34351)
0808 15:46:52.011671 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:52.011686 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:52.011723 (+ 37us) server_negotiation.cc:407] Connection header received
0808 15:46:52.012357 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:52.012374 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:52.012721 (+ 347us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:52.013167 (+ 446us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:52.014003 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.015079 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.016038 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.016551 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.016725 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:52.019683 (+ 2958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:52.019689 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:52.019706 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:52.019738 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:52.021929 (+ 2191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:52.022405 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:52.022411 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:52.022417 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:52.022559 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:52.022909 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:52.022912 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:52.022914 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:52.023419 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:52.023628 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:52.023855 (+ 227us) server_negotiation.cc:299] Negotiation successful
0808 15:46:52.024165 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":142,"threads_started":1}
I20260808 15:46:52.025858 12731 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39081855aa8b406ca207595d9726af1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39081855aa8b406ca207595d9726af1d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 34351 } }
I20260808 15:46:52.026198 12731 leader_election.cc:302] T 00000000000000000000000000000000 P 39081855aa8b406ca207595d9726af1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 39081855aa8b406ca207595d9726af1d; no voters:
I20260808 15:46:52.026543 12731 leader_election.cc:288] T 00000000000000000000000000000000 P 39081855aa8b406ca207595d9726af1d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:46:52.026700 12736 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 39081855aa8b406ca207595d9726af1d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:52.026927 12736 raft_consensus.cc:686] T 00000000000000000000000000000000 P 39081855aa8b406ca207595d9726af1d [term 1 LEADER]: Becoming Leader. State: Replica: 39081855aa8b406ca207595d9726af1d, State: Running, Role: LEADER
I20260808 15:46:52.027340 12736 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39081855aa8b406ca207595d9726af1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39081855aa8b406ca207595d9726af1d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 34351 } }
I20260808 15:46:52.027791 12731 sys_catalog.cc:564] T 00000000000000000000000000000000 P 39081855aa8b406ca207595d9726af1d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:46:52.029069 12737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39081855aa8b406ca207595d9726af1d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "39081855aa8b406ca207595d9726af1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39081855aa8b406ca207595d9726af1d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 34351 } } }
I20260808 15:46:52.029213 12737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39081855aa8b406ca207595d9726af1d [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:52.029608 12738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39081855aa8b406ca207595d9726af1d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39081855aa8b406ca207595d9726af1d. Latest consensus state: current_term: 1 leader_uuid: "39081855aa8b406ca207595d9726af1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39081855aa8b406ca207595d9726af1d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 34351 } } }
I20260808 15:46:52.029731 12738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39081855aa8b406ca207595d9726af1d [sys.catalog]: This master's current role is: LEADER
W20260808 15:46:52.032657 12752 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 39081855aa8b406ca207595d9726af1d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:46:52.032755 12752 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:46:52.032843 12747 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:46:52.033717 12747 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:46:52.039762 12747 catalog_manager.cc:1347] Generated new cluster ID: 26a1da2baf7b486381377c3e420cbf6d
I20260808 15:46:52.039835 12747 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:46:52.059394 12747 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:46:52.060508 12747 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:46:52.069053 12747 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 39081855aa8b406ca207595d9726af1d: Generated new TSK 0
I20260808 15:46:52.069819 12747 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.39.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
I20260808 15:46:52.109294 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:0
--local_ip_for_outbound_sockets=127.8.39.65
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:34351
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:40553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:52.234297 12759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:52.234572 12759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:52.234649 12759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:52.238853 12759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:52.238917 12759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:52.238981 12759 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:46:52.244469 12759 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:40553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:34351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12759
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:52.245626 12759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:52.246971 12759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 15:46:52.256757 12759 server_base.cc:1034] running on GCE node
W20260808 15:46:52.256740 12764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:52.256960 12767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:52.256737 12765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:52.257534 12759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:52.258122 12759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:52.259316 12759 hybrid_clock.cc:648] HybridClock initialized: now 1786204012259283 us; error 46 us; skew 500 ppm
Aug 08 15:46:52 dist-test-slave-8tdl krb5kdc[12647](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204012, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:52.262589 12759 init.cc:377] Logged in from keytab as kudu/127.8.39.65@KRBTEST.COM (short username kudu)
I20260808 15:46:52.263422 12759 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:52.263499 12759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:52.263677 12759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:52.265925 12759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-0/data/instance:
uuid: "76ff9c8838d3417aa5803d6853b9c7f3"
format_stamp: "Formatted at 2026-08-08 15:46:52 on dist-test-slave-8tdl"
server_key: "fb1d9d928882b12f5aaf30ed843f0ce2"
server_key_iv: "bab76e4fac462d39f1e6583f07550c4c"
server_key_version: "encryptionkey@0"
I20260808 15:46:52.266513 12759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance:
uuid: "76ff9c8838d3417aa5803d6853b9c7f3"
format_stamp: "Formatted at 2026-08-08 15:46:52 on dist-test-slave-8tdl"
server_key: "fb1d9d928882b12f5aaf30ed843f0ce2"
server_key_iv: "bab76e4fac462d39f1e6583f07550c4c"
server_key_version: "encryptionkey@0"
I20260808 15:46:52.270577 12759 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 15:46:52.273303 12773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:52.274876 12759 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:46:52.275015 12759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "76ff9c8838d3417aa5803d6853b9c7f3"
format_stamp: "Formatted at 2026-08-08 15:46:52 on dist-test-slave-8tdl"
server_key: "fb1d9d928882b12f5aaf30ed843f0ce2"
server_key_iv: "bab76e4fac462d39f1e6583f07550c4c"
server_key_version: "encryptionkey@0"
I20260808 15:46:52.275128 12759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:52.305317 12759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:52.309096 12759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:52.309337 12759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:52.310034 12759 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:46:52.311040 12759 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:52.311105 12759 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:52.311174 12759 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:52.311210 12759 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:52.321352 12759 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:39291
I20260808 15:46:52.321377 12890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:39291 every 8 connection(s)
I20260808 15:46:52.322024 12759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:46:52.327772 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 12759
I20260808 15:46:52.327925 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance
I20260808 15:46:52.328289 8349 external_mini_cluster.cc:1428] Setting key d137b7b8a2a89b0570851ac7ae1526c8
Aug 08 15:46:52 dist-test-slave-8tdl krb5kdc[12647](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204012, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:52.338752 12734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:52.324029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:35593 (local address 127.8.39.126:34351)
0808 15:46:52.324175 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:52.324179 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:52.324983 (+ 804us) server_negotiation.cc:407] Connection header received
0808 15:46:52.326242 (+ 1259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:52.326245 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:52.326301 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:52.326391 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:52.328098 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.328911 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.330765 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.331184 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.331315 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:52.334430 (+ 3115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:52.334434 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:52.334437 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:52.334470 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:52.336334 (+ 1864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:52.336931 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:52.336936 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:52.336939 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:52.337037 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:52.337438 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:52.337443 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:52.337445 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:52.337660 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:52.337791 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:52.338339 (+ 548us) server_negotiation.cc:299] Negotiation successful
0808 15:46:52.338530 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
WARNING: no policy specified for kudu/127.8.39.66@KRBTEST.COM; defaulting to no policy
I20260808 15:46:52.339665 12893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:52.324302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:34351 (local address 127.8.39.65:35593)
0808 15:46:52.324777 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:52.324820 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:52.326005 (+ 1185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:52.326749 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:52.326766 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:52.327281 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:52.327882 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:52.327897 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.329118 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.329121 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:52.330584 (+ 1463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:52.330600 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.331377 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.331381 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:52.331548 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:52.332283 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:52.332313 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:52.334221 (+ 1908us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:52.336480 (+ 2259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:52.336488 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:52.336505 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:52.336808 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:52.337151 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:52.337154 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:52.337157 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:52.337321 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:52.337783 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:52.337791 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:52.338078 (+ 287us) client_negotiation.cc:769] Sending connection context
0808 15:46:52.338291 (+ 213us) client_negotiation.cc:240] Negotiation successful
0808 15:46:52.338733 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":115,"threads_started":1}
I20260808 15:46:52.341094 12891 heartbeater.cc:347] Connected to a master server at 127.8.39.126:34351
I20260808 15:46:52.341398 12891 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:52.342031 12891 heartbeater.cc:511] Master 127.8.39.126:34351 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.66@KRBTEST.COM" created.
I20260808 15:46:52.343761 12695 ts_manager.cc:194] Registered new tserver with Master: 76ff9c8838d3417aa5803d6853b9c7f3 (127.8.39.65:39291)
I20260808 15:46:52.344897 12695 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.65@KRBTEST.COM'} at 127.8.39.65:35593
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
I20260808 15:46:52.359548 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:0
--local_ip_for_outbound_sockets=127.8.39.66
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:34351
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:40553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:52.473250 12897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:52.473585 12897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:52.473662 12897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:52.477952 12897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:52.478075 12897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:52.478191 12897 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:46:52.484090 12897 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:40553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:34351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12897
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:52.485257 12897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:52.486340 12897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:52.495962 12902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:52.496057 12897 server_base.cc:1034] running on GCE node
W20260808 15:46:52.495997 12906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:52.495973 12904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:52.496680 12897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:52.497409 12897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:52.498618 12897 hybrid_clock.cc:648] HybridClock initialized: now 1786204012498603 us; error 29 us; skew 500 ppm
Aug 08 15:46:52 dist-test-slave-8tdl krb5kdc[12647](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204012, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:52.501535 12897 init.cc:377] Logged in from keytab as kudu/127.8.39.66@KRBTEST.COM (short username kudu)
I20260808 15:46:52.502511 12897 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:52.502638 12897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:52.502928 12897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:52.505066 12897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-1/data/instance:
uuid: "58a16906b80c4c09a474c21bf4c093e7"
format_stamp: "Formatted at 2026-08-08 15:46:52 on dist-test-slave-8tdl"
server_key: "c7cdf2d6013bc28d78248324da66acde"
server_key_iv: "0a715baab11b015b4df2a8abd84b5e95"
server_key_version: "encryptionkey@0"
I20260808 15:46:52.505652 12897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance:
uuid: "58a16906b80c4c09a474c21bf4c093e7"
format_stamp: "Formatted at 2026-08-08 15:46:52 on dist-test-slave-8tdl"
server_key: "c7cdf2d6013bc28d78248324da66acde"
server_key_iv: "0a715baab11b015b4df2a8abd84b5e95"
server_key_version: "encryptionkey@0"
I20260808 15:46:52.509445 12897 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 15:46:52.511965 12912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:52.513258 12897 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:46:52.513396 12897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "58a16906b80c4c09a474c21bf4c093e7"
format_stamp: "Formatted at 2026-08-08 15:46:52 on dist-test-slave-8tdl"
server_key: "c7cdf2d6013bc28d78248324da66acde"
server_key_iv: "0a715baab11b015b4df2a8abd84b5e95"
server_key_version: "encryptionkey@0"
I20260808 15:46:52.513516 12897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:52.532433 12897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:52.535516 12897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:52.535722 12897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:52.536320 12897 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:46:52.537160 12897 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:52.537232 12897 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:52.537303 12897 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:52.537354 12897 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:52.546764 12897 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:39913
I20260808 15:46:52.546866 13030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:39913 every 8 connection(s)
I20260808 15:46:52.547439 12897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:46:52.557171 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 12897
I20260808 15:46:52.557307 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance
Aug 08 15:46:52 dist-test-slave-8tdl krb5kdc[12647](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204012, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:52.557646 8349 external_mini_cluster.cc:1428] Setting key ede7d8fc2b11e8a7520ea90ef04c86f4
I20260808 15:46:52.562188 12734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:52.549308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:54537 (local address 127.8.39.126:34351)
0808 15:46:52.549505 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:52.549509 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:52.550301 (+ 792us) server_negotiation.cc:407] Connection header received
0808 15:46:52.551743 (+ 1442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:52.551746 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:52.551809 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:52.551933 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:52.553122 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.553675 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.554908 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.555148 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.555256 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:52.558219 (+ 2963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:52.558224 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:52.558227 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:52.558259 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:52.559756 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:52.560408 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:52.560410 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:52.560411 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:52.560486 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:52.560875 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:52.560877 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:52.560878 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:52.561053 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:52.561129 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:52.561794 (+ 665us) server_negotiation.cc:299] Negotiation successful
0808 15:46:52.561946 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260808 15:46:52.562922 13033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:52.549664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:34351 (local address 127.8.39.66:54537)
0808 15:46:52.550132 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:52.550176 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:52.551521 (+ 1345us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:52.552104 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:52.552114 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:52.552481 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:52.552969 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:52.552982 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.553808 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.553818 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:52.554770 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:52.554780 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.555314 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.555318 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:52.555497 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:52.556133 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:52.556149 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:52.558013 (+ 1864us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:52.559877 (+ 1864us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:52.559887 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:52.559905 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:52.560306 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:52.560577 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:52.560583 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:52.560588 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:52.560782 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:52.561156 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:52.561165 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:52.561523 (+ 358us) client_negotiation.cc:769] Sending connection context
0808 15:46:52.561708 (+ 185us) client_negotiation.cc:240] Negotiation successful
0808 15:46:52.561972 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":125,"threads_started":1}
I20260808 15:46:52.564105 13031 heartbeater.cc:347] Connected to a master server at 127.8.39.126:34351
I20260808 15:46:52.564373 13031 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:52.564942 13031 heartbeater.cc:511] Master 127.8.39.126:34351 requested a full tablet report, sending...
I20260808 15:46:52.566071 12695 ts_manager.cc:194] Registered new tserver with Master: 58a16906b80c4c09a474c21bf4c093e7 (127.8.39.66:39913)
I20260808 15:46:52.566653 12695 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.66@KRBTEST.COM'} at 127.8.39.66:54537
WARNING: no policy specified for kudu/127.8.39.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
I20260808 15:46:52.588024 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:0
--local_ip_for_outbound_sockets=127.8.39.67
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:34351
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:40553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:52.702633 13036 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:52.703015 13036 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:52.703123 13036 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:52.707240 13036 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:52.707321 13036 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:52.707407 13036 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:46:52.712752 13036 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:40553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:34351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13036
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:52.713884 13036 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:52.714959 13036 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:52.724807 13043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:52.724795 13042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:52.724855 13036 server_base.cc:1034] running on GCE node
W20260808 15:46:52.724795 13046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:52.725689 13036 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:52.726506 13036 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:52.727690 13036 hybrid_clock.cc:648] HybridClock initialized: now 1786204012727674 us; error 31 us; skew 500 ppm
Aug 08 15:46:52 dist-test-slave-8tdl krb5kdc[12647](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204012, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:52.730561 13036 init.cc:377] Logged in from keytab as kudu/127.8.39.67@KRBTEST.COM (short username kudu)
I20260808 15:46:52.731353 13036 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:52.731418 13036 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:52.731590 13036 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:52.733598 13036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-2/data/instance:
uuid: "d0ea979d9ac948f98901d4b4c887f847"
format_stamp: "Formatted at 2026-08-08 15:46:52 on dist-test-slave-8tdl"
server_key: "f4aa2a397a76d343fb37e568a98d3a79"
server_key_iv: "200bea4df54d5fb59bbbe1b3e32f722c"
server_key_version: "encryptionkey@0"
I20260808 15:46:52.734148 13036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance:
uuid: "d0ea979d9ac948f98901d4b4c887f847"
format_stamp: "Formatted at 2026-08-08 15:46:52 on dist-test-slave-8tdl"
server_key: "f4aa2a397a76d343fb37e568a98d3a79"
server_key_iv: "200bea4df54d5fb59bbbe1b3e32f722c"
server_key_version: "encryptionkey@0"
I20260808 15:46:52.737962 13036 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 15:46:52.740535 13052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:52.741799 13036 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:46:52.741899 13036 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "d0ea979d9ac948f98901d4b4c887f847"
format_stamp: "Formatted at 2026-08-08 15:46:52 on dist-test-slave-8tdl"
server_key: "f4aa2a397a76d343fb37e568a98d3a79"
server_key_iv: "200bea4df54d5fb59bbbe1b3e32f722c"
server_key_version: "encryptionkey@0"
I20260808 15:46:52.741986 13036 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:52.756704 13036 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:52.760243 13036 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:52.760418 13036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:52.760965 13036 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:46:52.761780 13036 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:52.761838 13036 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:52.761879 13036 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:52.761902 13036 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:52.771628 13036 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:34099
I20260808 15:46:52.771646 13172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:34099 every 8 connection(s)
I20260808 15:46:52.772274 13036 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:46:52.775475 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 13036
I20260808 15:46:52.775635 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance
I20260808 15:46:52.776057 8349 external_mini_cluster.cc:1428] Setting key de800013505cf969d11dcf4283a71053
Aug 08 15:46:52 dist-test-slave-8tdl krb5kdc[12647](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204012, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:52.786609 12734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:52.774089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:44935 (local address 127.8.39.126:34351)
0808 15:46:52.774281 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:52.774286 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:52.775198 (+ 912us) server_negotiation.cc:407] Connection header received
0808 15:46:52.777020 (+ 1822us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:52.777023 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:52.777084 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:52.777180 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:52.778626 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.779266 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.780516 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.780745 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.780822 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:52.783189 (+ 2367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:52.783191 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:52.783193 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:52.783218 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:52.784699 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:52.785184 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:52.785187 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:52.785188 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:52.785266 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:52.785621 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:52.785623 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:52.785624 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:52.785792 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:52.785866 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:52.786351 (+ 485us) server_negotiation.cc:299] Negotiation successful
0808 15:46:52.786461 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 15:46:52.787467 13175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:52.774426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:34351 (local address 127.8.39.67:44935)
0808 15:46:52.775032 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:52.775078 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:52.776726 (+ 1648us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:52.777384 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:52.777402 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:52.777855 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:52.778489 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:52.778506 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.779431 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.779433 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:52.780389 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:52.780401 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.780861 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.780864 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:52.781009 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:52.781536 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:52.781552 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:52.783033 (+ 1481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:52.784806 (+ 1773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:52.784811 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:52.784823 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:52.785096 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:52.785386 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:52.785389 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:52.785390 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:52.785533 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:52.785897 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:52.785903 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:52.786135 (+ 232us) client_negotiation.cc:769] Sending connection context
0808 15:46:52.786294 (+ 159us) client_negotiation.cc:240] Negotiation successful
0808 15:46:52.786577 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":124,"threads_started":1}
I20260808 15:46:52.788908 13173 heartbeater.cc:347] Connected to a master server at 127.8.39.126:34351
I20260808 15:46:52.789158 13173 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:52.789750 13173 heartbeater.cc:511] Master 127.8.39.126:34351 requested a full tablet report, sending...
I20260808 15:46:52.790771 12695 ts_manager.cc:194] Registered new tserver with Master: d0ea979d9ac948f98901d4b4c887f847 (127.8.39.67:34099)
I20260808 15:46:52.791368 12695 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.67@KRBTEST.COM'} at 127.8.39.67:44935
I20260808 15:46:52.802502 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:46:52.812664 12734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:52.804707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41686 (local address 127.8.39.126:34351)
0808 15:46:52.804947 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:52.804952 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:52.805075 (+ 123us) server_negotiation.cc:407] Connection header received
0808 15:46:52.805237 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:52.805241 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:52.805292 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:52.805388 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:52.806138 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.806661 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.807592 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.807810 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.807927 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:52.809454 (+ 1527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:52.809458 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:52.809460 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:52.809483 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:52.810964 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:52.811399 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:52.811403 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:52.811405 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:52.811486 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:52.811760 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:52.811764 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:52.811766 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:52.811998 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:52.812141 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:52.812374 (+ 233us) server_negotiation.cc:299] Negotiation successful
0808 15:46:52.812492 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 15:46:52.815757 12695 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41686:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:46:52.819088 12695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:46:52.834354 13184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:52.828011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:39913 (local address 127.0.0.1:48166)
0808 15:46:52.828590 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:52.828644 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:52.828779 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:52.829743 (+ 964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:52.829746 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:52.829774 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:46:52.830014 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:52.830020 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.831470 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.831473 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:52.832761 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:52.832772 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.833693 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.833697 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:52.833889 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:52.833944 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 15:46:52.834062 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 15:46:52.834182 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":406,"mutex_wait_us":195,"spinlock_wait_cycles":896,"thread_start_us":68,"threads_started":1}
I20260808 15:46:52.834348 13187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:52.828168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48166 (local address 127.8.39.66:39913)
0808 15:46:52.829135 (+ 967us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:52.829150 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:52.829178 (+ 28us) server_negotiation.cc:407] Connection header received
0808 15:46:52.829258 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:52.829263 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:52.829529 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:52.829922 (+ 393us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:46:52.830104 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.831332 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.832897 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.833566 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.833690 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:52.833843 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:52.834100 (+ 257us) server_negotiation.cc:299] Negotiation successful
0808 15:46:52.834193 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":862,"thread_start_us":177,"threads_started":1}
I20260808 15:46:52.834412 13190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:52.829334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34068 (local address 127.8.39.65:39291)
0808 15:46:52.829666 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:52.829674 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:52.829696 (+ 22us) server_negotiation.cc:407] Connection header received
0808 15:46:52.829768 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:52.829773 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:52.829954 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:52.830362 (+ 408us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:46:52.830518 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.831615 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.832913 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.833565 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.833696 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:52.833850 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:52.834159 (+ 309us) server_negotiation.cc:299] Negotiation successful
0808 15:46:52.834253 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":99,"threads_started":1}
I20260808 15:46:52.834749 13189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:52.828901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:39291 (local address 127.0.0.1:34068)
0808 15:46:52.829258 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:52.829282 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:52.829364 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:52.830113 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:52.830116 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:52.830135 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:46:52.830221 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:52.830227 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.831744 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.831748 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:52.832688 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:52.832709 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.833697 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.833700 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:52.833925 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:52.833950 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 15:46:52.834045 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 15:46:52.834591 (+ 546us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":482,"thread_start_us":105,"threads_started":1}
I20260808 15:46:52.835841 13185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:52.828196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:34099 (local address 127.0.0.1:54342)
0808 15:46:52.828754 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:52.828770 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:52.828865 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:52.829679 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:52.829685 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:52.829711 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:46:52.829902 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:52.829910 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.831274 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.831281 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:52.832765 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:52.832772 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.835449 (+ 2677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.835452 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:52.835570 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:52.835593 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 15:46:52.835648 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 15:46:52.835716 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"mutex_wait_us":66,"thread_start_us":115,"threads_started":1}
I20260808 15:46:52.836448 13188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:52.828832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54342 (local address 127.8.39.67:34099)
0808 15:46:52.829171 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:52.829182 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:52.829207 (+ 25us) server_negotiation.cc:407] Connection header received
0808 15:46:52.829291 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:52.829296 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:52.829500 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:52.830190 (+ 690us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:46:52.830349 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.831140 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.833909 (+ 2769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.835288 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.836018 (+ 730us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:52.836154 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:52.836204 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 15:46:52.836288 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":130,"threads_started":1}
I20260808 15:46:52.837430 12961 tablet_service.cc:1467] Processing CreateTablet for tablet 6f2755255e794683a8a5492492b6089a (DEFAULT_TABLE table=test-table [id=879ff81153b64b36b475b281756780d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:52.837430 12824 tablet_service.cc:1467] Processing CreateTablet for tablet 6f2755255e794683a8a5492492b6089a (DEFAULT_TABLE table=test-table [id=879ff81153b64b36b475b281756780d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:52.838397 12961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f2755255e794683a8a5492492b6089a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:52.838452 12824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f2755255e794683a8a5492492b6089a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:52.840637 13103 tablet_service.cc:1467] Processing CreateTablet for tablet 6f2755255e794683a8a5492492b6089a (DEFAULT_TABLE table=test-table [id=879ff81153b64b36b475b281756780d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:52.841681 13103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f2755255e794683a8a5492492b6089a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:52.845168 13191 tablet_bootstrap.cc:492] T 6f2755255e794683a8a5492492b6089a P 76ff9c8838d3417aa5803d6853b9c7f3: Bootstrap starting.
I20260808 15:46:52.847036 13192 tablet_bootstrap.cc:492] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7: Bootstrap starting.
I20260808 15:46:52.848189 13193 tablet_bootstrap.cc:492] T 6f2755255e794683a8a5492492b6089a P d0ea979d9ac948f98901d4b4c887f847: Bootstrap starting.
I20260808 15:46:52.848912 13191 tablet_bootstrap.cc:654] T 6f2755255e794683a8a5492492b6089a P 76ff9c8838d3417aa5803d6853b9c7f3: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:52.849172 13192 tablet_bootstrap.cc:654] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:52.850055 13191 log.cc:824] T 6f2755255e794683a8a5492492b6089a P 76ff9c8838d3417aa5803d6853b9c7f3: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:52.850232 13193 tablet_bootstrap.cc:654] T 6f2755255e794683a8a5492492b6089a P d0ea979d9ac948f98901d4b4c887f847: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:52.850370 13192 log.cc:824] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:52.851531 13193 log.cc:824] T 6f2755255e794683a8a5492492b6089a P d0ea979d9ac948f98901d4b4c887f847: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:52.852219 13191 tablet_bootstrap.cc:492] T 6f2755255e794683a8a5492492b6089a P 76ff9c8838d3417aa5803d6853b9c7f3: No bootstrap required, opened a new log
I20260808 15:46:52.852334 13192 tablet_bootstrap.cc:492] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7: No bootstrap required, opened a new log
I20260808 15:46:52.852468 13191 ts_tablet_manager.cc:1397] T 6f2755255e794683a8a5492492b6089a P 76ff9c8838d3417aa5803d6853b9c7f3: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 15:46:52.852533 13192 ts_tablet_manager.cc:1397] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260808 15:46:52.853744 13193 tablet_bootstrap.cc:492] T 6f2755255e794683a8a5492492b6089a P d0ea979d9ac948f98901d4b4c887f847: No bootstrap required, opened a new log
I20260808 15:46:52.853935 13193 ts_tablet_manager.cc:1397] T 6f2755255e794683a8a5492492b6089a P d0ea979d9ac948f98901d4b4c887f847: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 15:46:52.856298 13191 raft_consensus.cc:348] T 6f2755255e794683a8a5492492b6089a P 76ff9c8838d3417aa5803d6853b9c7f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a16906b80c4c09a474c21bf4c093e7" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39913 } } peers { permanent_uuid: "d0ea979d9ac948f98901d4b4c887f847" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34099 } } peers { permanent_uuid: "76ff9c8838d3417aa5803d6853b9c7f3" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39291 } }
I20260808 15:46:52.856555 13191 raft_consensus.cc:374] T 6f2755255e794683a8a5492492b6089a P 76ff9c8838d3417aa5803d6853b9c7f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:52.856609 13191 raft_consensus.cc:729] T 6f2755255e794683a8a5492492b6089a P 76ff9c8838d3417aa5803d6853b9c7f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76ff9c8838d3417aa5803d6853b9c7f3, State: Initialized, Role: FOLLOWER
I20260808 15:46:52.856446 13192 raft_consensus.cc:348] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a16906b80c4c09a474c21bf4c093e7" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39913 } } peers { permanent_uuid: "d0ea979d9ac948f98901d4b4c887f847" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34099 } } peers { permanent_uuid: "76ff9c8838d3417aa5803d6853b9c7f3" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39291 } }
I20260808 15:46:52.856711 13192 raft_consensus.cc:374] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:52.856772 13192 raft_consensus.cc:729] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a16906b80c4c09a474c21bf4c093e7, State: Initialized, Role: FOLLOWER
I20260808 15:46:52.857159 13191 consensus_queue.cc:260] T 6f2755255e794683a8a5492492b6089a P 76ff9c8838d3417aa5803d6853b9c7f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a16906b80c4c09a474c21bf4c093e7" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39913 } } peers { permanent_uuid: "d0ea979d9ac948f98901d4b4c887f847" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34099 } } peers { permanent_uuid: "76ff9c8838d3417aa5803d6853b9c7f3" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39291 } }
I20260808 15:46:52.857182 13192 consensus_queue.cc:260] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a16906b80c4c09a474c21bf4c093e7" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39913 } } peers { permanent_uuid: "d0ea979d9ac948f98901d4b4c887f847" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34099 } } peers { permanent_uuid: "76ff9c8838d3417aa5803d6853b9c7f3" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39291 } }
I20260808 15:46:52.857826 13193 raft_consensus.cc:348] T 6f2755255e794683a8a5492492b6089a P d0ea979d9ac948f98901d4b4c887f847 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a16906b80c4c09a474c21bf4c093e7" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39913 } } peers { permanent_uuid: "d0ea979d9ac948f98901d4b4c887f847" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34099 } } peers { permanent_uuid: "76ff9c8838d3417aa5803d6853b9c7f3" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39291 } }
I20260808 15:46:52.858059 13031 heartbeater.cc:503] Master 127.8.39.126:34351 was elected leader, sending a full tablet report...
I20260808 15:46:52.858141 13193 raft_consensus.cc:374] T 6f2755255e794683a8a5492492b6089a P d0ea979d9ac948f98901d4b4c887f847 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:52.858193 13193 raft_consensus.cc:729] T 6f2755255e794683a8a5492492b6089a P d0ea979d9ac948f98901d4b4c887f847 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ea979d9ac948f98901d4b4c887f847, State: Initialized, Role: FOLLOWER
I20260808 15:46:52.858243 13191 ts_tablet_manager.cc:1428] T 6f2755255e794683a8a5492492b6089a P 76ff9c8838d3417aa5803d6853b9c7f3: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 15:46:52.858258 13192 ts_tablet_manager.cc:1428] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260808 15:46:52.858700 12891 heartbeater.cc:503] Master 127.8.39.126:34351 was elected leader, sending a full tablet report...
I20260808 15:46:52.858608 13193 consensus_queue.cc:260] T 6f2755255e794683a8a5492492b6089a P d0ea979d9ac948f98901d4b4c887f847 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a16906b80c4c09a474c21bf4c093e7" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39913 } } peers { permanent_uuid: "d0ea979d9ac948f98901d4b4c887f847" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34099 } } peers { permanent_uuid: "76ff9c8838d3417aa5803d6853b9c7f3" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39291 } }
I20260808 15:46:52.859270 13173 heartbeater.cc:503] Master 127.8.39.126:34351 was elected leader, sending a full tablet report...
I20260808 15:46:52.859529 13193 ts_tablet_manager.cc:1428] T 6f2755255e794683a8a5492492b6089a P d0ea979d9ac948f98901d4b4c887f847: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 15:46:52.865456 13198 raft_consensus.cc:482] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:46:52.865607 13198 raft_consensus.cc:504] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a16906b80c4c09a474c21bf4c093e7" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39913 } } peers { permanent_uuid: "d0ea979d9ac948f98901d4b4c887f847" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34099 } } peers { permanent_uuid: "76ff9c8838d3417aa5803d6853b9c7f3" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39291 } }
I20260808 15:46:52.866642 13198 leader_election.cc:288] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0ea979d9ac948f98901d4b4c887f847 (127.8.39.67:34099), 76ff9c8838d3417aa5803d6853b9c7f3 (127.8.39.65:39291)
I20260808 15:46:52.870322 13033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:52.866901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:34099 (local address 127.8.39.66:54987)
0808 15:46:52.867083 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:52.867099 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:52.867185 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:52.867415 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:52.867418 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:52.867433 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:46:52.867563 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:52.867569 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.868282 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.868287 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:52.869207 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:52.869216 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.869900 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.869903 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:52.870008 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:52.870029 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 15:46:52.870125 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 15:46:52.870198 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"spinlock_wait_cycles":3328}
I20260808 15:46:52.870321 13188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:52.866946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:54987 (local address 127.8.39.67:34099)
0808 15:46:52.867162 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:52.867167 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:52.867180 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:46:52.867272 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:52.867275 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:52.867314 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:52.867404 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:46:52.867671 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.868174 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.869331 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.869779 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.869898 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:52.869956 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:52.870141 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 15:46:52.870204 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131}
I20260808 15:46:52.870784 13200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:52.866947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:39291 (local address 127.8.39.66:43207)
0808 15:46:52.867317 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:52.867329 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:52.867456 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:52.867707 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:52.867710 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:52.867725 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:46:52.867852 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:52.867858 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.868565 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.868568 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:52.869678 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:52.869687 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.870335 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.870339 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:52.870437 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:52.870459 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 15:46:52.870553 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 15:46:52.870613 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"spinlock_wait_cycles":3456,"thread_start_us":116,"threads_started":1}
I20260808 15:46:52.870985 13190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:52.867020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:43207 (local address 127.8.39.65:39291)
0808 15:46:52.867146 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:52.867151 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:52.867408 (+ 257us) server_negotiation.cc:407] Connection header received
0808 15:46:52.867557 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:52.867560 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:52.867601 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:52.867686 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:46:52.867958 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.868447 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.869802 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.870211 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.870339 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:52.870397 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:52.870756 (+ 359us) server_negotiation.cc:299] Negotiation successful
0808 15:46:52.870847 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 15:46:52.871032 13125 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f2755255e794683a8a5492492b6089a" candidate_uuid: "58a16906b80c4c09a474c21bf4c093e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea979d9ac948f98901d4b4c887f847" is_pre_election: true
I20260808 15:46:52.871333 13125 raft_consensus.cc:2454] T 6f2755255e794683a8a5492492b6089a P d0ea979d9ac948f98901d4b4c887f847 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58a16906b80c4c09a474c21bf4c093e7 in term 0.
I20260808 15:46:52.871833 12914 leader_election.cc:302] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58a16906b80c4c09a474c21bf4c093e7, d0ea979d9ac948f98901d4b4c887f847; no voters:
I20260808 15:46:52.872038 12845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f2755255e794683a8a5492492b6089a" candidate_uuid: "58a16906b80c4c09a474c21bf4c093e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76ff9c8838d3417aa5803d6853b9c7f3" is_pre_election: true
I20260808 15:46:52.872160 13198 raft_consensus.cc:2781] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:46:52.872251 13198 raft_consensus.cc:482] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:46:52.872290 13198 raft_consensus.cc:3037] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:52.872332 12845 raft_consensus.cc:2454] T 6f2755255e794683a8a5492492b6089a P 76ff9c8838d3417aa5803d6853b9c7f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58a16906b80c4c09a474c21bf4c093e7 in term 0.
I20260808 15:46:52.873467 13198 raft_consensus.cc:504] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a16906b80c4c09a474c21bf4c093e7" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39913 } } peers { permanent_uuid: "d0ea979d9ac948f98901d4b4c887f847" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34099 } } peers { permanent_uuid: "76ff9c8838d3417aa5803d6853b9c7f3" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39291 } }
I20260808 15:46:52.873799 13198 leader_election.cc:288] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7 [CANDIDATE]: Term 1 election: Requested vote from peers d0ea979d9ac948f98901d4b4c887f847 (127.8.39.67:34099), 76ff9c8838d3417aa5803d6853b9c7f3 (127.8.39.65:39291)
I20260808 15:46:52.874095 13125 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f2755255e794683a8a5492492b6089a" candidate_uuid: "58a16906b80c4c09a474c21bf4c093e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0ea979d9ac948f98901d4b4c887f847"
I20260808 15:46:52.874183 12845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f2755255e794683a8a5492492b6089a" candidate_uuid: "58a16906b80c4c09a474c21bf4c093e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76ff9c8838d3417aa5803d6853b9c7f3"
I20260808 15:46:52.874226 13125 raft_consensus.cc:3037] T 6f2755255e794683a8a5492492b6089a P d0ea979d9ac948f98901d4b4c887f847 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:52.874300 12845 raft_consensus.cc:3037] T 6f2755255e794683a8a5492492b6089a P 76ff9c8838d3417aa5803d6853b9c7f3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:52.875622 12845 raft_consensus.cc:2454] T 6f2755255e794683a8a5492492b6089a P 76ff9c8838d3417aa5803d6853b9c7f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58a16906b80c4c09a474c21bf4c093e7 in term 1.
I20260808 15:46:52.875622 13125 raft_consensus.cc:2454] T 6f2755255e794683a8a5492492b6089a P d0ea979d9ac948f98901d4b4c887f847 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58a16906b80c4c09a474c21bf4c093e7 in term 1.
I20260808 15:46:52.876009 12914 leader_election.cc:302] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58a16906b80c4c09a474c21bf4c093e7, d0ea979d9ac948f98901d4b4c887f847; no voters:
I20260808 15:46:52.876180 13198 raft_consensus.cc:2781] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:52.876396 13198 raft_consensus.cc:686] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7 [term 1 LEADER]: Becoming Leader. State: Replica: 58a16906b80c4c09a474c21bf4c093e7, State: Running, Role: LEADER
I20260808 15:46:52.876706 13198 consensus_queue.cc:237] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a16906b80c4c09a474c21bf4c093e7" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39913 } } peers { permanent_uuid: "d0ea979d9ac948f98901d4b4c887f847" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34099 } } peers { permanent_uuid: "76ff9c8838d3417aa5803d6853b9c7f3" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39291 } }
I20260808 15:46:52.880077 12695 catalog_manager.cc:5495] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58a16906b80c4c09a474c21bf4c093e7 (127.8.39.66). New cstate: current_term: 1 leader_uuid: "58a16906b80c4c09a474c21bf4c093e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58a16906b80c4c09a474c21bf4c093e7" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0ea979d9ac948f98901d4b4c887f847" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76ff9c8838d3417aa5803d6853b9c7f3" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39291 } health_report { overall_health: UNKNOWN } } }
I20260808 15:46:52.901274 13187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:52.897757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48178 (local address 127.8.39.66:39913)
0808 15:46:52.897887 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:52.897892 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:52.897914 (+ 22us) server_negotiation.cc:407] Connection header received
0808 15:46:52.898048 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:52.898050 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:52.898108 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:52.898207 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:46:52.898465 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.899062 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.899964 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:52.900176 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:52.900256 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:52.900538 (+ 282us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:46:52.900947 (+ 409us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:46:52.901037 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:52.901112 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 15:46:52.901161 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 15:46:52.907871 13125 raft_consensus.cc:1261] T 6f2755255e794683a8a5492492b6089a P d0ea979d9ac948f98901d4b4c887f847 [term 1 FOLLOWER]: Refusing update from remote peer 58a16906b80c4c09a474c21bf4c093e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:46:52.907871 12845 raft_consensus.cc:1261] T 6f2755255e794683a8a5492492b6089a P 76ff9c8838d3417aa5803d6853b9c7f3 [term 1 FOLLOWER]: Refusing update from remote peer 58a16906b80c4c09a474c21bf4c093e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:46:52.908648 13198 consensus_queue.cc:1035] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76ff9c8838d3417aa5803d6853b9c7f3" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:46:52.908876 13201 consensus_queue.cc:1035] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0ea979d9ac948f98901d4b4c887f847" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:46:52.919329 13207 mvcc.cc:205] Tried to move back new op lower bound from 7316291636862369792 to 7316291636745527296. Current Snapshot: MvccSnapshot[applied={T|T < 7316291636862369792}]
I20260808 15:46:52.925813 12691 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41686:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:46:52.926017 12691 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41686:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:46:52.928674 12691 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 39081855aa8b406ca207595d9726af1d: Sending DeleteTablet for 3 replicas of tablet 6f2755255e794683a8a5492492b6089a
I20260808 15:46:52.929544 13103 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f2755255e794683a8a5492492b6089a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:46:52 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:54342
I20260808 15:46:52.929560 12961 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f2755255e794683a8a5492492b6089a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:46:52 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:48166
I20260808 15:46:52.929574 12824 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f2755255e794683a8a5492492b6089a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:46:52 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:34068
I20260808 15:46:52.930079 13215 tablet_replica.cc:330] T 6f2755255e794683a8a5492492b6089a P 76ff9c8838d3417aa5803d6853b9c7f3: stopping tablet replica
I20260808 15:46:52.930200 13217 tablet_replica.cc:330] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7: stopping tablet replica
I20260808 15:46:52.930506 13217 raft_consensus.cc:2229] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:46:52.930512 13215 raft_consensus.cc:2229] T 6f2755255e794683a8a5492492b6089a P 76ff9c8838d3417aa5803d6853b9c7f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:46:52.930869 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 12759
I20260808 15:46:52.930945 13215 raft_consensus.cc:2258] T 6f2755255e794683a8a5492492b6089a P 76ff9c8838d3417aa5803d6853b9c7f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:46:52.932673 13217 raft_consensus.cc:2258] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:46:52.933151 13216 tablet_replica.cc:330] T 6f2755255e794683a8a5492492b6089a P d0ea979d9ac948f98901d4b4c887f847: stopping tablet replica
I20260808 15:46:52.933569 13216 raft_consensus.cc:2229] T 6f2755255e794683a8a5492492b6089a P d0ea979d9ac948f98901d4b4c887f847 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:46:52.933938 13216 raft_consensus.cc:2258] T 6f2755255e794683a8a5492492b6089a P d0ea979d9ac948f98901d4b4c887f847 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:46:52.935858 13217 ts_tablet_manager.cc:1905] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:46:52.940359 13216 ts_tablet_manager.cc:1905] T 6f2755255e794683a8a5492492b6089a P d0ea979d9ac948f98901d4b4c887f847: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:46:52.943815 13217 ts_tablet_manager.cc:1918] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:46:52.943948 13216 ts_tablet_manager.cc:1918] T 6f2755255e794683a8a5492492b6089a P d0ea979d9ac948f98901d4b4c887f847: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:46:52.944006 13217 log.cc:1196] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-1/wal/wals/6f2755255e794683a8a5492492b6089a
I20260808 15:46:52.944061 13216 log.cc:1196] T 6f2755255e794683a8a5492492b6089a P d0ea979d9ac948f98901d4b4c887f847: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/6f2755255e794683a8a5492492b6089a
I20260808 15:46:52.944449 13216 ts_tablet_manager.cc:1939] T 6f2755255e794683a8a5492492b6089a P d0ea979d9ac948f98901d4b4c887f847: Deleting consensus metadata
I20260808 15:46:52.944561 13217 ts_tablet_manager.cc:1939] T 6f2755255e794683a8a5492492b6089a P 58a16906b80c4c09a474c21bf4c093e7: Deleting consensus metadata
I20260808 15:46:52.945876 12679 catalog_manager.cc:4841] TS 58a16906b80c4c09a474c21bf4c093e7 (127.8.39.66:39913): tablet 6f2755255e794683a8a5492492b6089a (table test-table [id=879ff81153b64b36b475b281756780d3]) successfully deleted
I20260808 15:46:52.945940 12678 catalog_manager.cc:4841] TS d0ea979d9ac948f98901d4b4c887f847 (127.8.39.67:34099): tablet 6f2755255e794683a8a5492492b6089a (table test-table [id=879ff81153b64b36b475b281756780d3]) successfully deleted
W20260808 15:46:52.947597 12677 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.39.65:39291 (error 108)
I20260808 15:46:52.947659 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 12897
I20260808 15:46:52.950309 13185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:52.949946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:39291 (local address 127.0.0.1:34078)
0808 15:46:52.950107 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:52.950199 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.65:39291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 15:46:52.950496 12677 catalog_manager.cc:4584] TS 76ff9c8838d3417aa5803d6853b9c7f3 (127.8.39.65:39291): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6f2755255e794683a8a5492492b6089a: Network error: Client connection negotiation failed: client connection to 127.8.39.65:39291: connect: Connection refused (error 111)
I20260808 15:46:52.954737 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 13036
I20260808 15:46:52.962235 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 12661
2026-08-08T15:46:52Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2373 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T15:46:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:46:52Z Disabled control of system clock
I20260808 15:46:52.995185 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:45315
--webserver_interface=127.8.39.126
--webserver_port=0
--builtin_ntp_servers=127.8.39.84:43833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:45315
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 15:46:53.108429 13222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:53.108692 13222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:53.108731 13222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:53.112811 13222 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:46:53.112890 13222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:53.112905 13222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:53.112923 13222 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:46:53.112939 13222 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:46:53.117758 13222 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:43833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:45315
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:45315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13222
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:53.118949 13222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:53.120388 13222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:53.129060 13231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:53.129166 13222 server_base.cc:1034] running on GCE node
W20260808 15:46:53.128999 13228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:53.129079 13227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:53.129828 13222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:53.131017 13222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:53.132190 13222 hybrid_clock.cc:648] HybridClock initialized: now 1786204013132161 us; error 39 us; skew 500 ppm
I20260808 15:46:53.134166 13222 webserver.cc:460] Webserver started at http://127.8.39.126:34015/ using document root <none> and password file <none>
I20260808 15:46:53.134814 13222 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:53.134898 13222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:53.135178 13222 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:53.137296 13222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "10fc39c64b774914851ef7dfed87118d"
format_stamp: "Formatted at 2026-08-08 15:46:53 on dist-test-slave-8tdl"
server_key: "23effadae79d47b2267f2ce54dffe5c5"
server_key_iv: "8a9ad089acd49acd60a3be53d0815901"
server_key_version: "encryptionkey@0"
I20260808 15:46:53.137887 13222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "10fc39c64b774914851ef7dfed87118d"
format_stamp: "Formatted at 2026-08-08 15:46:53 on dist-test-slave-8tdl"
server_key: "23effadae79d47b2267f2ce54dffe5c5"
server_key_iv: "8a9ad089acd49acd60a3be53d0815901"
server_key_version: "encryptionkey@0"
I20260808 15:46:53.141649 13222 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 15:46:53.144191 13238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:53.145496 13222 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:46:53.145639 13222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "10fc39c64b774914851ef7dfed87118d"
format_stamp: "Formatted at 2026-08-08 15:46:53 on dist-test-slave-8tdl"
server_key: "23effadae79d47b2267f2ce54dffe5c5"
server_key_iv: "8a9ad089acd49acd60a3be53d0815901"
server_key_version: "encryptionkey@0"
I20260808 15:46:53.145756 13222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:53.150470 13222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:53.151177 13222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:53.151360 13222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:53.158471 13222 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:45315
I20260808 15:46:53.158561 13291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:45315 every 8 connection(s)
I20260808 15:46:53.159463 13222 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:46:53.161365 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 13222
I20260808 15:46:53.161510 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:46:53.161798 8349 external_mini_cluster.cc:1428] Setting key 09c5d0f0cdb76d980c5506cf67d5cfef
I20260808 15:46:53.163166 13292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:53.167577 13295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:53.163434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39978 (local address 127.8.39.126:45315)
0808 15:46:53.164093 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:53.164109 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:53.164146 (+ 37us) server_negotiation.cc:407] Connection header received
0808 15:46:53.164784 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:53.164798 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:53.165137 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:53.165461 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:53.166304 (+ 843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:53.166308 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:53.166319 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:46:53.166329 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:53.166383 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:46:53.166398 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:53.166547 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:53.166621 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 15:46:53.166909 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":150,"threads_started":1}
I20260808 15:46:53.169461 13292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10fc39c64b774914851ef7dfed87118d: Bootstrap starting.
I20260808 15:46:53.171787 13292 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10fc39c64b774914851ef7dfed87118d: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:53.172578 13292 log.cc:824] T 00000000000000000000000000000000 P 10fc39c64b774914851ef7dfed87118d: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:53.175225 13292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10fc39c64b774914851ef7dfed87118d: No bootstrap required, opened a new log
I20260808 15:46:53.179180 13292 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10fc39c64b774914851ef7dfed87118d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10fc39c64b774914851ef7dfed87118d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45315 } }
I20260808 15:46:53.179447 13292 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10fc39c64b774914851ef7dfed87118d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:53.179536 13292 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10fc39c64b774914851ef7dfed87118d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10fc39c64b774914851ef7dfed87118d, State: Initialized, Role: FOLLOWER
I20260808 15:46:53.179980 13292 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10fc39c64b774914851ef7dfed87118d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10fc39c64b774914851ef7dfed87118d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45315 } }
I20260808 15:46:53.180112 13292 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10fc39c64b774914851ef7dfed87118d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:46:53.180212 13292 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10fc39c64b774914851ef7dfed87118d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:46:53.180359 13292 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10fc39c64b774914851ef7dfed87118d [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:53.181577 13292 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10fc39c64b774914851ef7dfed87118d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10fc39c64b774914851ef7dfed87118d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45315 } }
I20260808 15:46:53.181948 13292 leader_election.cc:302] T 00000000000000000000000000000000 P 10fc39c64b774914851ef7dfed87118d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10fc39c64b774914851ef7dfed87118d; no voters:
I20260808 15:46:53.182286 13292 leader_election.cc:288] T 00000000000000000000000000000000 P 10fc39c64b774914851ef7dfed87118d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:46:53.182430 13297 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10fc39c64b774914851ef7dfed87118d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:53.182663 13297 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10fc39c64b774914851ef7dfed87118d [term 1 LEADER]: Becoming Leader. State: Replica: 10fc39c64b774914851ef7dfed87118d, State: Running, Role: LEADER
I20260808 15:46:53.183024 13297 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10fc39c64b774914851ef7dfed87118d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10fc39c64b774914851ef7dfed87118d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45315 } }
I20260808 15:46:53.183692 13292 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10fc39c64b774914851ef7dfed87118d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:46:53.184711 13299 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10fc39c64b774914851ef7dfed87118d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10fc39c64b774914851ef7dfed87118d. Latest consensus state: current_term: 1 leader_uuid: "10fc39c64b774914851ef7dfed87118d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10fc39c64b774914851ef7dfed87118d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45315 } } }
I20260808 15:46:53.184880 13299 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10fc39c64b774914851ef7dfed87118d [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:53.185226 13298 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10fc39c64b774914851ef7dfed87118d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10fc39c64b774914851ef7dfed87118d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10fc39c64b774914851ef7dfed87118d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45315 } } }
I20260808 15:46:53.185333 13298 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10fc39c64b774914851ef7dfed87118d [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:53.186468 13306 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:46:53.189368 13306 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:46:53.195070 13306 catalog_manager.cc:1347] Generated new cluster ID: e52df73db6eb4e89a8f9424224987cca
I20260808 15:46:53.195143 13306 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:46:53.236635 13306 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:46:53.236982 13306 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:46:53.249100 13306 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10fc39c64b774914851ef7dfed87118d: Generated new TSK 0
I20260808 15:46:53.249994 13306 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:46:53.265039 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:0
--local_ip_for_outbound_sockets=127.8.39.65
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:45315
--builtin_ntp_servers=127.8.39.84:43833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 15:46:53.377033 13316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:53.377286 13316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:53.377326 13316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:53.381282 13316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:53.381336 13316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:53.381420 13316 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:46:53.386459 13316 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:43833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:45315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:53.387549 13316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:53.388927 13316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:53.398833 13321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:53.398891 13322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:53.399057 13316 server_base.cc:1034] running on GCE node
W20260808 15:46:53.399233 13324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:53.399644 13316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:53.400303 13316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:53.401503 13316 hybrid_clock.cc:648] HybridClock initialized: now 1786204013401461 us; error 54 us; skew 500 ppm
I20260808 15:46:53.403602 13316 webserver.cc:460] Webserver started at http://127.8.39.65:39875/ using document root <none> and password file <none>
I20260808 15:46:53.404186 13316 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:53.404279 13316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:53.404516 13316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:53.406548 13316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-0/data/instance:
uuid: "f2a756fa43cd491f95ed70400405bba0"
format_stamp: "Formatted at 2026-08-08 15:46:53 on dist-test-slave-8tdl"
server_key: "5b4b6fc9a8574b9275021a2dcbdd679d"
server_key_iv: "8412aab85c692c390faa043b25790f1c"
server_key_version: "encryptionkey@0"
I20260808 15:46:53.407188 13316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance:
uuid: "f2a756fa43cd491f95ed70400405bba0"
format_stamp: "Formatted at 2026-08-08 15:46:53 on dist-test-slave-8tdl"
server_key: "5b4b6fc9a8574b9275021a2dcbdd679d"
server_key_iv: "8412aab85c692c390faa043b25790f1c"
server_key_version: "encryptionkey@0"
I20260808 15:46:53.410946 13316 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:46:53.413579 13331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:53.415048 13316 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:46:53.415185 13316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "f2a756fa43cd491f95ed70400405bba0"
format_stamp: "Formatted at 2026-08-08 15:46:53 on dist-test-slave-8tdl"
server_key: "5b4b6fc9a8574b9275021a2dcbdd679d"
server_key_iv: "8412aab85c692c390faa043b25790f1c"
server_key_version: "encryptionkey@0"
I20260808 15:46:53.415299 13316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:53.419937 13316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:53.420562 13316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:53.420750 13316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:53.421308 13316 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:46:53.422310 13316 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:53.422392 13316 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:53.422465 13316 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:53.422521 13316 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:53.432109 13316 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:38261
I20260808 15:46:53.432127 13453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:38261 every 8 connection(s)
I20260808 15:46:53.433068 13316 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:46:53.439747 13295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:53.435095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:35675 (local address 127.8.39.126:45315)
0808 15:46:53.435250 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:53.435254 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:53.436436 (+ 1182us) server_negotiation.cc:407] Connection header received
0808 15:46:53.437820 (+ 1384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:53.437824 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:53.437873 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:53.437960 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:53.439230 (+ 1270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:53.439234 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:53.439237 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:46:53.439254 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:53.439280 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:46:53.439288 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:53.439404 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:53.439552 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 15:46:53.439600 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 15:46:53.440634 13456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:53.435513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45315 (local address 127.8.39.65:35675)
0808 15:46:53.436247 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:53.436292 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:53.437604 (+ 1312us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:53.438132 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:53.438139 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:53.438248 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:53.438957 (+ 709us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:46:53.438959 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:53.438999 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:46:53.439068 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:53.439387 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:53.439397 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:53.439402 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 15:46:53.439600 (+ 198us) client_negotiation.cc:240] Negotiation successful
0808 15:46:53.439857 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":111,"threads_started":1}
I20260808 15:46:53.441789 13454 heartbeater.cc:347] Connected to a master server at 127.8.39.126:45315
I20260808 15:46:53.442075 13454 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:53.442337 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 13316
I20260808 15:46:53.442472 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance
I20260808 15:46:53.442543 13454 heartbeater.cc:511] Master 127.8.39.126:45315 requested a full tablet report, sending...
I20260808 15:46:53.442845 8349 external_mini_cluster.cc:1428] Setting key 716145e3827d61b85f283007e1f74db7
I20260808 15:46:53.444199 13254 ts_manager.cc:194] Registered new tserver with Master: f2a756fa43cd491f95ed70400405bba0 (127.8.39.65:38261)
I20260808 15:46:53.444994 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:0
--local_ip_for_outbound_sockets=127.8.39.66
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:45315
--builtin_ntp_servers=127.8.39.84:43833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 15:46:53.557437 13457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:53.557700 13457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:53.557740 13457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:53.561764 13457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:53.561827 13457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:53.561883 13457 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:46:53.566510 13457 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:43833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:45315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13457
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:53.567623 13457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:53.569047 13457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:53.578513 13463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:53.578541 13462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:53.578513 13465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:53.578773 13457 server_base.cc:1034] running on GCE node
I20260808 15:46:53.579397 13457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:53.580044 13457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:53.581238 13457 hybrid_clock.cc:648] HybridClock initialized: now 1786204013581220 us; error 37 us; skew 500 ppm
I20260808 15:46:53.583316 13457 webserver.cc:460] Webserver started at http://127.8.39.66:44877/ using document root <none> and password file <none>
I20260808 15:46:53.583945 13457 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:53.584097 13457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:53.584295 13457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:53.586723 13457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-1/data/instance:
uuid: "4acede97f5474118b773bd1e820ff119"
format_stamp: "Formatted at 2026-08-08 15:46:53 on dist-test-slave-8tdl"
server_key: "7ac2f3827b0f1eaf0996d85ba4bab0b9"
server_key_iv: "779094b3e61b09802e6d7d6ffafd2819"
server_key_version: "encryptionkey@0"
I20260808 15:46:53.587332 13457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance:
uuid: "4acede97f5474118b773bd1e820ff119"
format_stamp: "Formatted at 2026-08-08 15:46:53 on dist-test-slave-8tdl"
server_key: "7ac2f3827b0f1eaf0996d85ba4bab0b9"
server_key_iv: "779094b3e61b09802e6d7d6ffafd2819"
server_key_version: "encryptionkey@0"
I20260808 15:46:53.591215 13457 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 15:46:53.593704 13471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:53.595129 13457 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:46:53.595223 13457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "4acede97f5474118b773bd1e820ff119"
format_stamp: "Formatted at 2026-08-08 15:46:53 on dist-test-slave-8tdl"
server_key: "7ac2f3827b0f1eaf0996d85ba4bab0b9"
server_key_iv: "779094b3e61b09802e6d7d6ffafd2819"
server_key_version: "encryptionkey@0"
I20260808 15:46:53.595317 13457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:53.599756 13457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:53.600301 13457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:53.600440 13457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:53.600929 13457 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:46:53.601750 13457 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:53.601797 13457 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:53.601835 13457 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:53.601856 13457 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:53.610914 13457 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:33843
I20260808 15:46:53.610960 13589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:33843 every 8 connection(s)
I20260808 15:46:53.612214 13457 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:46:53.618937 13295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:53.614299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:47995 (local address 127.8.39.126:45315)
0808 15:46:53.614466 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:53.614470 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:53.615655 (+ 1185us) server_negotiation.cc:407] Connection header received
0808 15:46:53.616994 (+ 1339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:53.616997 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:53.617039 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:53.617125 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:53.618380 (+ 1255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:53.618384 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:53.618386 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:46:53.618399 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:53.618420 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:46:53.618428 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:53.618528 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:53.618648 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 15:46:53.618768 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 15:46:53.619793 13592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:53.614737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45315 (local address 127.8.39.66:47995)
0808 15:46:53.615515 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:53.615557 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:53.616747 (+ 1190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:53.617291 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:53.617298 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:53.617392 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:53.618044 (+ 652us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:46:53.618045 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:53.618085 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:46:53.618152 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:53.618523 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:53.618530 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:53.618534 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 15:46:53.618716 (+ 182us) client_negotiation.cc:240] Negotiation successful
0808 15:46:53.618928 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":157,"threads_started":1}
I20260808 15:46:53.621146 13590 heartbeater.cc:347] Connected to a master server at 127.8.39.126:45315
I20260808 15:46:53.621430 13590 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:53.621950 13590 heartbeater.cc:511] Master 127.8.39.126:45315 requested a full tablet report, sending...
I20260808 15:46:53.622537 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 13457
I20260808 15:46:53.622696 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance
I20260808 15:46:53.622997 8349 external_mini_cluster.cc:1428] Setting key 50e8d9a85125348523bcf2718e909a93
I20260808 15:46:53.623225 13254 ts_manager.cc:194] Registered new tserver with Master: 4acede97f5474118b773bd1e820ff119 (127.8.39.66:33843)
I20260808 15:46:53.625301 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:0
--local_ip_for_outbound_sockets=127.8.39.67
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:45315
--builtin_ntp_servers=127.8.39.84:43833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 15:46:53.745117 13593 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:53.745404 13593 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:53.745448 13593 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:53.749925 13593 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:53.750034 13593 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:53.750147 13593 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:46:53.755474 13593 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:43833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:45315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13593
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:53.756681 13593 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:53.758152 13593 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:53.768909 13599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:53.768994 13601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:53.768994 13598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:53.769245 13593 server_base.cc:1034] running on GCE node
I20260808 15:46:53.769690 13593 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:53.770363 13593 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:53.771539 13593 hybrid_clock.cc:648] HybridClock initialized: now 1786204013771491 us; error 63 us; skew 500 ppm
I20260808 15:46:53.773658 13593 webserver.cc:460] Webserver started at http://127.8.39.67:44153/ using document root <none> and password file <none>
I20260808 15:46:53.774268 13593 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:53.774369 13593 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:53.774644 13593 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:53.776991 13593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-2/data/instance:
uuid: "2838842a02fc43cba69b52f30912d6ed"
format_stamp: "Formatted at 2026-08-08 15:46:53 on dist-test-slave-8tdl"
server_key: "927ec942c1256bb6b9ac9e26f12c92cd"
server_key_iv: "5def0476ef586d7d2394e5ebe89ca8df"
server_key_version: "encryptionkey@0"
I20260808 15:46:53.777659 13593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance:
uuid: "2838842a02fc43cba69b52f30912d6ed"
format_stamp: "Formatted at 2026-08-08 15:46:53 on dist-test-slave-8tdl"
server_key: "927ec942c1256bb6b9ac9e26f12c92cd"
server_key_iv: "5def0476ef586d7d2394e5ebe89ca8df"
server_key_version: "encryptionkey@0"
I20260808 15:46:53.781708 13593 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260808 15:46:53.784468 13607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:53.785936 13593 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:46:53.786098 13593 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "2838842a02fc43cba69b52f30912d6ed"
format_stamp: "Formatted at 2026-08-08 15:46:53 on dist-test-slave-8tdl"
server_key: "927ec942c1256bb6b9ac9e26f12c92cd"
server_key_iv: "5def0476ef586d7d2394e5ebe89ca8df"
server_key_version: "encryptionkey@0"
I20260808 15:46:53.786252 13593 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:53.791795 13593 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:53.792461 13593 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:53.792673 13593 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:53.793272 13593 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:46:53.794247 13593 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:53.794322 13593 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:53.794395 13593 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:53.794436 13593 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:53.804421 13593 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:34405
I20260808 15:46:53.804448 13725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:34405 every 8 connection(s)
I20260808 15:46:53.805428 13593 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:46:53.811801 13295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:53.807330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:34885 (local address 127.8.39.126:45315)
0808 15:46:53.807483 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:53.807487 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:53.808547 (+ 1060us) server_negotiation.cc:407] Connection header received
0808 15:46:53.809902 (+ 1355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:53.809906 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:53.809959 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:53.810044 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:53.811309 (+ 1265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:53.811312 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:53.811315 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:46:53.811329 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:53.811352 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:46:53.811369 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:53.811474 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:53.811608 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 15:46:53.811656 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 15:46:53.812668 13729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:53.807699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45315 (local address 127.8.39.67:34885)
0808 15:46:53.808388 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:53.808431 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:53.809666 (+ 1235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:53.810274 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:53.810280 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:53.810367 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:53.811043 (+ 676us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:46:53.811044 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:53.811085 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:46:53.811152 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:53.811453 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:53.811462 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:53.811467 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 15:46:53.811653 (+ 186us) client_negotiation.cc:240] Negotiation successful
0808 15:46:53.811895 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":134,"threads_started":1}
I20260808 15:46:53.812680 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 13593
I20260808 15:46:53.812822 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance
I20260808 15:46:53.813144 8349 external_mini_cluster.cc:1428] Setting key b854e368eb0f419c9386b40cdb06b8e7
I20260808 15:46:53.814162 13726 heartbeater.cc:347] Connected to a master server at 127.8.39.126:45315
I20260808 15:46:53.814433 13726 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:53.814982 13726 heartbeater.cc:511] Master 127.8.39.126:45315 requested a full tablet report, sending...
I20260808 15:46:53.816037 13254 ts_manager.cc:194] Registered new tserver with Master: 2838842a02fc43cba69b52f30912d6ed (127.8.39.67:34405)
I20260808 15:46:53.827440 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:46:53.831419 13295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:53.829550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39980 (local address 127.8.39.126:45315)
0808 15:46:53.829685 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:53.829689 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:53.829795 (+ 106us) server_negotiation.cc:407] Connection header received
0808 15:46:53.829989 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:53.829992 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:53.830036 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:53.830123 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:53.831029 (+ 906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:53.831032 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:53.831034 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:46:53.831045 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:53.831066 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:46:53.831074 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:53.831154 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:53.831267 (+ 113us) server_negotiation.cc:299] Negotiation successful
0808 15:46:53.831305 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 15:46:53.834657 13254 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39980:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:46:53.837957 13254 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:46:53.850895 13739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:53.847129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:34405 (local address 127.0.0.1:53538)
0808 15:46:53.848001 (+ 872us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:53.848056 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:53.848168 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:53.848993 (+ 825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:53.848996 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:53.849040 (+ 44us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:53.849736 (+ 696us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:46:53.849741 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:53.849778 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:46:53.849880 (+ 102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:53.850413 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:53.850425 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:53.850435 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 15:46:53.850594 (+ 159us) client_negotiation.cc:240] Negotiation successful
0808 15:46:53.850706 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":676,"thread_start_us":85,"threads_started":1}
I20260808 15:46:53.851239 13740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:53.847146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:38261 (local address 127.0.0.1:48858)
0808 15:46:53.848295 (+ 1149us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:53.848310 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:53.848398 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:53.848945 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:53.848951 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:53.849041 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:53.849961 (+ 920us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:46:53.849966 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:53.849978 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:46:53.850007 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:53.850714 (+ 707us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:53.850717 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:53.850721 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 15:46:53.850782 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 15:46:53.850813 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1082,"thread_start_us":145,"threads_started":1}
I20260808 15:46:53.850929 13742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:53.847461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53538 (local address 127.8.39.67:34405)
0808 15:46:53.848094 (+ 633us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:53.848108 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:53.848140 (+ 32us) server_negotiation.cc:407] Connection header received
0808 15:46:53.848324 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:53.848331 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:53.848569 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:53.848735 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:53.850069 (+ 1334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:53.850078 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:53.850095 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:46:53.850112 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:53.850162 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:46:53.850199 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:53.850350 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:53.850614 (+ 264us) server_negotiation.cc:299] Negotiation successful
0808 15:46:53.850726 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":148,"threads_started":1}
I20260808 15:46:53.851925 13741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:53.847287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48858 (local address 127.8.39.65:38261)
0808 15:46:53.848421 (+ 1134us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:53.848437 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:53.848481 (+ 44us) server_negotiation.cc:407] Connection header received
0808 15:46:53.848541 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:53.848546 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:53.848745 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:53.849469 (+ 724us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:53.850160 (+ 691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:53.850166 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:53.850175 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:46:53.850188 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:53.850231 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:46:53.850574 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:53.851502 (+ 928us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:53.851561 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 15:46:53.851744 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":971,"thread_start_us":121,"threads_started":1}
I20260808 15:46:53.852741 13744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:53.848100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35018 (local address 127.8.39.66:33843)
0808 15:46:53.849005 (+ 905us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:53.849020 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:53.849340 (+ 320us) server_negotiation.cc:407] Connection header received
0808 15:46:53.849450 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:53.849456 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:53.849639 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:53.849774 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:53.850793 (+ 1019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:53.850798 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:53.850811 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:46:53.850976 (+ 165us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:53.851053 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:46:53.851258 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:53.851430 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:53.851648 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 15:46:53.852577 (+ 929us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":701,"thread_start_us":105,"threads_started":1}
I20260808 15:46:53.852890 13743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:53.847931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:33843 (local address 127.0.0.1:35018)
0808 15:46:53.849176 (+ 1245us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:53.849238 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:53.849348 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:53.850078 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:53.850081 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:53.850096 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:53.850582 (+ 486us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:46:53.850584 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:53.850595 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:46:53.850621 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:53.851517 (+ 896us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:53.851520 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:53.851522 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 15:46:53.852661 (+ 1139us) client_negotiation.cc:240] Negotiation successful
0808 15:46:53.852709 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1166,"thread_start_us":99,"threads_started":1}
I20260808 15:46:53.854758 13384 tablet_service.cc:1467] Processing CreateTablet for tablet 65f61c154719471196842f7472bde409 (DEFAULT_TABLE table=test-table [id=286f286a0d104144aba82ff21cc5101f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:53.855363 13658 tablet_service.cc:1467] Processing CreateTablet for tablet 65f61c154719471196842f7472bde409 (DEFAULT_TABLE table=test-table [id=286f286a0d104144aba82ff21cc5101f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:53.856000 13384 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65f61c154719471196842f7472bde409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:53.855749 13522 tablet_service.cc:1467] Processing CreateTablet for tablet 65f61c154719471196842f7472bde409 (DEFAULT_TABLE table=test-table [id=286f286a0d104144aba82ff21cc5101f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:46:53.856442 13658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65f61c154719471196842f7472bde409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:53.856737 13522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65f61c154719471196842f7472bde409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:53.863011 13745 tablet_bootstrap.cc:492] T 65f61c154719471196842f7472bde409 P 4acede97f5474118b773bd1e820ff119: Bootstrap starting.
I20260808 15:46:53.865150 13746 tablet_bootstrap.cc:492] T 65f61c154719471196842f7472bde409 P 2838842a02fc43cba69b52f30912d6ed: Bootstrap starting.
I20260808 15:46:53.866271 13745 tablet_bootstrap.cc:654] T 65f61c154719471196842f7472bde409 P 4acede97f5474118b773bd1e820ff119: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:53.867097 13747 tablet_bootstrap.cc:492] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0: Bootstrap starting.
I20260808 15:46:53.867132 13745 log.cc:824] T 65f61c154719471196842f7472bde409 P 4acede97f5474118b773bd1e820ff119: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:53.867417 13746 tablet_bootstrap.cc:654] T 65f61c154719471196842f7472bde409 P 2838842a02fc43cba69b52f30912d6ed: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:53.868335 13746 log.cc:824] T 65f61c154719471196842f7472bde409 P 2838842a02fc43cba69b52f30912d6ed: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:53.869292 13745 tablet_bootstrap.cc:492] T 65f61c154719471196842f7472bde409 P 4acede97f5474118b773bd1e820ff119: No bootstrap required, opened a new log
I20260808 15:46:53.869529 13745 ts_tablet_manager.cc:1397] T 65f61c154719471196842f7472bde409 P 4acede97f5474118b773bd1e820ff119: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 15:46:53.869531 13747 tablet_bootstrap.cc:654] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:53.870429 13747 log.cc:824] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:53.870667 13746 tablet_bootstrap.cc:492] T 65f61c154719471196842f7472bde409 P 2838842a02fc43cba69b52f30912d6ed: No bootstrap required, opened a new log
I20260808 15:46:53.870930 13746 ts_tablet_manager.cc:1397] T 65f61c154719471196842f7472bde409 P 2838842a02fc43cba69b52f30912d6ed: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 15:46:53.872709 13747 tablet_bootstrap.cc:492] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0: No bootstrap required, opened a new log
I20260808 15:46:53.872932 13747 ts_tablet_manager.cc:1397] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 15:46:53.873708 13745 raft_consensus.cc:348] T 65f61c154719471196842f7472bde409 P 4acede97f5474118b773bd1e820ff119 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2a756fa43cd491f95ed70400405bba0" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 38261 } } peers { permanent_uuid: "2838842a02fc43cba69b52f30912d6ed" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34405 } } peers { permanent_uuid: "4acede97f5474118b773bd1e820ff119" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33843 } }
I20260808 15:46:53.873960 13745 raft_consensus.cc:374] T 65f61c154719471196842f7472bde409 P 4acede97f5474118b773bd1e820ff119 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:53.874022 13745 raft_consensus.cc:729] T 65f61c154719471196842f7472bde409 P 4acede97f5474118b773bd1e820ff119 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4acede97f5474118b773bd1e820ff119, State: Initialized, Role: FOLLOWER
I20260808 15:46:53.874485 13745 consensus_queue.cc:260] T 65f61c154719471196842f7472bde409 P 4acede97f5474118b773bd1e820ff119 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2a756fa43cd491f95ed70400405bba0" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 38261 } } peers { permanent_uuid: "2838842a02fc43cba69b52f30912d6ed" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34405 } } peers { permanent_uuid: "4acede97f5474118b773bd1e820ff119" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33843 } }
I20260808 15:46:53.875218 13590 heartbeater.cc:503] Master 127.8.39.126:45315 was elected leader, sending a full tablet report...
I20260808 15:46:53.876046 13746 raft_consensus.cc:348] T 65f61c154719471196842f7472bde409 P 2838842a02fc43cba69b52f30912d6ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2a756fa43cd491f95ed70400405bba0" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 38261 } } peers { permanent_uuid: "2838842a02fc43cba69b52f30912d6ed" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34405 } } peers { permanent_uuid: "4acede97f5474118b773bd1e820ff119" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33843 } }
I20260808 15:46:53.876435 13746 raft_consensus.cc:374] T 65f61c154719471196842f7472bde409 P 2838842a02fc43cba69b52f30912d6ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:53.876495 13746 raft_consensus.cc:729] T 65f61c154719471196842f7472bde409 P 2838842a02fc43cba69b52f30912d6ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2838842a02fc43cba69b52f30912d6ed, State: Initialized, Role: FOLLOWER
I20260808 15:46:53.876633 13745 ts_tablet_manager.cc:1428] T 65f61c154719471196842f7472bde409 P 4acede97f5474118b773bd1e820ff119: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260808 15:46:53.876986 13746 consensus_queue.cc:260] T 65f61c154719471196842f7472bde409 P 2838842a02fc43cba69b52f30912d6ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2a756fa43cd491f95ed70400405bba0" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 38261 } } peers { permanent_uuid: "2838842a02fc43cba69b52f30912d6ed" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34405 } } peers { permanent_uuid: "4acede97f5474118b773bd1e820ff119" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33843 } }
I20260808 15:46:53.878166 13746 ts_tablet_manager.cc:1428] T 65f61c154719471196842f7472bde409 P 2838842a02fc43cba69b52f30912d6ed: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260808 15:46:53.878248 13747 raft_consensus.cc:348] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2a756fa43cd491f95ed70400405bba0" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 38261 } } peers { permanent_uuid: "2838842a02fc43cba69b52f30912d6ed" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34405 } } peers { permanent_uuid: "4acede97f5474118b773bd1e820ff119" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33843 } }
I20260808 15:46:53.878537 13747 raft_consensus.cc:374] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:53.878599 13747 raft_consensus.cc:729] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2a756fa43cd491f95ed70400405bba0, State: Initialized, Role: FOLLOWER
I20260808 15:46:53.878587 13726 heartbeater.cc:503] Master 127.8.39.126:45315 was elected leader, sending a full tablet report...
I20260808 15:46:53.879105 13747 consensus_queue.cc:260] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2a756fa43cd491f95ed70400405bba0" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 38261 } } peers { permanent_uuid: "2838842a02fc43cba69b52f30912d6ed" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34405 } } peers { permanent_uuid: "4acede97f5474118b773bd1e820ff119" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33843 } }
I20260808 15:46:53.879834 13454 heartbeater.cc:503] Master 127.8.39.126:45315 was elected leader, sending a full tablet report...
I20260808 15:46:53.881073 13747 ts_tablet_manager.cc:1428] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
W20260808 15:46:53.934311 13455 tablet.cc:2369] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:46:54.056550 13727 tablet.cc:2369] T 65f61c154719471196842f7472bde409 P 2838842a02fc43cba69b52f30912d6ed: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:46:54.084831 13753 raft_consensus.cc:482] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:46:54.085124 13753 raft_consensus.cc:504] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2a756fa43cd491f95ed70400405bba0" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 38261 } } peers { permanent_uuid: "2838842a02fc43cba69b52f30912d6ed" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34405 } } peers { permanent_uuid: "4acede97f5474118b773bd1e820ff119" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33843 } }
I20260808 15:46:54.086436 13753 leader_election.cc:288] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2838842a02fc43cba69b52f30912d6ed (127.8.39.67:34405), 4acede97f5474118b773bd1e820ff119 (127.8.39.66:33843)
I20260808 15:46:54.088790 13742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:54.086820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:40101 (local address 127.8.39.67:34405)
0808 15:46:54.086965 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:54.086972 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:54.087197 (+ 225us) server_negotiation.cc:407] Connection header received
0808 15:46:54.087315 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:54.087320 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:54.087359 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:54.087422 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:54.088321 (+ 899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:54.088325 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:54.088328 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:46:54.088341 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:54.088361 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:46:54.088370 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:54.088461 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:54.088576 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 15:46:54.088633 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 15:46:54.088821 13754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:54.086625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:34405 (local address 127.8.39.65:40101)
0808 15:46:54.087082 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:54.087099 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:54.087218 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:54.087469 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:54.087473 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:54.087490 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:54.088091 (+ 601us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:46:54.088094 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:54.088110 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:46:54.088149 (+ 39us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:54.088474 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:54.088478 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:54.088482 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 15:46:54.088588 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 15:46:54.088635 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":153,"threads_started":1}
I20260808 15:46:54.088936 13744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:54.087167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:39647 (local address 127.8.39.66:33843)
0808 15:46:54.087331 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:54.087336 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:54.087360 (+ 24us) server_negotiation.cc:407] Connection header received
0808 15:46:54.087421 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:54.087427 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:54.087466 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:54.087557 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:54.088499 (+ 942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:54.088504 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:54.088511 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:46:54.088529 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:54.088556 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:46:54.088569 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:54.088658 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:54.088763 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 15:46:54.088801 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 15:46:54.089438 13755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:54.086810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:33843 (local address 127.8.39.65:39647)
0808 15:46:54.087120 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:54.087133 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:54.087234 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:54.087585 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:54.087588 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:54.087599 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:54.088316 (+ 717us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:46:54.088318 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:54.088328 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:46:54.088355 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:54.088660 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:54.088663 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:54.088666 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 15:46:54.088748 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 15:46:54.088779 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":97,"threads_started":1}
I20260808 15:46:54.089681 13678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65f61c154719471196842f7472bde409" candidate_uuid: "f2a756fa43cd491f95ed70400405bba0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2838842a02fc43cba69b52f30912d6ed" is_pre_election: true
I20260808 15:46:54.090036 13542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65f61c154719471196842f7472bde409" candidate_uuid: "f2a756fa43cd491f95ed70400405bba0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4acede97f5474118b773bd1e820ff119" is_pre_election: true
I20260808 15:46:54.090080 13678 raft_consensus.cc:2454] T 65f61c154719471196842f7472bde409 P 2838842a02fc43cba69b52f30912d6ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2a756fa43cd491f95ed70400405bba0 in term 0.
I20260808 15:46:54.090296 13542 raft_consensus.cc:2454] T 65f61c154719471196842f7472bde409 P 4acede97f5474118b773bd1e820ff119 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2a756fa43cd491f95ed70400405bba0 in term 0.
I20260808 15:46:54.090633 13332 leader_election.cc:302] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2838842a02fc43cba69b52f30912d6ed, f2a756fa43cd491f95ed70400405bba0; no voters:
I20260808 15:46:54.090932 13753 raft_consensus.cc:2781] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:46:54.091034 13753 raft_consensus.cc:482] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:46:54.091094 13753 raft_consensus.cc:3037] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:54.092207 13753 raft_consensus.cc:504] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2a756fa43cd491f95ed70400405bba0" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 38261 } } peers { permanent_uuid: "2838842a02fc43cba69b52f30912d6ed" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34405 } } peers { permanent_uuid: "4acede97f5474118b773bd1e820ff119" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33843 } }
I20260808 15:46:54.092547 13753 leader_election.cc:288] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0 [CANDIDATE]: Term 1 election: Requested vote from peers 2838842a02fc43cba69b52f30912d6ed (127.8.39.67:34405), 4acede97f5474118b773bd1e820ff119 (127.8.39.66:33843)
I20260808 15:46:54.092891 13542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65f61c154719471196842f7472bde409" candidate_uuid: "f2a756fa43cd491f95ed70400405bba0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4acede97f5474118b773bd1e820ff119"
I20260808 15:46:54.093055 13542 raft_consensus.cc:3037] T 65f61c154719471196842f7472bde409 P 4acede97f5474118b773bd1e820ff119 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:54.093094 13678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65f61c154719471196842f7472bde409" candidate_uuid: "f2a756fa43cd491f95ed70400405bba0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2838842a02fc43cba69b52f30912d6ed"
I20260808 15:46:54.093250 13678 raft_consensus.cc:3037] T 65f61c154719471196842f7472bde409 P 2838842a02fc43cba69b52f30912d6ed [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:54.094542 13542 raft_consensus.cc:2454] T 65f61c154719471196842f7472bde409 P 4acede97f5474118b773bd1e820ff119 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2a756fa43cd491f95ed70400405bba0 in term 1.
I20260808 15:46:54.094763 13678 raft_consensus.cc:2454] T 65f61c154719471196842f7472bde409 P 2838842a02fc43cba69b52f30912d6ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2a756fa43cd491f95ed70400405bba0 in term 1.
I20260808 15:46:54.094934 13335 leader_election.cc:302] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4acede97f5474118b773bd1e820ff119, f2a756fa43cd491f95ed70400405bba0; no voters:
I20260808 15:46:54.095129 13753 raft_consensus.cc:2781] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:54.095358 13753 raft_consensus.cc:686] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0 [term 1 LEADER]: Becoming Leader. State: Replica: f2a756fa43cd491f95ed70400405bba0, State: Running, Role: LEADER
I20260808 15:46:54.095685 13753 consensus_queue.cc:237] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2a756fa43cd491f95ed70400405bba0" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 38261 } } peers { permanent_uuid: "2838842a02fc43cba69b52f30912d6ed" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34405 } } peers { permanent_uuid: "4acede97f5474118b773bd1e820ff119" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33843 } }
I20260808 15:46:54.098874 13255 catalog_manager.cc:5495] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2a756fa43cd491f95ed70400405bba0 (127.8.39.65). New cstate: current_term: 1 leader_uuid: "f2a756fa43cd491f95ed70400405bba0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2a756fa43cd491f95ed70400405bba0" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 38261 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2838842a02fc43cba69b52f30912d6ed" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4acede97f5474118b773bd1e820ff119" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33843 } health_report { overall_health: UNKNOWN } } }
W20260808 15:46:54.113484 13591 tablet.cc:2369] T 65f61c154719471196842f7472bde409 P 4acede97f5474118b773bd1e820ff119: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:46:54.146903 13741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:54.145236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48872 (local address 127.8.39.65:38261)
0808 15:46:54.145381 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:54.145386 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:54.145402 (+ 16us) server_negotiation.cc:407] Connection header received
0808 15:46:54.145506 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:54.145508 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:54.145569 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:54.145671 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:54.146438 (+ 767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:54.146442 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:54.146445 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:46:54.146457 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:54.146490 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:46:54.146498 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:54.146601 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:54.146667 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 15:46:54.146740 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 15:46:54.153472 13542 raft_consensus.cc:1261] T 65f61c154719471196842f7472bde409 P 4acede97f5474118b773bd1e820ff119 [term 1 FOLLOWER]: Refusing update from remote peer f2a756fa43cd491f95ed70400405bba0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:46:54.153473 13678 raft_consensus.cc:1261] T 65f61c154719471196842f7472bde409 P 2838842a02fc43cba69b52f30912d6ed [term 1 FOLLOWER]: Refusing update from remote peer f2a756fa43cd491f95ed70400405bba0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:46:54.154277 13753 consensus_queue.cc:1035] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4acede97f5474118b773bd1e820ff119" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:46:54.154542 13756 consensus_queue.cc:1035] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2838842a02fc43cba69b52f30912d6ed" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 34405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:46:54.164455 13759 mvcc.cc:205] Tried to move back new op lower bound from 7316291641963847680 to 7316291641738829824. Current Snapshot: MvccSnapshot[applied={T|T < 7316291641963847680}]
I20260808 15:46:54.164776 13760 mvcc.cc:205] Tried to move back new op lower bound from 7316291641963847680 to 7316291641738829824. Current Snapshot: MvccSnapshot[applied={T|T < 7316291641963847680}]
I20260808 15:46:54.164875 13761 mvcc.cc:205] Tried to move back new op lower bound from 7316291641963847680 to 7316291641738829824. Current Snapshot: MvccSnapshot[applied={T|T < 7316291641963847680}]
I20260808 15:46:54.174228 13254 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:46:54.174422 13254 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:46:54.177196 13254 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 10fc39c64b774914851ef7dfed87118d: Sending DeleteTablet for 3 replicas of tablet 65f61c154719471196842f7472bde409
I20260808 15:46:54.178195 13658 tablet_service.cc:1514] Processing DeleteTablet for tablet 65f61c154719471196842f7472bde409 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:46:54 UTC) from {username='slave'} at 127.0.0.1:53538
I20260808 15:46:54.178213 13522 tablet_service.cc:1514] Processing DeleteTablet for tablet 65f61c154719471196842f7472bde409 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:46:54 UTC) from {username='slave'} at 127.0.0.1:35018
I20260808 15:46:54.178860 13768 tablet_replica.cc:330] T 65f61c154719471196842f7472bde409 P 2838842a02fc43cba69b52f30912d6ed: stopping tablet replica
I20260808 15:46:54.179203 13384 tablet_service.cc:1514] Processing DeleteTablet for tablet 65f61c154719471196842f7472bde409 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:46:54 UTC) from {username='slave'} at 127.0.0.1:48858
I20260808 15:46:54.179256 13768 raft_consensus.cc:2229] T 65f61c154719471196842f7472bde409 P 2838842a02fc43cba69b52f30912d6ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:46:54.179663 13768 raft_consensus.cc:2258] T 65f61c154719471196842f7472bde409 P 2838842a02fc43cba69b52f30912d6ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:46:54.179739 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 13316
I20260808 15:46:54.179855 13770 tablet_replica.cc:330] T 65f61c154719471196842f7472bde409 P f2a756fa43cd491f95ed70400405bba0: stopping tablet replica
I20260808 15:46:54.180105 13769 tablet_replica.cc:330] T 65f61c154719471196842f7472bde409 P 4acede97f5474118b773bd1e820ff119: stopping tablet replica
I20260808 15:46:54.180408 13769 raft_consensus.cc:2229] T 65f61c154719471196842f7472bde409 P 4acede97f5474118b773bd1e820ff119 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:46:54.180743 13769 raft_consensus.cc:2258] T 65f61c154719471196842f7472bde409 P 4acede97f5474118b773bd1e820ff119 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:46:54.182478 13769 ts_tablet_manager.cc:1905] T 65f61c154719471196842f7472bde409 P 4acede97f5474118b773bd1e820ff119: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:46:54.182865 13768 ts_tablet_manager.cc:1905] T 65f61c154719471196842f7472bde409 P 2838842a02fc43cba69b52f30912d6ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:46:54.185879 13768 ts_tablet_manager.cc:1918] T 65f61c154719471196842f7472bde409 P 2838842a02fc43cba69b52f30912d6ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:46:54.185890 13769 ts_tablet_manager.cc:1918] T 65f61c154719471196842f7472bde409 P 4acede97f5474118b773bd1e820ff119: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:46:54.186004 13768 log.cc:1196] T 65f61c154719471196842f7472bde409 P 2838842a02fc43cba69b52f30912d6ed: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/65f61c154719471196842f7472bde409
I20260808 15:46:54.186049 13769 log.cc:1196] T 65f61c154719471196842f7472bde409 P 4acede97f5474118b773bd1e820ff119: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786203987027663-8349-0/minicluster-data/ts-1/wal/wals/65f61c154719471196842f7472bde409
I20260808 15:46:54.186430 13768 ts_tablet_manager.cc:1939] T 65f61c154719471196842f7472bde409 P 2838842a02fc43cba69b52f30912d6ed: Deleting consensus metadata
I20260808 15:46:54.186452 13769 ts_tablet_manager.cc:1939] T 65f61c154719471196842f7472bde409 P 4acede97f5474118b773bd1e820ff119: Deleting consensus metadata
I20260808 15:46:54.187914 13239 catalog_manager.cc:4841] TS 2838842a02fc43cba69b52f30912d6ed (127.8.39.67:34405): tablet 65f61c154719471196842f7472bde409 (table test-table [id=286f286a0d104144aba82ff21cc5101f]) successfully deleted
I20260808 15:46:54.187914 13242 catalog_manager.cc:4841] TS 4acede97f5474118b773bd1e820ff119 (127.8.39.66:33843): tablet 65f61c154719471196842f7472bde409 (table test-table [id=286f286a0d104144aba82ff21cc5101f]) successfully deleted
W20260808 15:46:54.189452 13242 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.39.65:38261 (error 108)
I20260808 15:46:54.189495 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 13457
I20260808 15:46:54.190755 13743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:54.190389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:38261 (local address 127.0.0.1:48876)
0808 15:46:54.190509 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:54.190610 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.65:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 15:46:54.190932 13242 catalog_manager.cc:4584] TS f2a756fa43cd491f95ed70400405bba0 (127.8.39.65:38261): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 65f61c154719471196842f7472bde409: Network error: Client connection negotiation failed: client connection to 127.8.39.65:38261: connect: Connection refused (error 111)
I20260808 15:46:54.201522 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 13593
I20260808 15:46:54.208241 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 13222
2026-08-08T15:46:54Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1246 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 15:46:54.232241 8349 mini_oidc.cc:152] Starting JWKS server
I20260808 15:46:54.233946 8349 webserver.cc:460] Webserver started at https://127.0.0.1:42063/ using document root <none> and password file <none>
I20260808 15:46:54.234119 8349 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 15:46:54.234412 8349 webserver.cc:460] Webserver started at http://127.0.0.1:46321/ using document root <none> and password file <none>
2026-08-08T15:46:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:46:54Z Disabled control of system clock
I20260808 15:46:54.245373 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:42221
--webserver_interface=127.8.39.126
--webserver_port=0
--builtin_ntp_servers=127.8.39.84:40013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:42221
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42063/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786203987027663-8349-0/testchainca.cert with env {}
W20260808 15:46:54.359592 13778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:54.359861 13778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:54.359903 13778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:54.364001 13778 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:46:54.364075 13778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:54.364091 13778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:54.364108 13778 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:46:54.364125 13778 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 15:46:54.364140 13778 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 15:46:54.364154 13778 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42063/jwks.json
I20260808 15:46:54.369488 13778 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:40013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:42221
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:42221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42063/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786203987027663-8349-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13778
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:54.370504 13778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:54.371598 13778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:54.380157 13786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:54.380193 13783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:54.380232 13778 server_base.cc:1034] running on GCE node
W20260808 15:46:54.380149 13784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:54.380918 13778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:54.382037 13778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:54.383273 13778 hybrid_clock.cc:648] HybridClock initialized: now 1786204014383257 us; error 52 us; skew 500 ppm
I20260808 15:46:54.385200 13778 webserver.cc:460] Webserver started at http://127.8.39.126:35815/ using document root <none> and password file <none>
I20260808 15:46:54.385778 13778 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:54.385845 13778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:54.386056 13778 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:54.388157 13778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "9eb18c07fec34ffc8e133741b5b4bcdf"
format_stamp: "Formatted at 2026-08-08 15:46:54 on dist-test-slave-8tdl"
server_key: "7f9b6148e13d98e8ba02f81c6139fe9c"
server_key_iv: "36c8998d67f72ecac211897999a5d9ed"
server_key_version: "encryptionkey@0"
I20260808 15:46:54.388813 13778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "9eb18c07fec34ffc8e133741b5b4bcdf"
format_stamp: "Formatted at 2026-08-08 15:46:54 on dist-test-slave-8tdl"
server_key: "7f9b6148e13d98e8ba02f81c6139fe9c"
server_key_iv: "36c8998d67f72ecac211897999a5d9ed"
server_key_version: "encryptionkey@0"
I20260808 15:46:54.392573 13778 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 15:46:54.395116 13792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:54.396365 13778 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 15:46:54.396550 13778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "9eb18c07fec34ffc8e133741b5b4bcdf"
format_stamp: "Formatted at 2026-08-08 15:46:54 on dist-test-slave-8tdl"
server_key: "7f9b6148e13d98e8ba02f81c6139fe9c"
server_key_iv: "36c8998d67f72ecac211897999a5d9ed"
server_key_version: "encryptionkey@0"
I20260808 15:46:54.396670 13778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:54.414465 13778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:54.415339 13778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:54.415570 13778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:54.423462 13778 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:42221
I20260808 15:46:54.423545 13849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:42221 every 8 connection(s)
I20260808 15:46:54.424542 13778 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:46:54.427883 13850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:54.432189 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 13778
I20260808 15:46:54.432340 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:46:54.432646 8349 external_mini_cluster.cc:1428] Setting key 55b14b62cb17b2c29028d2364b13d4b6
I20260808 15:46:54.434162 13850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eb18c07fec34ffc8e133741b5b4bcdf: Bootstrap starting.
I20260808 15:46:54.436645 13850 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9eb18c07fec34ffc8e133741b5b4bcdf: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:54.437597 13850 log.cc:824] T 00000000000000000000000000000000 P 9eb18c07fec34ffc8e133741b5b4bcdf: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:54.439597 13850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eb18c07fec34ffc8e133741b5b4bcdf: No bootstrap required, opened a new log
I20260808 15:46:54.442246 13853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:54.434073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50830 (local address 127.8.39.126:42221)
0808 15:46:54.434864 (+ 791us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:54.434880 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:54.434919 (+ 39us) server_negotiation.cc:407] Connection header received
0808 15:46:54.435592 (+ 673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:54.435609 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:54.436001 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:54.436334 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:54.436829 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:54.437831 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:54.438744 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:54.439210 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:54.439385 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:54.440292 (+ 907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:54.440305 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:54.440317 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:46:54.440724 (+ 407us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:54.440781 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:46:54.440800 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:54.440911 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:54.441087 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 15:46:54.441348 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":136,"threads_started":1}
I20260808 15:46:54.443001 13850 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9eb18c07fec34ffc8e133741b5b4bcdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb18c07fec34ffc8e133741b5b4bcdf" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42221 } }
I20260808 15:46:54.443252 13850 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9eb18c07fec34ffc8e133741b5b4bcdf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:54.443308 13850 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9eb18c07fec34ffc8e133741b5b4bcdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eb18c07fec34ffc8e133741b5b4bcdf, State: Initialized, Role: FOLLOWER
I20260808 15:46:54.443773 13850 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9eb18c07fec34ffc8e133741b5b4bcdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb18c07fec34ffc8e133741b5b4bcdf" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42221 } }
I20260808 15:46:54.443931 13850 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9eb18c07fec34ffc8e133741b5b4bcdf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:46:54.444042 13850 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9eb18c07fec34ffc8e133741b5b4bcdf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:46:54.444155 13850 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9eb18c07fec34ffc8e133741b5b4bcdf [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:54.445132 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:46:54.445345 13850 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9eb18c07fec34ffc8e133741b5b4bcdf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb18c07fec34ffc8e133741b5b4bcdf" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42221 } }
I20260808 15:46:54.445686 13850 leader_election.cc:302] T 00000000000000000000000000000000 P 9eb18c07fec34ffc8e133741b5b4bcdf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9eb18c07fec34ffc8e133741b5b4bcdf; no voters:
I20260808 15:46:54.446067 13850 leader_election.cc:288] T 00000000000000000000000000000000 P 9eb18c07fec34ffc8e133741b5b4bcdf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:46:54.446501 13856 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9eb18c07fec34ffc8e133741b5b4bcdf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:54.446877 13856 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9eb18c07fec34ffc8e133741b5b4bcdf [term 1 LEADER]: Becoming Leader. State: Replica: 9eb18c07fec34ffc8e133741b5b4bcdf, State: Running, Role: LEADER
I20260808 15:46:54.447294 13856 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9eb18c07fec34ffc8e133741b5b4bcdf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb18c07fec34ffc8e133741b5b4bcdf" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42221 } }
I20260808 15:46:54.447499 13850 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9eb18c07fec34ffc8e133741b5b4bcdf [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:46:54.448596 13856 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eb18c07fec34ffc8e133741b5b4bcdf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9eb18c07fec34ffc8e133741b5b4bcdf. Latest consensus state: current_term: 1 leader_uuid: "9eb18c07fec34ffc8e133741b5b4bcdf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb18c07fec34ffc8e133741b5b4bcdf" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42221 } } }
I20260808 15:46:54.448730 13856 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eb18c07fec34ffc8e133741b5b4bcdf [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:54.449004 13855 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eb18c07fec34ffc8e133741b5b4bcdf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9eb18c07fec34ffc8e133741b5b4bcdf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb18c07fec34ffc8e133741b5b4bcdf" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42221 } } }
I20260808 15:46:54.449134 13855 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eb18c07fec34ffc8e133741b5b4bcdf [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:54.449126 13866 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:46:54.452505 13866 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:46:54.458472 13866 catalog_manager.cc:1347] Generated new cluster ID: 4d7cf2ec7e7f4a2d8d9e51919c0049cd
I20260808 15:46:54.458552 13866 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:46:54.478366 13866 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:46:54.479391 13866 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:46:54.486519 13866 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9eb18c07fec34ffc8e133741b5b4bcdf: Generated new TSK 0
I20260808 15:46:54.487432 13866 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 15:46:54.525339 13884 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 15:46:54.525542 13884 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 15:46:54.526114 13853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:54.508806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50844 (local address 127.8.39.126:42221)
0808 15:46:54.508974 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:54.508978 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:54.509148 (+ 170us) server_negotiation.cc:407] Connection header received
0808 15:46:54.509357 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:54.509359 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:54.509407 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:54.509493 (+ 86us) server_negotiation.cc:226] Negotiated authn=JWT
0808 15:46:54.509807 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:54.510355 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:54.511622 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:54.511847 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:54.511928 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:54.512328 (+ 400us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 15:46:54.525680 (+ 13352us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42063/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 15:46:54.525989 (+ 309us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50844: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42063/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":37}
W20260808 15:46:54.526227 13853 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50844: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42063/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260808 15:46:54.527980 13883 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:46:54.508665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:42221 (local address 127.0.0.1:50844)
0808 15:46:54.509053 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:54.509068 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:54.509203 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:54.509533 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:54.509537 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:54.509544 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0808 15:46:54.509671 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:54.509678 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:54.510472 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:54.510476 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:54.511505 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:54.511516 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:54.511969 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:54.511973 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:54.512070 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:54.512125 (+ 55us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 15:46:54.525975 (+ 13850us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42063/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 15:46:54.526261 (+ 286us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.8.39.126:42221: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42063/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":279,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.8.39.126:42221: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42063/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 15:46:54.528865 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 13778
2026-08-08T15:46:54Z chronyd exiting
I20260808 15:46:54.568171 8349 test_util.cc:175] -----------------------------------------------
I20260808 15:46:54.568285 8349 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786203987027663-8349-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (337 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 15:46:54.569540 8349 mini_oidc.cc:152] Starting JWKS server
I20260808 15:46:54.570422 8349 webserver.cc:460] Webserver started at https://127.0.0.1:41007/ using document root <none> and password file <none>
I20260808 15:46:54.570557 8349 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 15:46:54.570919 8349 webserver.cc:460] Webserver started at http://127.0.0.1:33265/ using document root <none> and password file <none>
2026-08-08T15:46:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:46:54Z Disabled control of system clock
I20260808 15:46:54.581180 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:38205
--webserver_interface=127.8.39.126
--webserver_port=0
--builtin_ntp_servers=127.8.39.84:43235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:38205
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41007/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786203987027663-8349-0/testchainca.cert with env {}
W20260808 15:46:54.692956 13890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:54.693239 13890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:54.693280 13890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:54.697445 13890 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:46:54.697513 13890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:54.697530 13890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:54.697546 13890 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:46:54.697562 13890 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 15:46:54.697624 13890 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 15:46:54.697654 13890 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41007/jwks.json
I20260808 15:46:54.703229 13890 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:43235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:38205
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:38205
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41007/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786203987027663-8349-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13890
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:54.704352 13890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:54.705377 13890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:54.713896 13899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:54.713891 13897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:54.713891 13896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:54.714000 13890 server_base.cc:1034] running on GCE node
I20260808 15:46:54.714766 13890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:54.715904 13890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:54.717100 13890 hybrid_clock.cc:648] HybridClock initialized: now 1786204014717088 us; error 37 us; skew 500 ppm
I20260808 15:46:54.719041 13890 webserver.cc:460] Webserver started at http://127.8.39.126:42223/ using document root <none> and password file <none>
I20260808 15:46:54.719626 13890 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:54.719723 13890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:54.719959 13890 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:54.722244 13890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "a89cbaf403324ba69eb98c49170821b8"
format_stamp: "Formatted at 2026-08-08 15:46:54 on dist-test-slave-8tdl"
server_key: "ca2f7f19a700d45cbda868c201c19afd"
server_key_iv: "4cad7ad41d2b8ff53ab1c41cfad59bec"
server_key_version: "encryptionkey@0"
I20260808 15:46:54.722958 13890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "a89cbaf403324ba69eb98c49170821b8"
format_stamp: "Formatted at 2026-08-08 15:46:54 on dist-test-slave-8tdl"
server_key: "ca2f7f19a700d45cbda868c201c19afd"
server_key_iv: "4cad7ad41d2b8ff53ab1c41cfad59bec"
server_key_version: "encryptionkey@0"
I20260808 15:46:54.727519 13890 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 15:46:54.730170 13906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:54.731670 13890 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:46:54.731822 13890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "a89cbaf403324ba69eb98c49170821b8"
format_stamp: "Formatted at 2026-08-08 15:46:54 on dist-test-slave-8tdl"
server_key: "ca2f7f19a700d45cbda868c201c19afd"
server_key_iv: "4cad7ad41d2b8ff53ab1c41cfad59bec"
server_key_version: "encryptionkey@0"
I20260808 15:46:54.731956 13890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:54.753346 13890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:54.754139 13890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:54.754367 13890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:54.761504 13890 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:38205
I20260808 15:46:54.761521 13959 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:38205 every 8 connection(s)
I20260808 15:46:54.762513 13890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:46:54.765827 13960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:54.767622 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 13890
I20260808 15:46:54.767758 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:46:54.768064 8349 external_mini_cluster.cc:1428] Setting key e00555338d2afe76978242e82bebb0d7
I20260808 15:46:54.772814 13960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a89cbaf403324ba69eb98c49170821b8: Bootstrap starting.
I20260808 15:46:54.775746 13960 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a89cbaf403324ba69eb98c49170821b8: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:54.776573 13960 log.cc:824] T 00000000000000000000000000000000 P a89cbaf403324ba69eb98c49170821b8: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:54.777884 13963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:54.769589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54068 (local address 127.8.39.126:38205)
0808 15:46:54.770256 (+ 667us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:54.770273 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:54.770310 (+ 37us) server_negotiation.cc:407] Connection header received
0808 15:46:54.771075 (+ 765us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:54.771093 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:54.771549 (+ 456us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:54.771831 (+ 282us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:54.772177 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:54.773214 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:54.774443 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:54.775053 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:54.775182 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:54.776060 (+ 878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:54.776064 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:54.776077 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:46:54.776477 (+ 400us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:54.776539 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:46:54.776559 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:54.776640 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:54.776848 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 15:46:54.777160 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":138,"threads_started":1}
I20260808 15:46:54.778718 13960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a89cbaf403324ba69eb98c49170821b8: No bootstrap required, opened a new log
I20260808 15:46:54.780928 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:46:54.783306 13960 raft_consensus.cc:348] T 00000000000000000000000000000000 P a89cbaf403324ba69eb98c49170821b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a89cbaf403324ba69eb98c49170821b8" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 38205 } }
I20260808 15:46:54.783579 13960 raft_consensus.cc:374] T 00000000000000000000000000000000 P a89cbaf403324ba69eb98c49170821b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:54.783638 13960 raft_consensus.cc:729] T 00000000000000000000000000000000 P a89cbaf403324ba69eb98c49170821b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89cbaf403324ba69eb98c49170821b8, State: Initialized, Role: FOLLOWER
I20260808 15:46:54.784051 13960 consensus_queue.cc:260] T 00000000000000000000000000000000 P a89cbaf403324ba69eb98c49170821b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a89cbaf403324ba69eb98c49170821b8" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 38205 } }
I20260808 15:46:54.784199 13960 raft_consensus.cc:388] T 00000000000000000000000000000000 P a89cbaf403324ba69eb98c49170821b8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:46:54.784291 13960 raft_consensus.cc:482] T 00000000000000000000000000000000 P a89cbaf403324ba69eb98c49170821b8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:46:54.784391 13960 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a89cbaf403324ba69eb98c49170821b8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:54.785392 13960 raft_consensus.cc:504] T 00000000000000000000000000000000 P a89cbaf403324ba69eb98c49170821b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a89cbaf403324ba69eb98c49170821b8" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 38205 } }
I20260808 15:46:54.785753 13960 leader_election.cc:302] T 00000000000000000000000000000000 P a89cbaf403324ba69eb98c49170821b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a89cbaf403324ba69eb98c49170821b8; no voters:
I20260808 15:46:54.786140 13960 leader_election.cc:288] T 00000000000000000000000000000000 P a89cbaf403324ba69eb98c49170821b8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:46:54.786321 13965 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a89cbaf403324ba69eb98c49170821b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:54.786592 13965 raft_consensus.cc:686] T 00000000000000000000000000000000 P a89cbaf403324ba69eb98c49170821b8 [term 1 LEADER]: Becoming Leader. State: Replica: a89cbaf403324ba69eb98c49170821b8, State: Running, Role: LEADER
I20260808 15:46:54.786967 13965 consensus_queue.cc:237] T 00000000000000000000000000000000 P a89cbaf403324ba69eb98c49170821b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a89cbaf403324ba69eb98c49170821b8" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 38205 } }
I20260808 15:46:54.787577 13960 sys_catalog.cc:564] T 00000000000000000000000000000000 P a89cbaf403324ba69eb98c49170821b8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:46:54.788874 13967 sys_catalog.cc:455] T 00000000000000000000000000000000 P a89cbaf403324ba69eb98c49170821b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a89cbaf403324ba69eb98c49170821b8. Latest consensus state: current_term: 1 leader_uuid: "a89cbaf403324ba69eb98c49170821b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a89cbaf403324ba69eb98c49170821b8" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 38205 } } }
I20260808 15:46:54.789050 13967 sys_catalog.cc:458] T 00000000000000000000000000000000 P a89cbaf403324ba69eb98c49170821b8 [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:54.788890 13966 sys_catalog.cc:455] T 00000000000000000000000000000000 P a89cbaf403324ba69eb98c49170821b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a89cbaf403324ba69eb98c49170821b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a89cbaf403324ba69eb98c49170821b8" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 38205 } } }
I20260808 15:46:54.789108 13966 sys_catalog.cc:458] T 00000000000000000000000000000000 P a89cbaf403324ba69eb98c49170821b8 [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:54.789983 13975 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:46:54.793161 13975 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:46:54.798939 13975 catalog_manager.cc:1347] Generated new cluster ID: acc0e993042b40cb8e9d3bb8503b658c
I20260808 15:46:54.799019 13975 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:46:54.827368 13975 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:46:54.828668 13975 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:46:54.837664 13975 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a89cbaf403324ba69eb98c49170821b8: Generated new TSK 0
I20260808 15:46:54.838493 13975 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 15:46:54.872794 13991 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 15:46:54.872910 13991 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 15:46:54.873754 13963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:54.854108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54082 (local address 127.8.39.126:38205)
0808 15:46:54.854261 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:54.854268 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:54.854436 (+ 168us) server_negotiation.cc:407] Connection header received
0808 15:46:54.854603 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:54.854605 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:54.854652 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:54.854796 (+ 144us) server_negotiation.cc:226] Negotiated authn=JWT
0808 15:46:54.855082 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:54.855605 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:54.856870 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:54.857127 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:54.857209 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:54.857545 (+ 336us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 15:46:54.873251 (+ 15706us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41007/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 15:46:54.873597 (+ 346us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54082: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41007/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":60}
W20260808 15:46:54.873791 13990 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:46:54.854021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:38205 (local address 127.0.0.1:54082)
0808 15:46:54.854339 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:54.854355 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:54.854487 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:54.854819 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:54.854822 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:54.854844 (+ 22us) client_negotiation.cc:189] Negotiated authn=JWT
0808 15:46:54.854970 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:54.854976 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:54.855737 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:54.855741 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:54.856746 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:54.856756 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:54.857250 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:54.857254 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:54.857348 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:54.857377 (+ 29us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 15:46:54.873489 (+ 16112us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41007/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 15:46:54.873647 (+ 158us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.8.39.126:38205: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41007/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":107,"threads_started":1}
W20260808 15:46:54.873833 13963 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54082: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41007/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260808 15:46:54.874728 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 13890
2026-08-08T15:46:54Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (347 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 15:46:54.916733 8349 mini_oidc.cc:152] Starting JWKS server
I20260808 15:46:54.917699 8349 webserver.cc:460] Webserver started at https://127.0.0.1:45637/ using document root <none> and password file <none>
I20260808 15:46:54.917838 8349 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 15:46:54.918119 8349 webserver.cc:460] Webserver started at http://127.0.0.1:43907/ using document root <none> and password file <none>
2026-08-08T15:46:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:46:54Z Disabled control of system clock
I20260808 15:46:54.928854 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:42129
--webserver_interface=127.8.39.126
--webserver_port=0
--builtin_ntp_servers=127.8.39.84:36279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:42129
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45637/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 15:46:55.041579 13997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:55.041858 13997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:55.041898 13997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:55.045972 13997 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:46:55.046046 13997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:55.046062 13997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:55.046087 13997 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:46:55.046103 13997 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 15:46:55.046119 13997 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 15:46:55.046132 13997 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45637/jwks.json
I20260808 15:46:55.050813 13997 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:36279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:42129
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:42129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45637/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:55.051856 13997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:55.053215 13997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:55.062083 14005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:55.062180 14007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:55.062232 13997 server_base.cc:1034] running on GCE node
W20260808 15:46:55.062083 14002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:55.063004 13997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:55.064149 13997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:55.065339 13997 hybrid_clock.cc:648] HybridClock initialized: now 1786204015065306 us; error 52 us; skew 500 ppm
I20260808 15:46:55.067318 13997 webserver.cc:460] Webserver started at http://127.8.39.126:45467/ using document root <none> and password file <none>
I20260808 15:46:55.067898 13997 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:55.067963 13997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:55.068236 13997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:55.070422 13997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "788f7db397d0454ea5841a93acf4a8e8"
format_stamp: "Formatted at 2026-08-08 15:46:55 on dist-test-slave-8tdl"
server_key: "7b152f56d92fb8dfbd12ae0c7d39e0a2"
server_key_iv: "5f6c4ec8df2e89c72c4f6381b6fdc768"
server_key_version: "encryptionkey@0"
I20260808 15:46:55.071110 13997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "788f7db397d0454ea5841a93acf4a8e8"
format_stamp: "Formatted at 2026-08-08 15:46:55 on dist-test-slave-8tdl"
server_key: "7b152f56d92fb8dfbd12ae0c7d39e0a2"
server_key_iv: "5f6c4ec8df2e89c72c4f6381b6fdc768"
server_key_version: "encryptionkey@0"
I20260808 15:46:55.075237 13997 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 15:46:55.077704 14014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:55.079056 13997 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:46:55.079210 13997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "788f7db397d0454ea5841a93acf4a8e8"
format_stamp: "Formatted at 2026-08-08 15:46:55 on dist-test-slave-8tdl"
server_key: "7b152f56d92fb8dfbd12ae0c7d39e0a2"
server_key_iv: "5f6c4ec8df2e89c72c4f6381b6fdc768"
server_key_version: "encryptionkey@0"
I20260808 15:46:55.079339 13997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:55.114948 13997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:55.115712 13997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:55.115938 13997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:55.123422 13997 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:42129
I20260808 15:46:55.123438 14069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:42129 every 8 connection(s)
I20260808 15:46:55.124444 13997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:46:55.125615 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 13997
I20260808 15:46:55.125731 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:46:55.126055 8349 external_mini_cluster.cc:1428] Setting key 513f057cf30592f5973884265713ca88
I20260808 15:46:55.128309 14070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:55.134127 14070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 788f7db397d0454ea5841a93acf4a8e8: Bootstrap starting.
I20260808 15:46:55.135531 14073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:55.127540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48420 (local address 127.8.39.126:42129)
0808 15:46:55.128235 (+ 695us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:55.128264 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:55.128312 (+ 48us) server_negotiation.cc:407] Connection header received
0808 15:46:55.129050 (+ 738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:55.129066 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:55.129445 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:55.129801 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:55.130223 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:55.131272 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:55.132166 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:55.132627 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:55.132797 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:55.133693 (+ 896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:55.133698 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:55.133710 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:46:55.134146 (+ 436us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:55.134200 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:46:55.134221 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:55.134337 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:55.134500 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 15:46:55.134816 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":154,"threads_started":1}
I20260808 15:46:55.136698 14070 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 788f7db397d0454ea5841a93acf4a8e8: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:55.137588 14070 log.cc:824] T 00000000000000000000000000000000 P 788f7db397d0454ea5841a93acf4a8e8: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:55.138527 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:46:55.140033 14070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 788f7db397d0454ea5841a93acf4a8e8: No bootstrap required, opened a new log
I20260808 15:46:55.143714 14070 raft_consensus.cc:348] T 00000000000000000000000000000000 P 788f7db397d0454ea5841a93acf4a8e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "788f7db397d0454ea5841a93acf4a8e8" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42129 } }
I20260808 15:46:55.143985 14070 raft_consensus.cc:374] T 00000000000000000000000000000000 P 788f7db397d0454ea5841a93acf4a8e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:55.144059 14070 raft_consensus.cc:729] T 00000000000000000000000000000000 P 788f7db397d0454ea5841a93acf4a8e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 788f7db397d0454ea5841a93acf4a8e8, State: Initialized, Role: FOLLOWER
I20260808 15:46:55.144552 14070 consensus_queue.cc:260] T 00000000000000000000000000000000 P 788f7db397d0454ea5841a93acf4a8e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "788f7db397d0454ea5841a93acf4a8e8" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42129 } }
I20260808 15:46:55.144709 14070 raft_consensus.cc:388] T 00000000000000000000000000000000 P 788f7db397d0454ea5841a93acf4a8e8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:46:55.144783 14070 raft_consensus.cc:482] T 00000000000000000000000000000000 P 788f7db397d0454ea5841a93acf4a8e8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:46:55.144892 14070 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 788f7db397d0454ea5841a93acf4a8e8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:55.146014 14070 raft_consensus.cc:504] T 00000000000000000000000000000000 P 788f7db397d0454ea5841a93acf4a8e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "788f7db397d0454ea5841a93acf4a8e8" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42129 } }
I20260808 15:46:55.146381 14070 leader_election.cc:302] T 00000000000000000000000000000000 P 788f7db397d0454ea5841a93acf4a8e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 788f7db397d0454ea5841a93acf4a8e8; no voters:
I20260808 15:46:55.146809 14070 leader_election.cc:288] T 00000000000000000000000000000000 P 788f7db397d0454ea5841a93acf4a8e8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:46:55.146937 14075 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 788f7db397d0454ea5841a93acf4a8e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:55.147197 14075 raft_consensus.cc:686] T 00000000000000000000000000000000 P 788f7db397d0454ea5841a93acf4a8e8 [term 1 LEADER]: Becoming Leader. State: Replica: 788f7db397d0454ea5841a93acf4a8e8, State: Running, Role: LEADER
I20260808 15:46:55.147507 14075 consensus_queue.cc:237] T 00000000000000000000000000000000 P 788f7db397d0454ea5841a93acf4a8e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "788f7db397d0454ea5841a93acf4a8e8" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42129 } }
I20260808 15:46:55.148106 14070 sys_catalog.cc:564] T 00000000000000000000000000000000 P 788f7db397d0454ea5841a93acf4a8e8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:46:55.149326 14076 sys_catalog.cc:455] T 00000000000000000000000000000000 P 788f7db397d0454ea5841a93acf4a8e8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "788f7db397d0454ea5841a93acf4a8e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "788f7db397d0454ea5841a93acf4a8e8" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42129 } } }
I20260808 15:46:55.149356 14077 sys_catalog.cc:455] T 00000000000000000000000000000000 P 788f7db397d0454ea5841a93acf4a8e8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 788f7db397d0454ea5841a93acf4a8e8. Latest consensus state: current_term: 1 leader_uuid: "788f7db397d0454ea5841a93acf4a8e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "788f7db397d0454ea5841a93acf4a8e8" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42129 } } }
I20260808 15:46:55.149494 14077 sys_catalog.cc:458] T 00000000000000000000000000000000 P 788f7db397d0454ea5841a93acf4a8e8 [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:55.149493 14076 sys_catalog.cc:458] T 00000000000000000000000000000000 P 788f7db397d0454ea5841a93acf4a8e8 [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:55.149937 14084 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:46:55.152859 14084 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:46:55.158115 14084 catalog_manager.cc:1347] Generated new cluster ID: 982bd5b306704854836f6d907766fe0e
I20260808 15:46:55.158186 14084 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:46:55.178980 14084 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:46:55.180289 14084 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:46:55.187136 14084 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 788f7db397d0454ea5841a93acf4a8e8: Generated new TSK 0
I20260808 15:46:55.187975 14084 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:46:55.204530 14073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:55.198798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48432 (local address 127.8.39.126:42129)
0808 15:46:55.198949 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:55.198954 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:55.199213 (+ 259us) server_negotiation.cc:407] Connection header received
0808 15:46:55.199346 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:55.199348 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:55.199396 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:55.199494 (+ 98us) server_negotiation.cc:226] Negotiated authn=JWT
0808 15:46:55.199768 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:55.200324 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:55.201588 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:55.201921 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:55.202020 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:55.202414 (+ 394us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 15:46:55.204131 (+ 1717us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45637/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 15:46:55.204380 (+ 249us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48432: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45637/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":58}
W20260808 15:46:55.204612 14073 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48432: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45637/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260808 15:46:55.206663 14099 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:46:55.198730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:42129 (local address 127.0.0.1:48432)
0808 15:46:55.199086 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:55.199101 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:55.199218 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:55.199531 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:55.199534 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:55.199542 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0808 15:46:55.199659 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:55.199666 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:55.200452 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:55.200456 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:55.201434 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:55.201444 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:55.202069 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:55.202073 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:55.202166 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:55.202195 (+ 29us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 15:46:55.204320 (+ 2125us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45637/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 15:46:55.206447 (+ 2127us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.8.39.126:42129: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45637/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":266,"mutex_wait_us":1921,"thread_start_us":133,"threads_started":1}
I20260808 15:46:55.207427 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 13997
E20260808 15:46:55.217224 14100 webserver.cc:533] Webserver: sslize failed:
E20260808 15:46:55.217298 14100 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-08T15:46:55Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (332 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T15:46:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:46:55Z Disabled control of system clock
I20260808 15:46:55.259542 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:34087
--webserver_interface=127.8.39.126
--webserver_port=0
--builtin_ntp_servers=127.8.39.84:35147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:34087
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786203987027663-8349-0/testchainca.cert with env {}
W20260808 15:46:55.372874 14104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:55.373160 14104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:55.373202 14104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:55.377337 14104 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:46:55.377405 14104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:55.377421 14104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:55.377439 14104 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:46:55.377453 14104 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 15:46:55.377470 14104 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 15:46:55.377483 14104 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 15:46:55.383133 14104 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:35147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:34087
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:34087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786203987027663-8349-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:55.384181 14104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:55.385229 14104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:55.393810 14110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:55.393813 14109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:55.393805 14112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:55.394177 14104 server_base.cc:1034] running on GCE node
I20260808 15:46:55.394876 14104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:55.396010 14104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:55.397195 14104 hybrid_clock.cc:648] HybridClock initialized: now 1786204015397164 us; error 42 us; skew 500 ppm
I20260808 15:46:55.402467 14104 webserver.cc:460] Webserver started at http://127.8.39.126:42455/ using document root <none> and password file <none>
I20260808 15:46:55.403185 14104 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:55.403258 14104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:55.403474 14104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:55.405651 14104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "88c6031181e9462c91c800b873ee7e7b"
format_stamp: "Formatted at 2026-08-08 15:46:55 on dist-test-slave-8tdl"
server_key: "268b969123d1c7e856aa1b008d4a1939"
server_key_iv: "52a49701e362c85c2457924052fe5312"
server_key_version: "encryptionkey@0"
I20260808 15:46:55.406292 14104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "88c6031181e9462c91c800b873ee7e7b"
format_stamp: "Formatted at 2026-08-08 15:46:55 on dist-test-slave-8tdl"
server_key: "268b969123d1c7e856aa1b008d4a1939"
server_key_iv: "52a49701e362c85c2457924052fe5312"
server_key_version: "encryptionkey@0"
I20260808 15:46:55.410198 14104 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 15:46:55.412855 14118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:55.414176 14104 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:46:55.414299 14104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "88c6031181e9462c91c800b873ee7e7b"
format_stamp: "Formatted at 2026-08-08 15:46:55 on dist-test-slave-8tdl"
server_key: "268b969123d1c7e856aa1b008d4a1939"
server_key_iv: "52a49701e362c85c2457924052fe5312"
server_key_version: "encryptionkey@0"
I20260808 15:46:55.414404 14104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:55.441061 14104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:55.441838 14104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:55.442009 14104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:55.449978 14104 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:34087
I20260808 15:46:55.449995 14173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:34087 every 8 connection(s)
I20260808 15:46:55.451141 14104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:46:55.454566 14174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:55.455986 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 14104
I20260808 15:46:55.456094 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:46:55.456423 8349 external_mini_cluster.cc:1428] Setting key 0ca1bcbb09fbedc27c80312aa7603313
I20260808 15:46:55.460994 14174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88c6031181e9462c91c800b873ee7e7b: Bootstrap starting.
I20260808 15:46:55.463896 14174 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 88c6031181e9462c91c800b873ee7e7b: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:55.464725 14174 log.cc:824] T 00000000000000000000000000000000 P 88c6031181e9462c91c800b873ee7e7b: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:55.466152 14177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:55.457912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44398 (local address 127.8.39.126:34087)
0808 15:46:55.458527 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:55.458543 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:55.458581 (+ 38us) server_negotiation.cc:407] Connection header received
0808 15:46:55.459285 (+ 704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:55.459302 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:55.459698 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:55.459984 (+ 286us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:55.460403 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:55.461439 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:55.462666 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:55.463202 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:55.463324 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:55.464212 (+ 888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:55.464217 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:55.464229 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:46:55.464622 (+ 393us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:55.464680 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:46:55.464700 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:55.464775 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:55.464993 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 15:46:55.465292 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":135,"threads_started":1}
I20260808 15:46:55.467020 14174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88c6031181e9462c91c800b873ee7e7b: No bootstrap required, opened a new log
I20260808 15:46:55.468971 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:46:55.470928 14174 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88c6031181e9462c91c800b873ee7e7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88c6031181e9462c91c800b873ee7e7b" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 34087 } }
I20260808 15:46:55.471181 14174 raft_consensus.cc:374] T 00000000000000000000000000000000 P 88c6031181e9462c91c800b873ee7e7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:55.471254 14174 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88c6031181e9462c91c800b873ee7e7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88c6031181e9462c91c800b873ee7e7b, State: Initialized, Role: FOLLOWER
I20260808 15:46:55.471679 14174 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88c6031181e9462c91c800b873ee7e7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88c6031181e9462c91c800b873ee7e7b" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 34087 } }
I20260808 15:46:55.471828 14174 raft_consensus.cc:388] T 00000000000000000000000000000000 P 88c6031181e9462c91c800b873ee7e7b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:46:55.471915 14174 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88c6031181e9462c91c800b873ee7e7b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:46:55.472018 14174 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88c6031181e9462c91c800b873ee7e7b [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:55.473006 14174 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88c6031181e9462c91c800b873ee7e7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88c6031181e9462c91c800b873ee7e7b" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 34087 } }
I20260808 15:46:55.473359 14174 leader_election.cc:302] T 00000000000000000000000000000000 P 88c6031181e9462c91c800b873ee7e7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88c6031181e9462c91c800b873ee7e7b; no voters:
I20260808 15:46:55.473686 14174 leader_election.cc:288] T 00000000000000000000000000000000 P 88c6031181e9462c91c800b873ee7e7b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:46:55.473837 14179 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88c6031181e9462c91c800b873ee7e7b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:55.474128 14179 raft_consensus.cc:686] T 00000000000000000000000000000000 P 88c6031181e9462c91c800b873ee7e7b [term 1 LEADER]: Becoming Leader. State: Replica: 88c6031181e9462c91c800b873ee7e7b, State: Running, Role: LEADER
I20260808 15:46:55.474436 14179 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88c6031181e9462c91c800b873ee7e7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88c6031181e9462c91c800b873ee7e7b" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 34087 } }
I20260808 15:46:55.475069 14174 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88c6031181e9462c91c800b873ee7e7b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:46:55.476226 14180 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88c6031181e9462c91c800b873ee7e7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "88c6031181e9462c91c800b873ee7e7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88c6031181e9462c91c800b873ee7e7b" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 34087 } } }
I20260808 15:46:55.476383 14180 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88c6031181e9462c91c800b873ee7e7b [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:55.476696 14181 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88c6031181e9462c91c800b873ee7e7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88c6031181e9462c91c800b873ee7e7b. Latest consensus state: current_term: 1 leader_uuid: "88c6031181e9462c91c800b873ee7e7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88c6031181e9462c91c800b873ee7e7b" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 34087 } } }
I20260808 15:46:55.476809 14181 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88c6031181e9462c91c800b873ee7e7b [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:55.476786 14189 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:46:55.480181 14189 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:46:55.485950 14189 catalog_manager.cc:1347] Generated new cluster ID: b6aaa3cc8f054c9da6f5adc506549ef2
I20260808 15:46:55.486025 14189 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:46:55.492820 14189 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:46:55.493976 14189 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:46:55.506536 14189 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 88c6031181e9462c91c800b873ee7e7b: Generated new TSK 0
I20260808 15:46:55.507319 14189 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:46:55.972687 14177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:55.517515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44400 (local address 127.8.39.126:34087)
0808 15:46:55.517639 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:55.517643 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:55.518128 (+ 485us) server_negotiation.cc:407] Connection header received
0808 15:46:55.518340 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:55.518343 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:55.518411 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:55.518528 (+ 117us) server_negotiation.cc:226] Negotiated authn=JWT
0808 15:46:55.518931 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:55.519487 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:55.520813 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:55.521182 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:55.521268 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:55.521824 (+ 556us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 15:46:55.972088 (+450264us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 15:46:55.972497 (+ 409us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44400: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":33}
W20260808 15:46:55.972800 14177 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44400: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 15:46:55.972859 14205 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:46:55.517535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:34087 (local address 127.0.0.1:44400)
0808 15:46:55.518023 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:55.518046 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:55.518179 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:55.518654 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:55.518660 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:55.518695 (+ 35us) client_negotiation.cc:189] Negotiated authn=JWT
0808 15:46:55.518814 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:55.518824 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:55.519610 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:55.519614 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:55.520657 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:55.520670 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:55.521426 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:55.521431 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:55.521555 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:55.521594 (+ 39us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 15:46:55.972420 (+450826us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 15:46:55.972639 (+ 219us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.8.39.126:34087: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":142,"threads_started":1}
I20260808 15:46:55.973636 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 14104
2026-08-08T15:46:55Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (745 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (131 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (128 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:46:56 dist-test-slave-8tdl krb5kdc[14217](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:46:56 dist-test-slave-8tdl krb5kdc[14217](info): set up 2 sockets
Aug 08 15:46:56 dist-test-slave-8tdl krb5kdc[14217](info): commencing operation
krb5kdc: starting...
W20260808 15:46:57.296452 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.042s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:46:57 dist-test-slave-8tdl krb5kdc[14217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204017, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:46:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:46:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:46:57.429306 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:44605
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:42973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:44605
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:57.544186 14230 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:57.544479 14230 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:57.544581 14230 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:57.548672 14230 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:46:57.548761 14230 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:57.548799 14230 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:57.548866 14230 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:46:57.548903 14230 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:46:57.554410 14230 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:42973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:44605
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:44605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14230
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:57.555568 14230 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:57.556627 14230 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:57.565701 14236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:57.565960 14238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:57.566180 14235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:57.566418 14230 server_base.cc:1034] running on GCE node
I20260808 15:46:57.567039 14230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:57.568166 14230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:57.569339 14230 hybrid_clock.cc:648] HybridClock initialized: now 1786204017569309 us; error 39 us; skew 500 ppm
Aug 08 15:46:57 dist-test-slave-8tdl krb5kdc[14217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204017, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:57.572301 14230 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:46:57.573169 14230 webserver.cc:460] Webserver started at http://127.8.39.126:39917/ using document root <none> and password file <none>
I20260808 15:46:57.573824 14230 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:57.573930 14230 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:57.574175 14230 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:57.576604 14230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "fa1a5467d4194341bb772b54d8f3c5fa"
format_stamp: "Formatted at 2026-08-08 15:46:57 on dist-test-slave-8tdl"
server_key: "ee0b0aa1987e1646c9459a36161026c0"
server_key_iv: "2889fff9a173ecde1e05d25d7b2449e6"
server_key_version: "encryptionkey@0"
I20260808 15:46:57.577231 14230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "fa1a5467d4194341bb772b54d8f3c5fa"
format_stamp: "Formatted at 2026-08-08 15:46:57 on dist-test-slave-8tdl"
server_key: "ee0b0aa1987e1646c9459a36161026c0"
server_key_iv: "2889fff9a173ecde1e05d25d7b2449e6"
server_key_version: "encryptionkey@0"
I20260808 15:46:57.581270 14230 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 15:46:57.583904 14245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:57.585284 14230 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:46:57.585460 14230 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "fa1a5467d4194341bb772b54d8f3c5fa"
format_stamp: "Formatted at 2026-08-08 15:46:57 on dist-test-slave-8tdl"
server_key: "ee0b0aa1987e1646c9459a36161026c0"
server_key_iv: "2889fff9a173ecde1e05d25d7b2449e6"
server_key_version: "encryptionkey@0"
I20260808 15:46:57.585577 14230 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:57.602931 14230 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:57.606704 14230 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:57.606937 14230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:57.615005 14230 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:44605
I20260808 15:46:57.615069 14298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:44605 every 8 connection(s)
I20260808 15:46:57.616086 14230 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:46:57.616947 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 14230
I20260808 15:46:57.617102 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:46:57.617412 8349 external_mini_cluster.cc:1428] Setting key c421208bb2543c6ce36fb01c3c3a0cea
I20260808 15:46:57.619527 14299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:57.626922 14299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa1a5467d4194341bb772b54d8f3c5fa: Bootstrap starting.
Aug 08 15:46:57 dist-test-slave-8tdl krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204017, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:57.629809 14299 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa1a5467d4194341bb772b54d8f3c5fa: Neither blocks nor log segments found. Creating new log.
I20260808 15:46:57.630841 14299 log.cc:824] T 00000000000000000000000000000000 P fa1a5467d4194341bb772b54d8f3c5fa: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:57.633453 14299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa1a5467d4194341bb772b54d8f3c5fa: No bootstrap required, opened a new log
I20260808 15:46:57.634891 14302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:57.618953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48972 (local address 127.8.39.126:44605)
0808 15:46:57.619403 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:57.619424 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:57.619469 (+ 45us) server_negotiation.cc:407] Connection header received
0808 15:46:57.620395 (+ 926us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:57.620419 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:57.620851 (+ 432us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:57.621255 (+ 404us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:57.622148 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:57.623860 (+ 1712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:57.624852 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:57.625636 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:57.625819 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:57.629006 (+ 3187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:57.629013 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:57.629030 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:57.629065 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:57.631307 (+ 2242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:57.631893 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:57.631899 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:57.631908 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:57.632111 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:57.632443 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:57.632447 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:57.632448 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:57.632973 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:57.633185 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:57.633514 (+ 329us) server_negotiation.cc:299] Negotiation successful
0808 15:46:57.633838 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":126,"threads_started":1}
I20260808 15:46:57.637610 14299 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa1a5467d4194341bb772b54d8f3c5fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa1a5467d4194341bb772b54d8f3c5fa" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 44605 } }
I20260808 15:46:57.637849 14299 raft_consensus.cc:374] T 00000000000000000000000000000000 P fa1a5467d4194341bb772b54d8f3c5fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:57.637887 14299 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa1a5467d4194341bb772b54d8f3c5fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1a5467d4194341bb772b54d8f3c5fa, State: Initialized, Role: FOLLOWER
I20260808 15:46:57.638366 14299 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa1a5467d4194341bb772b54d8f3c5fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa1a5467d4194341bb772b54d8f3c5fa" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 44605 } }
I20260808 15:46:57.638505 14299 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa1a5467d4194341bb772b54d8f3c5fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:46:57.638592 14299 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa1a5467d4194341bb772b54d8f3c5fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:46:57.638737 14299 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa1a5467d4194341bb772b54d8f3c5fa [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:57.639724 14299 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa1a5467d4194341bb772b54d8f3c5fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa1a5467d4194341bb772b54d8f3c5fa" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 44605 } }
I20260808 15:46:57.640079 14299 leader_election.cc:302] T 00000000000000000000000000000000 P fa1a5467d4194341bb772b54d8f3c5fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa1a5467d4194341bb772b54d8f3c5fa; no voters:
I20260808 15:46:57.640439 14299 leader_election.cc:288] T 00000000000000000000000000000000 P fa1a5467d4194341bb772b54d8f3c5fa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:46:57.640601 14304 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa1a5467d4194341bb772b54d8f3c5fa [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:57.640848 14304 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa1a5467d4194341bb772b54d8f3c5fa [term 1 LEADER]: Becoming Leader. State: Replica: fa1a5467d4194341bb772b54d8f3c5fa, State: Running, Role: LEADER
I20260808 15:46:57.641224 14304 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa1a5467d4194341bb772b54d8f3c5fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa1a5467d4194341bb772b54d8f3c5fa" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 44605 } }
I20260808 15:46:57.641782 14299 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa1a5467d4194341bb772b54d8f3c5fa [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:46:57.643397 14306 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa1a5467d4194341bb772b54d8f3c5fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa1a5467d4194341bb772b54d8f3c5fa. Latest consensus state: current_term: 1 leader_uuid: "fa1a5467d4194341bb772b54d8f3c5fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa1a5467d4194341bb772b54d8f3c5fa" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 44605 } } }
I20260808 15:46:57.643461 14305 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa1a5467d4194341bb772b54d8f3c5fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fa1a5467d4194341bb772b54d8f3c5fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa1a5467d4194341bb772b54d8f3c5fa" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 44605 } } }
I20260808 15:46:57.643545 14306 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa1a5467d4194341bb772b54d8f3c5fa [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:57.643574 14305 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa1a5467d4194341bb772b54d8f3c5fa [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:57.644378 14313 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:46:57.647428 14313 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:46:57.652954 14313 catalog_manager.cc:1347] Generated new cluster ID: a50fb6cd06ce4eaaa4ac9711dbe72166
I20260808 15:46:57.653023 14313 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:46:57.677189 14313 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:46:57.678241 14313 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:46:57.685752 14313 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fa1a5467d4194341bb772b54d8f3c5fa: Generated new TSK 0
I20260808 15:46:57.686604 14313 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.39.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
I20260808 15:46:57.726620 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:0
--local_ip_for_outbound_sockets=127.8.39.65
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:44605
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:42973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:57.854737 14326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:57.855093 14326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:57.855170 14326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:57.859411 14326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:57.859519 14326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:57.859632 14326 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:46:57.865751 14326 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:42973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:44605
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14326
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:57.866937 14326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:57.867970 14326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:57.877909 14332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:57.877950 14334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:57.877985 14331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:57.878202 14326 server_base.cc:1034] running on GCE node
I20260808 15:46:57.878827 14326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:57.879544 14326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:57.880741 14326 hybrid_clock.cc:648] HybridClock initialized: now 1786204017880722 us; error 34 us; skew 500 ppm
Aug 08 15:46:57 dist-test-slave-8tdl krb5kdc[14217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204017, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:57.883880 14326 init.cc:377] Logged in from keytab as kudu/127.8.39.65@KRBTEST.COM (short username kudu)
I20260808 15:46:57.884774 14326 webserver.cc:460] Webserver started at http://127.8.39.65:46835/ using document root <none> and password file <none>
I20260808 15:46:57.885368 14326 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:57.885460 14326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:57.885684 14326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:57.887820 14326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-0/data/instance:
uuid: "d3f2050691c849fba87210982ed847ed"
format_stamp: "Formatted at 2026-08-08 15:46:57 on dist-test-slave-8tdl"
server_key: "a84a2a1fc2ac538020a6a67655601efe"
server_key_iv: "c07b727f9862501d622f41376cb2df0f"
server_key_version: "encryptionkey@0"
I20260808 15:46:57.888399 14326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance:
uuid: "d3f2050691c849fba87210982ed847ed"
format_stamp: "Formatted at 2026-08-08 15:46:57 on dist-test-slave-8tdl"
server_key: "a84a2a1fc2ac538020a6a67655601efe"
server_key_iv: "c07b727f9862501d622f41376cb2df0f"
server_key_version: "encryptionkey@0"
I20260808 15:46:57.892216 14326 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 15:46:57.894759 14342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:57.896106 14326 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:46:57.896253 14326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "d3f2050691c849fba87210982ed847ed"
format_stamp: "Formatted at 2026-08-08 15:46:57 on dist-test-slave-8tdl"
server_key: "a84a2a1fc2ac538020a6a67655601efe"
server_key_iv: "c07b727f9862501d622f41376cb2df0f"
server_key_version: "encryptionkey@0"
I20260808 15:46:57.896366 14326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:57.912006 14326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:57.915158 14326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:57.915364 14326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:57.915999 14326 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:46:57.916853 14326 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:57.916899 14326 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:57.916963 14326 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:57.916997 14326 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:57.925833 14326 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:33927
I20260808 15:46:57.925992 14460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:33927 every 8 connection(s)
I20260808 15:46:57.926867 14326 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:46:57.936251 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 14326
I20260808 15:46:57.936398 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance
I20260808 15:46:57.936676 8349 external_mini_cluster.cc:1428] Setting key 82600035e88679aa0a8c8c5c7f4a34d4
Aug 08 15:46:57 dist-test-slave-8tdl krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204017, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:57.943467 14302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:57.928815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:49765 (local address 127.8.39.126:44605)
0808 15:46:57.929059 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:57.929063 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:57.929800 (+ 737us) server_negotiation.cc:407] Connection header received
0808 15:46:57.931497 (+ 1697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:57.931501 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:57.931567 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:57.931688 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:57.933321 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:57.933942 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:57.935367 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:57.935647 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:57.935781 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:57.939032 (+ 3251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:57.939036 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:57.939039 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:57.939076 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:57.940950 (+ 1874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:57.941492 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:57.941497 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:57.941502 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:57.941624 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:57.941979 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:57.941983 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:57.941987 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:57.942274 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:57.942440 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:57.943004 (+ 564us) server_negotiation.cc:299] Negotiation successful
0808 15:46:57.943176 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141}
I20260808 15:46:57.944252 14463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:57.929099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:44605 (local address 127.8.39.65:49765)
0808 15:46:57.929617 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:57.929666 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:57.931250 (+ 1584us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:57.931921 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:57.931933 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:57.932502 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:57.933143 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:57.933158 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:57.934093 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:57.934097 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:57.935217 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:57.935228 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:57.935830 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:57.935835 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:57.936060 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:57.936849 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:57.936872 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:57.938826 (+ 1954us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:57.941085 (+ 2259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:57.941090 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:57.941102 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:57.941373 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:57.941727 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:57.941729 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:57.941730 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:57.941862 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:57.942380 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:57.942385 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:57.942730 (+ 345us) client_negotiation.cc:769] Sending connection context
0808 15:46:57.942891 (+ 161us) client_negotiation.cc:240] Negotiation successful
0808 15:46:57.943238 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":137,"threads_started":1}
I20260808 15:46:57.945570 14461 heartbeater.cc:347] Connected to a master server at 127.8.39.126:44605
I20260808 15:46:57.945871 14461 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:57.946581 14461 heartbeater.cc:511] Master 127.8.39.126:44605 requested a full tablet report, sending...
I20260808 15:46:57.948258 14262 ts_manager.cc:194] Registered new tserver with Master: d3f2050691c849fba87210982ed847ed (127.8.39.65:33927)
WARNING: no policy specified for kudu/127.8.39.66@KRBTEST.COM; defaulting to no policy
I20260808 15:46:57.949419 14262 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.65@KRBTEST.COM'} at 127.8.39.65:49765
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
I20260808 15:46:57.969514 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:0
--local_ip_for_outbound_sockets=127.8.39.66
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:44605
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:42973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:58.083060 14467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:58.083374 14467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:58.083469 14467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:58.087594 14467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:58.087697 14467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:58.087795 14467 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:46:58.093272 14467 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:42973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:44605
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:58.094432 14467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:58.095553 14467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:58.105278 14475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:58.105297 14473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:58.105300 14472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:58.105791 14467 server_base.cc:1034] running on GCE node
I20260808 15:46:58.106227 14467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:58.106868 14467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:58.108042 14467 hybrid_clock.cc:648] HybridClock initialized: now 1786204018108029 us; error 25 us; skew 500 ppm
Aug 08 15:46:58 dist-test-slave-8tdl krb5kdc[14217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204018, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:58.110963 14467 init.cc:377] Logged in from keytab as kudu/127.8.39.66@KRBTEST.COM (short username kudu)
I20260808 15:46:58.111889 14467 webserver.cc:460] Webserver started at http://127.8.39.66:37085/ using document root <none> and password file <none>
I20260808 15:46:58.112453 14467 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:58.112515 14467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:58.112732 14467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:58.114845 14467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-1/data/instance:
uuid: "dafbc21296084ae99acb291e9fbe1d5d"
format_stamp: "Formatted at 2026-08-08 15:46:58 on dist-test-slave-8tdl"
server_key: "b528cf6b04be1e3c9c353478b45baad2"
server_key_iv: "224619e78849d3c14c73866d5c20fe0c"
server_key_version: "encryptionkey@0"
I20260808 15:46:58.115410 14467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance:
uuid: "dafbc21296084ae99acb291e9fbe1d5d"
format_stamp: "Formatted at 2026-08-08 15:46:58 on dist-test-slave-8tdl"
server_key: "b528cf6b04be1e3c9c353478b45baad2"
server_key_iv: "224619e78849d3c14c73866d5c20fe0c"
server_key_version: "encryptionkey@0"
I20260808 15:46:58.119177 14467 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:46:58.121593 14483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:58.123013 14467 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:46:58.123147 14467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "dafbc21296084ae99acb291e9fbe1d5d"
format_stamp: "Formatted at 2026-08-08 15:46:58 on dist-test-slave-8tdl"
server_key: "b528cf6b04be1e3c9c353478b45baad2"
server_key_iv: "224619e78849d3c14c73866d5c20fe0c"
server_key_version: "encryptionkey@0"
I20260808 15:46:58.123255 14467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:58.138659 14467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:58.142027 14467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:58.142226 14467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:58.142899 14467 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:46:58.143811 14467 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:58.143873 14467 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:58.143940 14467 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:58.143989 14467 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:58.152819 14467 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:36623
I20260808 15:46:58.152844 14597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:36623 every 8 connection(s)
I20260808 15:46:58.153697 14467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:46:58.156917 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 14467
I20260808 15:46:58.157085 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance
I20260808 15:46:58.157373 8349 external_mini_cluster.cc:1428] Setting key 9f02e5412e943416b61f1e529e7180f8
Aug 08 15:46:58 dist-test-slave-8tdl krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204018, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.39.67@KRBTEST.COM; defaulting to no policy
I20260808 15:46:58.168954 14302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:58.155517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:53861 (local address 127.8.39.126:44605)
0808 15:46:58.155652 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:58.155656 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:58.156431 (+ 775us) server_negotiation.cc:407] Connection header received
0808 15:46:58.158068 (+ 1637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:58.158071 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:58.158133 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:58.158237 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:58.159534 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:58.160067 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:58.161611 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:58.161941 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:58.162031 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:58.164981 (+ 2950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:58.164988 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:58.164994 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:58.165033 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:58.166773 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:58.167262 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:58.167266 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:58.167269 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:58.167366 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:58.167711 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:58.167716 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:58.167720 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:58.167984 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:58.168101 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:58.168599 (+ 498us) server_negotiation.cc:299] Negotiation successful
0808 15:46:58.168728 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 15:46:58.169730 14600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:58.155845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:44605 (local address 127.8.39.66:53861)
0808 15:46:58.156282 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:58.156324 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:58.157792 (+ 1468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:58.158406 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:58.158414 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:58.158905 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:58.159381 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:58.159395 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:58.160197 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:58.160206 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:58.161460 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:58.161484 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:58.162103 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:58.162109 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:58.162353 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:58.163027 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:58.163052 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:58.164794 (+ 1742us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:58.166883 (+ 2089us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:58.166888 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:58.166899 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:58.167154 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:58.167462 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:58.167464 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:58.167465 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:58.167609 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:58.168103 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:58.168108 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:58.168337 (+ 229us) client_negotiation.cc:769] Sending connection context
0808 15:46:58.168510 (+ 173us) client_negotiation.cc:240] Negotiation successful
0808 15:46:58.168765 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":126,"threads_started":1}
I20260808 15:46:58.170995 14598 heartbeater.cc:347] Connected to a master server at 127.8.39.126:44605
I20260808 15:46:58.171257 14598 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.67@KRBTEST.COM" created.
I20260808 15:46:58.171895 14598 heartbeater.cc:511] Master 127.8.39.126:44605 requested a full tablet report, sending...
I20260808 15:46:58.173100 14262 ts_manager.cc:194] Registered new tserver with Master: dafbc21296084ae99acb291e9fbe1d5d (127.8.39.66:36623)
I20260808 15:46:58.174007 14262 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.66@KRBTEST.COM'} at 127.8.39.66:53861
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
I20260808 15:46:58.188000 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:0
--local_ip_for_outbound_sockets=127.8.39.67
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:44605
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:42973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:58.302256 14603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:58.302556 14603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:58.302634 14603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:58.306722 14603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:58.306807 14603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:58.306900 14603 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:46:58.312274 14603 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:42973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:44605
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14603
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:58.313385 14603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:58.314410 14603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:58.323974 14608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:58.323989 14611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:58.324043 14609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:58.324342 14603 server_base.cc:1034] running on GCE node
I20260808 15:46:58.324752 14603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:58.325335 14603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:58.326504 14603 hybrid_clock.cc:648] HybridClock initialized: now 1786204018326492 us; error 23 us; skew 500 ppm
Aug 08 15:46:58 dist-test-slave-8tdl krb5kdc[14217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204018, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:58.329500 14603 init.cc:377] Logged in from keytab as kudu/127.8.39.67@KRBTEST.COM (short username kudu)
I20260808 15:46:58.330358 14603 webserver.cc:460] Webserver started at http://127.8.39.67:40975/ using document root <none> and password file <none>
I20260808 15:46:58.330997 14603 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:58.331090 14603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:58.331321 14603 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:58.333355 14603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-2/data/instance:
uuid: "406482d29c8b446e84a3fc649d5acafc"
format_stamp: "Formatted at 2026-08-08 15:46:58 on dist-test-slave-8tdl"
server_key: "c4944e40c6f87f45d2231b41e30f0004"
server_key_iv: "47a3599ca167f507eb61ba8220176c69"
server_key_version: "encryptionkey@0"
I20260808 15:46:58.333930 14603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance:
uuid: "406482d29c8b446e84a3fc649d5acafc"
format_stamp: "Formatted at 2026-08-08 15:46:58 on dist-test-slave-8tdl"
server_key: "c4944e40c6f87f45d2231b41e30f0004"
server_key_iv: "47a3599ca167f507eb61ba8220176c69"
server_key_version: "encryptionkey@0"
I20260808 15:46:58.337924 14603 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 15:46:58.340420 14618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:58.341688 14603 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:46:58.341825 14603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "406482d29c8b446e84a3fc649d5acafc"
format_stamp: "Formatted at 2026-08-08 15:46:58 on dist-test-slave-8tdl"
server_key: "c4944e40c6f87f45d2231b41e30f0004"
server_key_iv: "47a3599ca167f507eb61ba8220176c69"
server_key_version: "encryptionkey@0"
I20260808 15:46:58.341936 14603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:58.396092 14603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:58.399639 14603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:58.399853 14603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:58.400545 14603 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:46:58.401471 14603 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:46:58.401551 14603 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:58.401623 14603 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:46:58.401666 14603 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:58.411134 14603 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:36469
I20260808 15:46:58.411165 14733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:36469 every 8 connection(s)
I20260808 15:46:58.412047 14603 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:46:58.415786 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 14603
I20260808 15:46:58.415891 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance
I20260808 15:46:58.416186 8349 external_mini_cluster.cc:1428] Setting key eebe646aecd2556ff809316bc9252a2e
Aug 08 15:46:58 dist-test-slave-8tdl krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204018, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:46:58.427274 14302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:58.414053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:53119 (local address 127.8.39.126:44605)
0808 15:46:58.414215 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:58.414219 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:58.415191 (+ 972us) server_negotiation.cc:407] Connection header received
0808 15:46:58.416953 (+ 1762us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:58.416957 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:58.417024 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:58.417140 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:58.418436 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:58.419102 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:58.420409 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:58.420653 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:58.420773 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:58.423549 (+ 2776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:58.423553 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:58.423555 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:58.423581 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:58.425050 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:58.425597 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:58.425605 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:58.425607 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:58.425685 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:58.426031 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:58.426034 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:58.426036 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:58.426220 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:58.426335 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:58.426958 (+ 623us) server_negotiation.cc:299] Negotiation successful
0808 15:46:58.427097 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 15:46:58.428176 14736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:58.414397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:44605 (local address 127.8.39.67:53119)
0808 15:46:58.414982 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0808 15:46:58.415068 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0808 15:46:58.416679 (+ 1611us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:46:58.417337 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:46:58.417344 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:46:58.417731 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:46:58.418263 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:58.418278 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:58.419240 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:58.419246 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:58.420251 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:46:58.420261 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:46:58.420830 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:46:58.420834 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:46:58.421023 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:58.421616 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:46:58.421634 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:46:58.423348 (+ 1714us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:46:58.425180 (+ 1832us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:58.425186 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:58.425200 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:58.425465 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:58.425779 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:46:58.425782 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:46:58.425784 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:46:58.425926 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:46:58.426345 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:46:58.426353 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:46:58.426670 (+ 317us) client_negotiation.cc:769] Sending connection context
0808 15:46:58.426917 (+ 247us) client_negotiation.cc:240] Negotiation successful
0808 15:46:58.427243 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":120,"threads_started":1}
I20260808 15:46:58.429323 14734 heartbeater.cc:347] Connected to a master server at 127.8.39.126:44605
I20260808 15:46:58.429589 14734 heartbeater.cc:464] Registering TS with master...
I20260808 15:46:58.430163 14734 heartbeater.cc:511] Master 127.8.39.126:44605 requested a full tablet report, sending...
I20260808 15:46:58.431236 14262 ts_manager.cc:194] Registered new tserver with Master: 406482d29c8b446e84a3fc649d5acafc (127.8.39.67:36469)
I20260808 15:46:58.431774 14262 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.67@KRBTEST.COM'} at 127.8.39.67:53119
I20260808 15:46:58.442346 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/test-admin.keytab.
Aug 08 15:46:58 dist-test-slave-8tdl krb5kdc[14217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:58.459642 8349 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 15:46:58.462800 14741 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:46:58.461041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54288 (local address 127.8.39.65:33927)
0808 15:46:58.461458 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:58.461470 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:58.461510 (+ 40us) server_negotiation.cc:407] Connection header received
0808 15:46:58.461566 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:58.461572 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:58.461770 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:58.461928 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:58.462580 (+ 652us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54288: BlockingRecv error: recv got EOF from 127.0.0.1:54288 (error 108)
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":74,"threads_started":1}
W20260808 15:46:58.462822 8349 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/krb5cc' of type FILE
Aug 08 15:46:58 dist-test-slave-8tdl krb5kdc[14217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:58.464213 8349 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 15:46:58 dist-test-slave-8tdl krb5kdc[14217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:58.465332 8349 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 15:46:58 dist-test-slave-8tdl krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.65@KRBTEST.COM
I20260808 15:46:58.476891 14741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:58.466505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54298 (local address 127.8.39.65:33927)
0808 15:46:58.466624 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:58.466627 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:58.466641 (+ 14us) server_negotiation.cc:407] Connection header received
0808 15:46:58.466793 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:58.466795 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:58.466838 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:58.466958 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:58.467635 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:58.468447 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:58.469391 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:58.469778 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:58.469863 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:58.472716 (+ 2853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:58.472726 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:58.472740 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:58.472764 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:58.474563 (+ 1799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:58.475072 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:58.475077 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:58.475078 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:58.475188 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:58.475621 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:58.475626 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:58.475645 (+ 19us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:58.476014 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:58.476259 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:58.476632 (+ 373us) server_negotiation.cc:299] Negotiation successful
0808 15:46:58.476767 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260808 15:46:58.481045 14741 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:46:58.479927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54312 (local address 127.8.39.65:33927)
0808 15:46:58.480079 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:58.480083 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:58.480205 (+ 122us) server_negotiation.cc:407] Connection header received
0808 15:46:58.480350 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:58.480353 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:58.480395 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:58.480486 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:58.480906 (+ 420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54312: BlockingRecv error: recv got EOF from 127.0.0.1:54312 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260808 15:46:58.481189 8349 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/krb5cc' of type FILE
Aug 08 15:46:58 dist-test-slave-8tdl krb5kdc[14217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:58.482197 8349 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 15:46:58 dist-test-slave-8tdl krb5kdc[14217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:58.483506 8349 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 15:46:58 dist-test-slave-8tdl krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.65@KRBTEST.COM
I20260808 15:46:58.492810 14741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:58.484496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54324 (local address 127.8.39.65:33927)
0808 15:46:58.484666 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:58.484669 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:58.484685 (+ 16us) server_negotiation.cc:407] Connection header received
0808 15:46:58.484777 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:58.484780 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:58.484819 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:58.484893 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:58.485364 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:58.485911 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:58.486672 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:58.486994 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:58.487089 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:58.489498 (+ 2409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:58.489501 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:58.489503 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:58.489526 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:58.491221 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:58.491609 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:58.491612 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:58.491613 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:58.491685 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:58.491918 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:58.491920 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:58.491921 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:58.492091 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:58.492208 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:58.492423 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 15:46:58.492675 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260808 15:46:58.495671 14741 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:46:58.494653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54336 (local address 127.8.39.65:33927)
0808 15:46:58.494798 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:58.494802 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:58.494921 (+ 119us) server_negotiation.cc:407] Connection header received
0808 15:46:58.495067 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:58.495070 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:58.495109 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:58.495197 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:58.495570 (+ 373us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54336: BlockingRecv error: recv got EOF from 127.0.0.1:54336 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260808 15:46:58.495823 8349 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786203987027663-8349-0/krb5kdc/krb5cc' of type FILE
Aug 08 15:46:58 dist-test-slave-8tdl krb5kdc[14217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:58.496836 8349 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 15:46:58 dist-test-slave-8tdl krb5kdc[14217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:58.497730 8349 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 15:46:58 dist-test-slave-8tdl krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.65@KRBTEST.COM
I20260808 15:46:58.506533 14741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:58.498503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54342 (local address 127.8.39.65:33927)
0808 15:46:58.498617 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:58.498620 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:58.498884 (+ 264us) server_negotiation.cc:407] Connection header received
0808 15:46:58.499019 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:58.499022 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:58.499059 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:58.499149 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:58.499647 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:58.500136 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:58.500900 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:58.501134 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:58.501241 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:58.503500 (+ 2259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:58.503504 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:58.503507 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:58.503537 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:58.504924 (+ 1387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:58.505353 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:58.505357 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:58.505359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:58.505436 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:58.505715 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:58.505719 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:58.505720 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:58.505884 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:58.506074 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:58.506273 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 15:46:58.506374 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 15:46:58.507606 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 14326
I20260808 15:46:58.514601 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 14467
I20260808 15:46:58.520678 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 14603
I20260808 15:46:58.528447 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 14230
2026-08-08T15:46:58Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2298 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:46:58 dist-test-slave-8tdl krb5kdc[14755](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:46:58 dist-test-slave-8tdl krb5kdc[14755](info): set up 2 sockets
Aug 08 15:46:58 dist-test-slave-8tdl krb5kdc[14755](info): commencing operation
krb5kdc: starting...
W20260808 15:46:59.611011 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.008s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:46:59 dist-test-slave-8tdl krb5kdc[14755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:46:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:46:59Z Disabled control of system clock
WARNING: no policy specified for oryx/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.126.keytab.
Entry for principal oryx/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.126.keytab.
I20260808 15:46:59.746537 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:45971
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.126.keytab
--principal=oryx/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:41173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:45971
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:46:59.861792 14768 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:46:59.862149 14768 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:46:59.862221 14768 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:46:59.866456 14768 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:46:59.866559 14768 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:46:59.866606 14768 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:46:59.866644 14768 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:46:59.866698 14768 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:46:59.872256 14768 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:41173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:45971
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.126.keytab
--principal=oryx/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:45971
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14768
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:46:59.873441 14768 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:46:59.874529 14768 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:46:59.883407 14774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:59.883407 14773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:46:59.883567 14776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:46:59.883939 14768 server_base.cc:1034] running on GCE node
I20260808 15:46:59.884574 14768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:46:59.885851 14768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:46:59.887041 14768 hybrid_clock.cc:648] HybridClock initialized: now 1786204019887021 us; error 43 us; skew 500 ppm
Aug 08 15:46:59 dist-test-slave-8tdl krb5kdc[14755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204019, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:46:59.889959 14768 init.cc:377] Logged in from keytab as oryx/127.8.39.126@KRBTEST.COM (short username oryx)
I20260808 15:46:59.891018 14768 webserver.cc:460] Webserver started at http://127.8.39.126:43343/ using document root <none> and password file <none>
I20260808 15:46:59.891624 14768 fs_manager.cc:359] Metadata directory not provided
I20260808 15:46:59.891724 14768 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:46:59.891963 14768 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:46:59.894035 14768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "ee802f092ae04c278f521f27230e7f5f"
format_stamp: "Formatted at 2026-08-08 15:46:59 on dist-test-slave-8tdl"
server_key: "11c2687ca255bd3ab037fd0ed96d6853"
server_key_iv: "3cb1748fb3cfc5a51ae4ec4d391c03ca"
server_key_version: "encryptionkey@0"
I20260808 15:46:59.894649 14768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "ee802f092ae04c278f521f27230e7f5f"
format_stamp: "Formatted at 2026-08-08 15:46:59 on dist-test-slave-8tdl"
server_key: "11c2687ca255bd3ab037fd0ed96d6853"
server_key_iv: "3cb1748fb3cfc5a51ae4ec4d391c03ca"
server_key_version: "encryptionkey@0"
I20260808 15:46:59.898661 14768 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 15:46:59.901168 14783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:46:59.902508 14768 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 15:46:59.902732 14768 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "ee802f092ae04c278f521f27230e7f5f"
format_stamp: "Formatted at 2026-08-08 15:46:59 on dist-test-slave-8tdl"
server_key: "11c2687ca255bd3ab037fd0ed96d6853"
server_key_iv: "3cb1748fb3cfc5a51ae4ec4d391c03ca"
server_key_version: "encryptionkey@0"
I20260808 15:46:59.902870 14768 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:46:59.928776 14768 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:46:59.932371 14768 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:46:59.932613 14768 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:46:59.940673 14768 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:45971
I20260808 15:46:59.940999 14836 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:45971 every 8 connection(s)
I20260808 15:46:59.941722 14768 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:46:59.944706 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 14768
I20260808 15:46:59.944806 14837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:46:59.944854 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:46:59.945186 8349 external_mini_cluster.cc:1428] Setting key 3be84256887f97109a1dd724f3474279
I20260808 15:46:59.952047 14837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f: Bootstrap starting.
I20260808 15:46:59.954387 14837 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f: Neither blocks nor log segments found. Creating new log.
Aug 08 15:46:59 dist-test-slave-8tdl krb5kdc[14755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM
I20260808 15:46:59.955379 14837 log.cc:824] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f: Log is configured to *not* fsync() on all Append() calls
I20260808 15:46:59.958060 14837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f: No bootstrap required, opened a new log
I20260808 15:46:59.960737 14840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:46:59.946638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36786 (local address 127.8.39.126:45971)
0808 15:46:59.947137 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0808 15:46:59.947153 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:46:59.947189 (+ 36us) server_negotiation.cc:407] Connection header received
0808 15:46:59.948083 (+ 894us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:46:59.948102 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:46:59.948421 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:46:59.948699 (+ 278us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:46:59.949653 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:59.950637 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:59.951813 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:46:59.952332 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:46:59.952526 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:46:59.955166 (+ 2640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:46:59.955173 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:46:59.955190 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:46:59.955228 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:46:59.957412 (+ 2184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:59.957891 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:59.957896 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:59.957901 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:59.958055 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:46:59.958359 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:46:59.958362 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:46:59.958364 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:46:59.958914 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:46:59.959109 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 15:46:59.959372 (+ 263us) server_negotiation.cc:299] Negotiation successful
0808 15:46:59.959676 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":127,"threads_started":1}
I20260808 15:46:59.962440 14837 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } }
I20260808 15:46:59.962728 14837 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:46:59.962793 14837 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee802f092ae04c278f521f27230e7f5f, State: Initialized, Role: FOLLOWER
I20260808 15:46:59.963232 14837 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } }
I20260808 15:46:59.963354 14837 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:46:59.963399 14837 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:46:59.963476 14837 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:46:59.964380 14837 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } }
I20260808 15:46:59.964674 14837 leader_election.cc:302] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee802f092ae04c278f521f27230e7f5f; no voters:
I20260808 15:46:59.964931 14837 leader_election.cc:288] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:46:59.965078 14842 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:46:59.965636 14842 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [term 1 LEADER]: Becoming Leader. State: Replica: ee802f092ae04c278f521f27230e7f5f, State: Running, Role: LEADER
I20260808 15:46:59.966234 14842 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } }
I20260808 15:46:59.966486 14837 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:46:59.968017 14844 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee802f092ae04c278f521f27230e7f5f. Latest consensus state: current_term: 1 leader_uuid: "ee802f092ae04c278f521f27230e7f5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } }
I20260808 15:46:59.968065 14843 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee802f092ae04c278f521f27230e7f5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } }
I20260808 15:46:59.968153 14844 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:59.968186 14843 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [sys.catalog]: This master's current role is: LEADER
I20260808 15:46:59.968514 14853 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:46:59.971690 14853 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:46:59.977440 14853 catalog_manager.cc:1347] Generated new cluster ID: d017dce23e6f4f138f04357015c133f6
I20260808 15:46:59.977514 14853 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:46:59.984751 14853 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:46:59.985924 14853 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:46:59.996052 14853 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f: Generated new TSK 0
I20260808 15:46:59.996876 14853 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.8.39.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.39.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.39.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.65.keytab.
Entry for principal oryx/127.8.39.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.65.keytab.
I20260808 15:47:00.029554 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:0
--local_ip_for_outbound_sockets=127.8.39.65
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:45971
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.65.keytab
--principal=oryx/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:41173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:47:00.145803 14863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:00.146103 14863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:00.146186 14863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:00.150274 14863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:00.150372 14863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:00.150461 14863 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:47:00.155853 14863 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:41173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.65.keytab
--principal=oryx/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:45971
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14863
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:00.156927 14863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:00.157948 14863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:00.167945 14871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:00.168085 14863 server_base.cc:1034] running on GCE node
W20260808 15:47:00.167953 14869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:00.167954 14868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:00.168676 14863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:00.169313 14863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:00.170531 14863 hybrid_clock.cc:648] HybridClock initialized: now 1786204020170518 us; error 30 us; skew 500 ppm
Aug 08 15:47:00 dist-test-slave-8tdl krb5kdc[14755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204020, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:47:00.173517 14863 init.cc:377] Logged in from keytab as oryx/127.8.39.65@KRBTEST.COM (short username oryx)
I20260808 15:47:00.174422 14863 webserver.cc:460] Webserver started at http://127.8.39.65:44879/ using document root <none> and password file <none>
I20260808 15:47:00.175084 14863 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:00.175179 14863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:00.175417 14863 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:47:00.177525 14863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/data/instance:
uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e"
format_stamp: "Formatted at 2026-08-08 15:47:00 on dist-test-slave-8tdl"
server_key: "1cda00611b20d640bf807d3032c7739c"
server_key_iv: "1a6f97e987c4299218a7bdf62e4dcdfa"
server_key_version: "encryptionkey@0"
I20260808 15:47:00.178124 14863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance:
uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e"
format_stamp: "Formatted at 2026-08-08 15:47:00 on dist-test-slave-8tdl"
server_key: "1cda00611b20d640bf807d3032c7739c"
server_key_iv: "1a6f97e987c4299218a7bdf62e4dcdfa"
server_key_version: "encryptionkey@0"
I20260808 15:47:00.182102 14863 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 15:47:00.184804 14878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:00.186205 14863 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:47:00.186362 14863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e"
format_stamp: "Formatted at 2026-08-08 15:47:00 on dist-test-slave-8tdl"
server_key: "1cda00611b20d640bf807d3032c7739c"
server_key_iv: "1a6f97e987c4299218a7bdf62e4dcdfa"
server_key_version: "encryptionkey@0"
I20260808 15:47:00.186496 14863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:00.215976 14863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:00.219439 14863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:00.219657 14863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:00.220278 14863 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:47:00.221123 14863 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:47:00.221195 14863 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:00.221266 14863 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:47:00.221309 14863 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:00.230254 14863 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:39155
I20260808 15:47:00.230293 14994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:39155 every 8 connection(s)
I20260808 15:47:00.231177 14863 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:47:00.237670 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 14863
I20260808 15:47:00.237836 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance
I20260808 15:47:00.238147 8349 external_mini_cluster.cc:1428] Setting key 36f02a4b310afc6a95aa571a18ed59b6
Aug 08 15:47:00 dist-test-slave-8tdl krb5kdc[14755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204020, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM
I20260808 15:47:00.247736 14840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:00.233124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:44999 (local address 127.8.39.126:45971)
0808 15:47:00.233265 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:00.233268 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:00.234018 (+ 750us) server_negotiation.cc:407] Connection header received
0808 15:47:00.235459 (+ 1441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:00.235463 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:00.235525 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:00.235630 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:00.236778 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:00.237316 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:00.238643 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:00.238981 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:00.239097 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:00.242158 (+ 3061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:00.242162 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:00.242165 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:00.242197 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:00.244624 (+ 2427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:00.245613 (+ 989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:00.245621 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:00.245624 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:00.245738 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:00.246185 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:00.246192 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:00.246196 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:00.246508 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:00.246632 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:00.247367 (+ 735us) server_negotiation.cc:299] Negotiation successful
0808 15:47:00.247528 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 15:47:00.248595 14997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:00.233413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.65:44999)
0808 15:47:00.233851 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:00.233900 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:00.235229 (+ 1329us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:00.235800 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:00.235807 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:00.236169 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:00.236630 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:00.236643 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:00.237487 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:00.237490 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:00.238513 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:00.238523 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:00.239148 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:00.239152 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:00.239311 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:00.240091 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:00.240108 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:00.241933 (+ 1825us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:00.245132 (+ 3199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:00.245140 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:00.245162 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:00.245494 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:00.245918 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:00.245920 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:00.245921 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:00.246075 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:00.246655 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:00.246662 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:00.247074 (+ 412us) client_negotiation.cc:769] Sending connection context
0808 15:47:00.247270 (+ 196us) client_negotiation.cc:240] Negotiation successful
0808 15:47:00.247583 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":104,"threads_started":1}
WARNING: no policy specified for oryx/127.8.39.66@KRBTEST.COM; defaulting to no policy
I20260808 15:47:00.250025 14995 heartbeater.cc:347] Connected to a master server at 127.8.39.126:45971
I20260808 15:47:00.250311 14995 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:00.250880 14995 heartbeater.cc:511] Master 127.8.39.126:45971 requested a full tablet report, sending...
I20260808 15:47:00.252614 14801 ts_manager.cc:194] Registered new tserver with Master: b0e5806c606e4b5ea2b6c9da30c5e73e (127.8.39.65:39155)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.39.66@KRBTEST.COM" created.
I20260808 15:47:00.253824 14801 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.39.65@KRBTEST.COM'} at 127.8.39.65:44999
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.39.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.66.keytab.
Entry for principal oryx/127.8.39.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.66.keytab.
I20260808 15:47:00.270089 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:0
--local_ip_for_outbound_sockets=127.8.39.66
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:45971
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.66.keytab
--principal=oryx/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:41173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:47:00.384850 15000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:00.385124 15000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:00.385169 15000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:00.389163 15000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:00.389225 15000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:00.389284 15000 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:47:00.394892 15000 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:41173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.66.keytab
--principal=oryx/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:45971
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15000
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:00.395928 15000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:00.396908 15000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:00.406734 15005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:00.406881 15000 server_base.cc:1034] running on GCE node
W20260808 15:47:00.406719 15006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:00.406693 15008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:00.407547 15000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:00.408214 15000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:00.409451 15000 hybrid_clock.cc:648] HybridClock initialized: now 1786204020409434 us; error 30 us; skew 500 ppm
Aug 08 15:47:00 dist-test-slave-8tdl krb5kdc[14755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204020, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:47:00.415622 15000 init.cc:377] Logged in from keytab as oryx/127.8.39.66@KRBTEST.COM (short username oryx)
I20260808 15:47:00.416535 15000 webserver.cc:460] Webserver started at http://127.8.39.66:37907/ using document root <none> and password file <none>
I20260808 15:47:00.417210 15000 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:00.417305 15000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:00.417551 15000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:47:00.419715 15000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/data/instance:
uuid: "0768475129944942a1a39ea968bfb1f9"
format_stamp: "Formatted at 2026-08-08 15:47:00 on dist-test-slave-8tdl"
server_key: "9ae922aa0af963408066baa747565f12"
server_key_iv: "eea1fa8c25bab61a11738596401a3fa8"
server_key_version: "encryptionkey@0"
I20260808 15:47:00.420320 15000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance:
uuid: "0768475129944942a1a39ea968bfb1f9"
format_stamp: "Formatted at 2026-08-08 15:47:00 on dist-test-slave-8tdl"
server_key: "9ae922aa0af963408066baa747565f12"
server_key_iv: "eea1fa8c25bab61a11738596401a3fa8"
server_key_version: "encryptionkey@0"
I20260808 15:47:00.424294 15000 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 15:47:00.426761 15015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:00.428120 15000 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:47:00.428277 15000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "0768475129944942a1a39ea968bfb1f9"
format_stamp: "Formatted at 2026-08-08 15:47:00 on dist-test-slave-8tdl"
server_key: "9ae922aa0af963408066baa747565f12"
server_key_iv: "eea1fa8c25bab61a11738596401a3fa8"
server_key_version: "encryptionkey@0"
I20260808 15:47:00.428396 15000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:00.441174 15000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:00.444464 15000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:00.444675 15000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:00.445271 15000 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:47:00.446103 15000 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:47:00.446172 15000 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:00.446244 15000 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:47:00.446295 15000 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:00.455864 15000 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:38557
I20260808 15:47:00.456064 15129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:38557 every 8 connection(s)
I20260808 15:47:00.456907 15000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:47:00.457778 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 15000
I20260808 15:47:00.457927 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance
I20260808 15:47:00.458226 8349 external_mini_cluster.cc:1428] Setting key b0c3088020d3496aaa4c908d6d7c7538
Aug 08 15:47:00 dist-test-slave-8tdl krb5kdc[14755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204020, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM
WARNING: no policy specified for oryx/127.8.39.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.39.67@KRBTEST.COM" created.
I20260808 15:47:00.472312 14840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:00.458956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:35047 (local address 127.8.39.126:45971)
0808 15:47:00.459098 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:00.459103 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:00.460595 (+ 1492us) server_negotiation.cc:407] Connection header received
0808 15:47:00.461862 (+ 1267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:00.461865 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:00.461920 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:00.462004 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:00.463235 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:00.463788 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:00.465009 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:00.465247 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:00.465373 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:00.468291 (+ 2918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:00.468295 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:00.468298 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:00.468348 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:00.469982 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:00.470549 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:00.470552 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:00.470553 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:00.470661 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:00.471126 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:00.471129 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:00.471131 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:00.471333 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:00.471447 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:00.471999 (+ 552us) server_negotiation.cc:299] Negotiation successful
0808 15:47:00.472132 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 15:47:00.473146 15132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:00.459427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.66:35047)
0808 15:47:00.460445 (+ 1018us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:00.460488 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:00.461647 (+ 1159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:00.462173 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:00.462180 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:00.462543 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:00.463086 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:00.463099 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:00.463947 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:00.463970 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:00.464876 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:00.464887 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:00.465405 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:00.465409 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:00.465584 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:00.466265 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:00.466282 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:00.468123 (+ 1841us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:00.470142 (+ 2019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:00.470147 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:00.470160 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:00.470443 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:00.470811 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:00.470815 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:00.470817 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:00.471016 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:00.471446 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:00.471452 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:00.471753 (+ 301us) client_negotiation.cc:769] Sending connection context
0808 15:47:00.471942 (+ 189us) client_negotiation.cc:240] Negotiation successful
0808 15:47:00.472289 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":849,"thread_start_us":136,"threads_started":1}
I20260808 15:47:00.474401 15130 heartbeater.cc:347] Connected to a master server at 127.8.39.126:45971
I20260808 15:47:00.474659 15130 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:00.475206 15130 heartbeater.cc:511] Master 127.8.39.126:45971 requested a full tablet report, sending...
I20260808 15:47:00.476305 14801 ts_manager.cc:194] Registered new tserver with Master: 0768475129944942a1a39ea968bfb1f9 (127.8.39.66:38557)
I20260808 15:47:00.476948 14801 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.39.66@KRBTEST.COM'} at 127.8.39.66:35047
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.39.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.67.keytab.
Entry for principal oryx/127.8.39.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.67.keytab.
I20260808 15:47:00.490577 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:0
--local_ip_for_outbound_sockets=127.8.39.67
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:45971
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.67.keytab
--principal=oryx/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:41173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:47:00.630659 15135 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:00.631028 15135 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:00.631126 15135 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:00.635401 15135 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:00.635492 15135 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:00.635586 15135 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:47:00.641498 15135 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:41173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.67.keytab
--principal=oryx/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:45971
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15135
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:00.642618 15135 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:00.643669 15135 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:00.653445 15141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:00.653483 15143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:00.653486 15140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:00.653677 15135 server_base.cc:1034] running on GCE node
I20260808 15:47:00.654193 15135 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:00.654892 15135 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:00.656075 15135 hybrid_clock.cc:648] HybridClock initialized: now 1786204020656061 us; error 26 us; skew 500 ppm
Aug 08 15:47:00 dist-test-slave-8tdl krb5kdc[14755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204020, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:47:00.659015 15135 init.cc:377] Logged in from keytab as oryx/127.8.39.67@KRBTEST.COM (short username oryx)
I20260808 15:47:00.659866 15135 webserver.cc:460] Webserver started at http://127.8.39.67:33981/ using document root <none> and password file <none>
I20260808 15:47:00.660420 15135 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:00.660487 15135 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:00.660699 15135 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:47:00.662830 15135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/data/instance:
uuid: "efef22d6e3874f02a4e6253d7ec88ac3"
format_stamp: "Formatted at 2026-08-08 15:47:00 on dist-test-slave-8tdl"
server_key: "b8ec7b2c1b37e56452c16453b95247eb"
server_key_iv: "6ebd47e7153331563f80ea004cd9593c"
server_key_version: "encryptionkey@0"
I20260808 15:47:00.663415 15135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance:
uuid: "efef22d6e3874f02a4e6253d7ec88ac3"
format_stamp: "Formatted at 2026-08-08 15:47:00 on dist-test-slave-8tdl"
server_key: "b8ec7b2c1b37e56452c16453b95247eb"
server_key_iv: "6ebd47e7153331563f80ea004cd9593c"
server_key_version: "encryptionkey@0"
I20260808 15:47:00.667449 15135 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 15:47:00.670087 15150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:00.671620 15135 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:47:00.671768 15135 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "efef22d6e3874f02a4e6253d7ec88ac3"
format_stamp: "Formatted at 2026-08-08 15:47:00 on dist-test-slave-8tdl"
server_key: "b8ec7b2c1b37e56452c16453b95247eb"
server_key_iv: "6ebd47e7153331563f80ea004cd9593c"
server_key_version: "encryptionkey@0"
I20260808 15:47:00.671901 15135 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:00.709822 15135 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:00.713357 15135 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:00.713577 15135 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:00.714212 15135 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:47:00.715111 15135 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:47:00.715183 15135 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:00.715253 15135 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:47:00.715296 15135 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:00.724602 15135 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:35371
I20260808 15:47:00.724625 15266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:35371 every 8 connection(s)
I20260808 15:47:00.725519 15135 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:47:00.728690 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 15135
I20260808 15:47:00.728834 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance
I20260808 15:47:00.729310 8349 external_mini_cluster.cc:1428] Setting key 92c65106311dcf4e78eb4e7993786dc1
Aug 08 15:47:00 dist-test-slave-8tdl krb5kdc[14755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204020, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM
I20260808 15:47:00.740454 14840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:00.727601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:53483 (local address 127.8.39.126:45971)
0808 15:47:00.727752 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:00.727756 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:00.728574 (+ 818us) server_negotiation.cc:407] Connection header received
0808 15:47:00.730163 (+ 1589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:00.730166 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:00.730246 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:00.730335 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:00.731940 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:00.732583 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:00.733730 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:00.733956 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:00.734075 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:00.736697 (+ 2622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:00.736702 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:00.736710 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:00.736737 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:00.738215 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:00.738780 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:00.738784 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:00.738787 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:00.738873 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:00.739244 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:00.739247 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:00.739249 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:00.739443 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:00.739550 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:00.740146 (+ 596us) server_negotiation.cc:299] Negotiation successful
0808 15:47:00.740276 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 15:47:00.741380 15269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:00.727921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.67:53483)
0808 15:47:00.728398 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:00.728442 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:00.729931 (+ 1489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:00.730536 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:00.730543 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:00.731062 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:00.731785 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:00.731807 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:00.732710 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:00.732713 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:00.733593 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:00.733602 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:00.734114 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:00.734118 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:00.734298 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:00.734995 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:00.735012 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:00.736520 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:00.738353 (+ 1833us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:00.738359 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:00.738375 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:00.738652 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:00.738975 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:00.738978 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:00.738980 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:00.739136 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:00.739552 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:00.739559 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:00.739896 (+ 337us) client_negotiation.cc:769] Sending connection context
0808 15:47:00.740088 (+ 192us) client_negotiation.cc:240] Negotiation successful
0808 15:47:00.740425 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":119,"threads_started":1}
I20260808 15:47:00.742621 15267 heartbeater.cc:347] Connected to a master server at 127.8.39.126:45971
I20260808 15:47:00.742904 15267 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:00.743513 15267 heartbeater.cc:511] Master 127.8.39.126:45971 requested a full tablet report, sending...
I20260808 15:47:00.744576 14801 ts_manager.cc:194] Registered new tserver with Master: efef22d6e3874f02a4e6253d7ec88ac3 (127.8.39.67:35371)
I20260808 15:47:00.745224 14801 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.39.67@KRBTEST.COM'} at 127.8.39.67:53483
I20260808 15:47:00.756088 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.8.39.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.39.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.39.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.125.keytab.
Entry for principal oryx/127.8.39.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.125.keytab.
I20260808 15:47:00.785940 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.125:38219
--webserver_interface=127.8.39.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.125.keytab
--principal=oryx/127.8.39.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:41173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:45971,127.8.39.125:38219
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:47:00.899693 15272 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:00.899966 15272 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:00.900009 15272 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:00.904080 15272 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:47:00.904135 15272 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:00.904156 15272 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:00.904173 15272 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:47:00.904191 15272 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:47:00.909663 15272 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:41173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:45971,127.8.39.125:38219
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.125.keytab
--principal=oryx/127.8.39.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.125:38219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.39.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15272
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
W20260808 15:47:00.909878 15272 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.8.39.126:45971,127.8.39.125:38219'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 15:47:00.910789 15272 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:00.911839 15272 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:00.920416 15280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:00.920500 15277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:00.920404 15278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:00.920615 15272 server_base.cc:1034] running on GCE node
I20260808 15:47:00.921370 15272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:00.922621 15272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:00.923879 15272 hybrid_clock.cc:648] HybridClock initialized: now 1786204020923857 us; error 33 us; skew 500 ppm
Aug 08 15:47:00 dist-test-slave-8tdl krb5kdc[14755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204020, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:47:00.927014 15272 init.cc:377] Logged in from keytab as oryx/127.8.39.125@KRBTEST.COM (short username oryx)
I20260808 15:47:00.927939 15272 webserver.cc:460] Webserver started at http://127.8.39.125:36731/ using document root <none> and password file <none>
I20260808 15:47:00.928517 15272 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:00.928588 15272 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:00.928767 15272 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:47:00.931023 15272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-1/data/instance:
uuid: "4db134f3e18f4744b07d2f2960a474df"
format_stamp: "Formatted at 2026-08-08 15:47:00 on dist-test-slave-8tdl"
server_key: "55c41da70b5fa96c26806a97f15b223b"
server_key_iv: "9b0c1b2593fa73c9b11c14dcc01c9dda"
server_key_version: "encryptionkey@0"
I20260808 15:47:00.931704 15272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-1/wal/instance:
uuid: "4db134f3e18f4744b07d2f2960a474df"
format_stamp: "Formatted at 2026-08-08 15:47:00 on dist-test-slave-8tdl"
server_key: "55c41da70b5fa96c26806a97f15b223b"
server_key_iv: "9b0c1b2593fa73c9b11c14dcc01c9dda"
server_key_version: "encryptionkey@0"
I20260808 15:47:00.936085 15272 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 15:47:00.938524 15287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:00.939852 15272 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 15:47:00.940001 15272 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-1/wal
uuid: "4db134f3e18f4744b07d2f2960a474df"
format_stamp: "Formatted at 2026-08-08 15:47:00 on dist-test-slave-8tdl"
server_key: "55c41da70b5fa96c26806a97f15b223b"
server_key_iv: "9b0c1b2593fa73c9b11c14dcc01c9dda"
server_key_version: "encryptionkey@0"
I20260808 15:47:00.940120 15272 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:00.980871 15272 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:00.984125 15272 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:00.984301 15272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:00.993188 15272 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.125:38219
I20260808 15:47:00.993197 15340 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.125:38219 every 8 connection(s)
I20260808 15:47:00.994233 15272 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-1/data/info.pb
I20260808 15:47:00.997054 15341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:01.000771 15341 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:47:01.003912 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 15272
Aug 08 15:47:01 dist-test-slave-8tdl krb5kdc[14755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204020, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.125@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM
Aug 08 15:47:01 dist-test-slave-8tdl krb5kdc[14755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.39.125@KRBTEST.COM
I20260808 15:47:01.017249 14840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.002747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36792 (local address 127.8.39.126:45971)
0808 15:47:01.002909 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:01.002914 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:01.003789 (+ 875us) server_negotiation.cc:407] Connection header received
0808 15:47:01.005091 (+ 1302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:01.005096 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:01.005161 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:01.005258 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:01.006559 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.007442 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.009119 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.009499 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.009619 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.012815 (+ 3196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:01.012818 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:01.012820 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:01.012845 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:01.014489 (+ 1644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.015231 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.015233 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.015235 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.015310 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.015677 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.015680 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.015682 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.016077 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:01.016175 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:01.016926 (+ 751us) server_negotiation.cc:299] Negotiation successful
0808 15:47:01.017063 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 15:47:01.018215 15345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.004816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46618 (local address 127.8.39.125:38219)
0808 15:47:01.005210 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:01.005224 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:01.005251 (+ 27us) server_negotiation.cc:407] Connection header received
0808 15:47:01.005401 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:01.005405 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:01.005564 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:01.005702 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:01.006745 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.007904 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.009119 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.009703 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.009867 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.013175 (+ 3308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:01.013181 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:01.013192 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:01.013212 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:01.015134 (+ 1922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.015790 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.015794 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.015795 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.015862 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.016278 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.016281 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.016283 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.016613 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:01.016805 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:01.017043 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 15:47:01.017197 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":80,"server-negotiator.queue_time_us":300,"thread_start_us":92,"threads_started":1}
I20260808 15:47:01.018215 15343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.003088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.0.0.1:36792)
0808 15:47:01.003578 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:01.003659 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:01.004811 (+ 1152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:01.005425 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:01.005433 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:01.005892 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:01.006400 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.006422 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.007593 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.007596 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.008945 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.008957 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.009665 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.009668 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.009852 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.010730 (+ 878us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:01.010754 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:01.012663 (+ 1909us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:01.014600 (+ 1937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.014610 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.014623 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.015141 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.015408 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.015410 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.015412 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.015549 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.016285 (+ 736us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:01.016291 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:01.016620 (+ 329us) client_negotiation.cc:769] Sending connection context
0808 15:47:01.016786 (+ 166us) client_negotiation.cc:240] Negotiation successful
0808 15:47:01.017146 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"mutex_wait_us":23,"spinlock_wait_cycles":1920,"thread_start_us":131,"threads_started":1}
I20260808 15:47:01.020411 15341 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 15:47:01 dist-test-slave-8tdl krb5kdc[14755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204020, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.125@KRBTEST.COM for oryx/127.8.39.125@KRBTEST.COM
I20260808 15:47:01.028189 15343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.020916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:38219 (local address 127.0.0.1:46620)
0808 15:47:01.021038 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:01.021054 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:01.021124 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:01.021310 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:01.021312 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:01.021460 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:01.021548 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.021552 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.022217 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.022220 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.022836 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.022845 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.023294 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.023297 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.023430 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.023982 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:01.023995 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:01.025245 (+ 1250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:01.026857 (+ 1612us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.026860 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.026861 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.027075 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.027317 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.027319 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.027321 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.027412 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.027762 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:01.027764 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:01.027841 (+ 77us) client_negotiation.cc:769] Sending connection context
0808 15:47:01.027926 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 15:47:01.028032 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 15:47:01.028213 15345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.021023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46620 (local address 127.8.39.125:38219)
0808 15:47:01.021135 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:01.021138 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:01.021170 (+ 32us) server_negotiation.cc:407] Connection header received
0808 15:47:01.021196 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:01.021198 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:01.021229 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:01.021285 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:01.021638 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.022111 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.022938 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.023165 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.023243 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.025379 (+ 2136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:01.025382 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:01.025384 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:01.025404 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:01.026761 (+ 1357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.027162 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.027165 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.027166 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.027235 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.027527 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.027529 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.027530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.027682 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:01.027752 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:01.027981 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 15:47:01.028083 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":41}
I20260808 15:47:01.031961 15341 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df: Bootstrap starting.
I20260808 15:47:01.034232 15341 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:01.035063 15341 log.cc:824] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df: Log is configured to *not* fsync() on all Append() calls
I20260808 15:47:01.036932 15341 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df: No bootstrap required, opened a new log
I20260808 15:47:01.039922 15341 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } }
I20260808 15:47:01.040148 15341 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:01.040226 15341 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db134f3e18f4744b07d2f2960a474df, State: Initialized, Role: FOLLOWER
I20260808 15:47:01.040688 15341 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } }
I20260808 15:47:01.041183 15347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } } }
I20260808 15:47:01.041298 15347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:47:01.041850 15341 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [sys.catalog]: configured and running, proceeding with master startup.
W20260808 15:47:01.046814 15358 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:47:01.046912 15358 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:47:01.049206 15272 master_runner.cc:428] Detected that this master 4db134f3e18f4744b07d2f2960a474df is joining an existing cluster
I20260808 15:47:01.049273 15272 master_runner.cc:432] Initiating AddMaster RPC to add 127.8.39.125:38219
I20260808 15:47:01.060542 15365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.051667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:38219 (local address 127.0.0.1:46634)
0808 15:47:01.052257 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:01.052272 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:01.052378 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:01.052647 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:01.052650 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:01.052971 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:01.053120 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.053128 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.053945 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.053948 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.054874 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.054884 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.055456 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.055460 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.055572 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.056145 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:01.056158 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:01.056525 (+ 367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:01.058759 (+ 2234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.058762 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.058765 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.059073 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.059414 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.059417 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.059419 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.059516 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.059965 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:01.059967 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:01.060055 (+ 88us) client_negotiation.cc:769] Sending connection context
0808 15:47:01.060170 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 15:47:01.060312 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"mutex_wait_us":299,"thread_start_us":100,"threads_started":1}
I20260808 15:47:01.060541 15345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.051841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46634 (local address 127.8.39.125:38219)
0808 15:47:01.052038 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:01.052044 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:01.052360 (+ 316us) server_negotiation.cc:407] Connection header received
0808 15:47:01.052473 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:01.052476 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:01.052518 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:01.052595 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:01.053243 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.053759 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.054998 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.055336 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.055449 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.056669 (+ 1220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:01.056672 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:01.056676 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:01.056701 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:01.058615 (+ 1914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.059190 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.059194 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.059198 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.059308 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.059624 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.059627 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.059629 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.059871 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:01.059976 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:01.060236 (+ 260us) server_negotiation.cc:299] Negotiation successful
0808 15:47:01.060376 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":48,"server-negotiator.queue_time_us":133,"spinlock_wait_cycles":1792}
I20260808 15:47:01.061077 14840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.051811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36806 (local address 127.8.39.126:45971)
0808 15:47:01.051944 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:01.051948 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:01.052288 (+ 340us) server_negotiation.cc:407] Connection header received
0808 15:47:01.052479 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:01.052482 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:01.052530 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:01.052588 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:01.053357 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.054191 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.055267 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.055583 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.055699 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.057301 (+ 1602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:01.057307 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:01.057310 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:01.057341 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:01.059085 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.059596 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.059600 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.059602 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.059699 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.060038 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.060041 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.060043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.060272 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:01.060417 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:01.060765 (+ 348us) server_negotiation.cc:299] Negotiation successful
0808 15:47:01.060903 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 15:47:01.061596 15364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.051665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.0.0.1:36806)
0808 15:47:01.052183 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:01.052199 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:01.052331 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:01.052787 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:01.052790 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:01.053093 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:01.053227 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.053237 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.054331 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.054335 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.055155 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.055161 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.055704 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.055708 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.056170 (+ 462us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.056640 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:01.056655 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:01.057097 (+ 442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:01.059225 (+ 2128us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.059228 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.059231 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.059498 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.059799 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.059802 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.059804 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.059905 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.060462 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:01.060465 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:01.060552 (+ 87us) client_negotiation.cc:769] Sending connection context
0808 15:47:01.061291 (+ 739us) client_negotiation.cc:240] Negotiation successful
0808 15:47:01.061440 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":108,"threads_started":1}
Aug 08 15:47:01 dist-test-slave-8tdl krb5kdc[14755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204019, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.126@KRBTEST.COM for oryx/127.8.39.125@KRBTEST.COM
I20260808 15:47:01.077618 15345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.066813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46648 (local address 127.8.39.125:38219)
0808 15:47:01.067012 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:01.067017 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:01.067358 (+ 341us) server_negotiation.cc:407] Connection header received
0808 15:47:01.067619 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:01.067622 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:01.067675 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:01.067780 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:01.068490 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.069384 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.070387 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.070759 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.070865 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.073424 (+ 2559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:01.073428 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:01.073430 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:01.073455 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:01.075264 (+ 1809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.075990 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.075996 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.075999 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.076107 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.076435 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.076441 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.076445 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.076702 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:01.076809 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:01.077312 (+ 503us) server_negotiation.cc:299] Negotiation successful
0808 15:47:01.077449 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260808 15:47:01.077764 15366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.066776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:38219 (local address 127.0.0.1:46648)
0808 15:47:01.067187 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:01.067244 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:01.067463 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:01.067846 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:01.067852 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:01.068251 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:01.068373 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.068379 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.069524 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.069527 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.070232 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.070242 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.070914 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.070918 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.071053 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.071755 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:01.071773 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:01.073280 (+ 1507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:01.075415 (+ 2135us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.075425 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.075432 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.075867 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.076216 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.076219 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.076221 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.076318 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.076875 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:01.076885 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:01.077039 (+ 154us) client_negotiation.cc:769] Sending connection context
0808 15:47:01.077226 (+ 187us) client_negotiation.cc:240] Negotiation successful
0808 15:47:01.077492 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":116,"threads_started":1}
I20260808 15:47:01.079496 14801 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.8.39.125:38219: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "4db134f3e18f4744b07d2f2960a474df"
member_type: NON_VOTER
last_known_addr {
host: "127.8.39.125"
port: 38219
}
attrs {
promote: true
}
}
dest_uuid: "ee802f092ae04c278f521f27230e7f5f"
cas_config_opid_index: -1
I20260808 15:47:01.080269 14801 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: NON_VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: true } }
I20260808 15:47:01.083194 15314 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 0 FOLLOWER]: Advancing to term 1
WARNING: no policy specified for oryx/127.8.39.124@KRBTEST.COM; defaulting to no policy
I20260808 15:47:01.084745 15314 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 1 FOLLOWER]: Refusing update from remote peer ee802f092ae04c278f521f27230e7f5f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 15:47:01.082455 15369 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 4db134f3e18f4744b07d2f2960a474df (127.8.39.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: NON_VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: true } } }
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.39.124@KRBTEST.COM" created.
I20260808 15:47:01.086845 15370 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: NON_VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:47:01.086848 15369 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.8.39.125:38219
I20260808 15:47:01.088848 15369 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "ee802f092ae04c278f521f27230e7f5f" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: NON_VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: true } } }
I20260808 15:47:01.088982 15369 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [sys.catalog]: This master's current role is: LEADER
I20260808 15:47:01.089130 15272 master.cc:537] Master@127.8.39.125:38219 shutting down...
I20260808 15:47:01.093998 15314 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 1 LEARNER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 4db134f3e18f4744b07d2f2960a474df (127.8.39.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: NON_VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: true } } }
I20260808 15:47:01.094544 15374 mvcc.cc:205] Tried to move back new op lower bound from 7316291665899618304 to 7316291665782657024. Current Snapshot: MvccSnapshot[applied={T|T < 7316291665817976832}]
I20260808 15:47:01.098331 15347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee802f092ae04c278f521f27230e7f5f. Latest consensus state: current_term: 1 leader_uuid: "ee802f092ae04c278f521f27230e7f5f" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: NON_VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: true } } }
I20260808 15:47:01.098450 15347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [sys.catalog]: This master's current role is: LEARNER
I20260808 15:47:01.098546 15347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ee802f092ae04c278f521f27230e7f5f" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: NON_VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: true } } }
I20260808 15:47:01.098624 15347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [sys.catalog]: This master's current role is: LEARNER
I20260808 15:47:01.098954 15347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ee802f092ae04c278f521f27230e7f5f" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: NON_VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: true } } }
I20260808 15:47:01.099063 15347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [sys.catalog]: This master's current role is: LEARNER
I20260808 15:47:01.101984 15272 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 1 LEARNER]: Raft consensus shutting down.
I20260808 15:47:01.102293 15272 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 1 LEARNER]: Raft consensus is shut down!
I20260808 15:47:01.102391 15272 tablet_replica.cc:330] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df: stopping tablet replica
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.39.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.124.keytab.
Entry for principal oryx/127.8.39.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.124.keytab.
I20260808 15:47:01.113454 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.124:43751
--webserver_interface=127.8.39.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.124.keytab
--principal=oryx/127.8.39.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:41173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:45971,127.8.39.125:38219,127.8.39.124:43751
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:47:01.118484 15272 master.cc:552] Master@127.8.39.125:38219 shutdown complete.
I20260808 15:47:01.118564 15272 master_runner.cc:305] Clearing existing system tablet
I20260808 15:47:01.118887 15272 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:01.118963 15272 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:01.120100 15272 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 15:47:01.121017 15383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:01.121263 15272 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:01.121412 15272 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 15:47:01.121451 15272 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-1/wal
uuid: "4db134f3e18f4744b07d2f2960a474df"
format_stamp: "Formatted at 2026-08-08 15:47:00 on dist-test-slave-8tdl"
server_key: "55c41da70b5fa96c26806a97f15b223b"
server_key_iv: "9b0c1b2593fa73c9b11c14dcc01c9dda"
server_key_version: "encryptionkey@0"
I20260808 15:47:01.123049 15272 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:47:01.124969 15272 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 15:47:01.125089 15272 log.cc:1196] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 15:47:01.125366 15272 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df: Deleting consensus metadata
I20260808 15:47:01.125557 15272 master_runner.cc:315] Copying system tablet from 127.8.39.126:45971
I20260808 15:47:01.126885 15272 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df: tablet copy: Beginning tablet copy session from remote peer at address 127.8.39.126:45971
I20260808 15:47:01.135318 15389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.127538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.0.0.1:36816)
0808 15:47:01.127906 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:01.127918 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:01.128066 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:01.128347 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:01.128350 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:01.128589 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:01.128681 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.128687 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.129494 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.129499 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.130096 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.130104 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.130620 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.130624 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.130755 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.131320 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:01.131343 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:01.131702 (+ 359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:01.133637 (+ 1935us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.133642 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.133644 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.133854 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.134154 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.134158 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.134160 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.134249 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.134667 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:01.134670 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:01.134844 (+ 174us) client_negotiation.cc:769] Sending connection context
0808 15:47:01.134960 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 15:47:01.135118 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":90,"threads_started":1}
I20260808 15:47:01.135308 14840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.127644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36816 (local address 127.8.39.126:45971)
0808 15:47:01.127790 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:01.127794 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:01.128016 (+ 222us) server_negotiation.cc:407] Connection header received
0808 15:47:01.128183 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:01.128186 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:01.128243 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:01.128330 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:01.128809 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.129374 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.130224 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.130463 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.130604 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.131843 (+ 1239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:01.131847 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:01.131850 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:01.131876 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:01.133521 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.133962 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.133966 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.133967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.134059 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.134345 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.134348 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.134350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.134566 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:01.134677 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:01.135025 (+ 348us) server_negotiation.cc:299] Negotiation successful
0808 15:47:01.135142 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 15:47:01.136246 14821 tablet_copy_service.cc:140] P ee802f092ae04c278f521f27230e7f5f: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 4db134f3e18f4744b07d2f2960a474df ({username='oryx', principal='oryx/127.8.39.125@KRBTEST.COM'} at 127.0.0.1:36816)
I20260808 15:47:01.136440 14821 tablet_copy_service.cc:161] P ee802f092ae04c278f521f27230e7f5f: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 4db134f3e18f4744b07d2f2960a474df at {username='oryx', principal='oryx/127.8.39.125@KRBTEST.COM'} at 127.0.0.1:36816: session id = 4db134f3e18f4744b07d2f2960a474df-00000000000000000000000000000000
I20260808 15:47:01.137986 14821 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 15:47:01.139633 15272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 15:47:01.141769 15272 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df: tablet copy: Starting download of 0 data blocks...
I20260808 15:47:01.142028 15272 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df: tablet copy: Starting download of 1 WAL segments...
I20260808 15:47:01.143929 15272 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 15:47:01.145471 14821 tablet_copy_service.cc:342] P ee802f092ae04c278f521f27230e7f5f: Request end of tablet copy session 4db134f3e18f4744b07d2f2960a474df-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.8.39.125@KRBTEST.COM'} at 127.0.0.1:36816
I20260808 15:47:01.145601 14821 tablet_copy_service.cc:433] P ee802f092ae04c278f521f27230e7f5f: ending tablet copy session 4db134f3e18f4744b07d2f2960a474df-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 4db134f3e18f4744b07d2f2960a474df
I20260808 15:47:01.152680 15272 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:01.154430 15394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:01.154733 15390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:01.154784 15391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:01.155275 15272 server_base.cc:1034] running on GCE node
I20260808 15:47:01.155444 15272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:01.155779 15272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:01.156924 15272 hybrid_clock.cc:648] HybridClock initialized: now 1786204021156936 us; error 44 us; skew 500 ppm
Aug 08 15:47:01 dist-test-slave-8tdl krb5kdc[14755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204021, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:47:01.158456 15272 init.cc:377] Logged in from keytab as oryx/127.8.39.125@KRBTEST.COM (short username oryx)
I20260808 15:47:01.159020 15272 webserver.cc:460] Webserver started at http://127.8.39.125:32789/ using document root <none> and password file <none>
I20260808 15:47:01.159233 15272 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:01.159288 15272 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:01.160410 15272 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 15:47:01.161440 15401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:01.161716 15272 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 15:47:01.161792 15272 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-1/wal
uuid: "4db134f3e18f4744b07d2f2960a474df"
format_stamp: "Formatted at 2026-08-08 15:47:00 on dist-test-slave-8tdl"
server_key: "55c41da70b5fa96c26806a97f15b223b"
server_key_iv: "9b0c1b2593fa73c9b11c14dcc01c9dda"
server_key_version: "encryptionkey@0"
I20260808 15:47:01.161878 15272 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:01.177035 15272 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:01.179414 15272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:01.184403 15272 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.125:38219
I20260808 15:47:01.184409 15455 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.125:38219 every 8 connection(s)
I20260808 15:47:01.184984 15272 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-1/data/info.pb
I20260808 15:47:01.186561 15456 sys_catalog.cc:263] Verifying existing consensus state
I20260808 15:47:01.187417 15456 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df: Bootstrap starting.
I20260808 15:47:01.193497 15456 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 15:47:01.193843 15456 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df: Bootstrap complete.
I20260808 15:47:01.194345 15456 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: NON_VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: true } }
I20260808 15:47:01.194475 15456 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4db134f3e18f4744b07d2f2960a474df, State: Initialized, Role: LEARNER
I20260808 15:47:01.194602 15456 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: NON_VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: true } }
I20260808 15:47:01.194975 15460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: NON_VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: true } } }
I20260808 15:47:01.195134 15456 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:47:01.195148 15460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [sys.catalog]: This master's current role is: LEARNER
I20260808 15:47:01.198840 15471 catalog_manager.cc:1259] Loaded cluster ID: d017dce23e6f4f138f04357015c133f6
I20260808 15:47:01.198909 15471 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df: loading cluster ID for follower catalog manager: success
I20260808 15:47:01.200517 15471 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df: acquiring CA information for follower catalog manager: success
I20260808 15:47:01.201591 15471 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 15:47:01.256292 14995 heartbeater.cc:503] Master 127.8.39.126:45971 was elected leader, sending a full tablet report...
W20260808 15:47:01.276091 15381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:01.276438 15381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:01.276485 15381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:01.280503 15381 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:47:01.280561 15381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:01.280581 15381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:01.280598 15381 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:47:01.280613 15381 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:47:01.285964 15381 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:41173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:45971,127.8.39.125:38219,127.8.39.124:43751
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.124.keytab
--principal=oryx/127.8.39.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.124:43751
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.39.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15381
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:01.287034 15381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:01.288023 15381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:01.297063 15477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:01.297070 15476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:01.297060 15479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:01.297497 15381 server_base.cc:1034] running on GCE node
I20260808 15:47:01.298185 15381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:01.299566 15381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:01.300778 15381 hybrid_clock.cc:648] HybridClock initialized: now 1786204021300751 us; error 41 us; skew 500 ppm
Aug 08 15:47:01 dist-test-slave-8tdl krb5kdc[14755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204021, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:47:01.304250 15381 init.cc:377] Logged in from keytab as oryx/127.8.39.124@KRBTEST.COM (short username oryx)
I20260808 15:47:01.305181 15381 webserver.cc:460] Webserver started at http://127.8.39.124:36463/ using document root <none> and password file <none>
I20260808 15:47:01.305814 15381 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:01.305931 15381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:01.306133 15381 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:47:01.308367 15381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-2/data/instance:
uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84"
format_stamp: "Formatted at 2026-08-08 15:47:01 on dist-test-slave-8tdl"
server_key: "4b25d8ece8bb1d33193f4b7d367ec4b9"
server_key_iv: "f706d094efc727cb73e4ecbb2652058e"
server_key_version: "encryptionkey@0"
I20260808 15:47:01.308979 15381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-2/wal/instance:
uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84"
format_stamp: "Formatted at 2026-08-08 15:47:01 on dist-test-slave-8tdl"
server_key: "4b25d8ece8bb1d33193f4b7d367ec4b9"
server_key_iv: "f706d094efc727cb73e4ecbb2652058e"
server_key_version: "encryptionkey@0"
I20260808 15:47:01.312855 15381 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 15:47:01.315508 15486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:01.316958 15381 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:47:01.317112 15381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-2/wal
uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84"
format_stamp: "Formatted at 2026-08-08 15:47:01 on dist-test-slave-8tdl"
server_key: "4b25d8ece8bb1d33193f4b7d367ec4b9"
server_key_iv: "f706d094efc727cb73e4ecbb2652058e"
server_key_version: "encryptionkey@0"
I20260808 15:47:01.317236 15381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:01.338187 15381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:01.341621 15381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:01.341777 15381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:01.350067 15381 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.124:43751
I20260808 15:47:01.350433 15539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.124:43751 every 8 connection(s)
I20260808 15:47:01.351153 15381 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-2/data/info.pb
I20260808 15:47:01.352289 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 15381
I20260808 15:47:01.354837 15540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:01.358927 15540 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 15:47:01 dist-test-slave-8tdl krb5kdc[14755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.39.124@KRBTEST.COM
Aug 08 15:47:01 dist-test-slave-8tdl krb5kdc[14755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204021, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.124@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM
I20260808 15:47:01.368507 15542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.353976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45058 (local address 127.8.39.124:43751)
0808 15:47:01.354428 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:01.354443 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:01.354481 (+ 38us) server_negotiation.cc:407] Connection header received
0808 15:47:01.355314 (+ 833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:01.355333 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:01.355660 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:01.356015 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:01.356874 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.357887 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.358828 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.359433 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.359624 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.362759 (+ 3135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:01.362765 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:01.362776 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:01.362807 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:01.364891 (+ 2084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.365429 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.365436 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.365445 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.365614 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.365971 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.365973 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.365975 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.366438 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:01.366670 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:01.367001 (+ 331us) server_negotiation.cc:299] Negotiation successful
0808 15:47:01.367341 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":148,"threads_started":1}
I20260808 15:47:01.371042 15543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.360792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.0.0.1:36820)
0808 15:47:01.361254 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:01.361315 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:01.361463 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:01.361784 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:01.361791 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:01.362317 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:01.362454 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.362460 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.363592 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.363598 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.364265 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.364274 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.364755 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.364758 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.364880 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.365390 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:01.365407 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:01.366965 (+ 1558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:01.369229 (+ 2264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.369237 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.369241 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.369447 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.369786 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.369790 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.369792 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.369887 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.370345 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:01.370352 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:01.370482 (+ 130us) client_negotiation.cc:769] Sending connection context
0808 15:47:01.370657 (+ 175us) client_negotiation.cc:240] Negotiation successful
0808 15:47:01.370869 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":143,"threads_started":1}
I20260808 15:47:01.371073 14840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.361044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36820 (local address 127.8.39.126:45971)
0808 15:47:01.361190 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:01.361195 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:01.361423 (+ 228us) server_negotiation.cc:407] Connection header received
0808 15:47:01.361562 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:01.361571 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:01.361621 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:01.361700 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:01.362589 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.363483 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.364398 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.364637 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.364741 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.367139 (+ 2398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:01.367143 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:01.367146 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:01.367196 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:01.369118 (+ 1922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.369559 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.369563 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.369565 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.369664 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.369993 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.369998 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.370000 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.370219 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:01.370346 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:01.370819 (+ 473us) server_negotiation.cc:299] Negotiation successful
0808 15:47:01.370946 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 15:47:01.372052 15540 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 15:47:01 dist-test-slave-8tdl krb5kdc[14755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204021, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.124@KRBTEST.COM for oryx/127.8.39.125@KRBTEST.COM
I20260808 15:47:01.381011 15543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.372573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:38219 (local address 127.0.0.1:46660)
0808 15:47:01.372706 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:01.372722 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:01.372807 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:01.373244 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:01.373246 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:01.373383 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:01.373479 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.373484 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.374496 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.374499 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.375214 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.375224 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.375761 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.375764 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.375839 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.376389 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:01.376403 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:01.377717 (+ 1314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:01.379531 (+ 1814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.379534 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.379536 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.379748 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.380076 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.380079 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.380080 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.380164 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.380529 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:01.380531 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:01.380610 (+ 79us) client_negotiation.cc:769] Sending connection context
0808 15:47:01.380698 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 15:47:01.380805 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260808 15:47:01.381043 15544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.372696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46660 (local address 127.8.39.125:38219)
0808 15:47:01.373013 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:01.373017 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:01.373032 (+ 15us) server_negotiation.cc:407] Connection header received
0808 15:47:01.373072 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:01.373074 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:01.373121 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:01.373208 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:01.373593 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.374380 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.375329 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.375653 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.375739 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.377892 (+ 2153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:01.377895 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:01.377897 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:01.377920 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:01.379404 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.379844 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.379846 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.379847 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.379982 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.380262 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.380264 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.380266 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.380445 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:01.380524 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:01.380801 (+ 277us) server_negotiation.cc:299] Negotiation successful
0808 15:47:01.380920 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":109,"threads_started":1}
I20260808 15:47:01.382097 15540 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.124" port: 43751 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 15:47:01 dist-test-slave-8tdl krb5kdc[14755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204021, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.124@KRBTEST.COM for oryx/127.8.39.124@KRBTEST.COM
I20260808 15:47:01.390753 15543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.382629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:43751 (local address 127.0.0.1:45060)
0808 15:47:01.382907 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:01.382923 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:01.383030 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:01.383277 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:01.383280 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:01.383462 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:01.383526 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.383531 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.384734 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.384741 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.385301 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.385309 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.385804 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.385808 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.385897 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.386327 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:01.386339 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:01.387650 (+ 1311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:01.389269 (+ 1619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.389272 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.389274 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.389465 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.389731 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.389733 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.389735 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.389810 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.390240 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:01.390245 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:01.390352 (+ 107us) client_negotiation.cc:769] Sending connection context
0808 15:47:01.390442 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 15:47:01.390567 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103}
I20260808 15:47:01.390945 15542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.382752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45060 (local address 127.8.39.124:43751)
0808 15:47:01.382856 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:01.382861 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:01.382987 (+ 126us) server_negotiation.cc:407] Connection header received
0808 15:47:01.383131 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:01.383136 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:01.383178 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:01.383265 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:01.383643 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.384608 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.385430 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.385689 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.385806 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.387779 (+ 1973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:01.387782 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:01.387784 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:01.387804 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:01.389159 (+ 1355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.389570 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.389573 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.389574 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.389651 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.389891 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.389894 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.389895 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.390093 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:01.390176 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:01.390524 (+ 348us) server_negotiation.cc:299] Negotiation successful
0808 15:47:01.390631 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 15:47:01.394049 15540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84: Bootstrap starting.
I20260808 15:47:01.396703 15540 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:01.397501 15540 log.cc:824] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84: Log is configured to *not* fsync() on all Append() calls
I20260808 15:47:01.399627 15540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84: No bootstrap required, opened a new log
I20260808 15:47:01.402554 15540 raft_consensus.cc:348] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 43751 } }
I20260808 15:47:01.402827 15540 raft_consensus.cc:374] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:01.402910 15540 raft_consensus.cc:729] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482e9fc7985b4da09a1f6fe5e5f6dd84, State: Initialized, Role: FOLLOWER
I20260808 15:47:01.403337 15540 consensus_queue.cc:260] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 43751 } }
I20260808 15:47:01.403823 15546 sys_catalog.cc:455] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 43751 } } }
I20260808 15:47:01.404170 15546 sys_catalog.cc:458] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:47:01.404544 15540 sys_catalog.cc:564] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 15:47:01.409730 15557 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:47:01.409829 15557 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:47:01.413224 15381 master_runner.cc:428] Detected that this master 482e9fc7985b4da09a1f6fe5e5f6dd84 is joining an existing cluster
I20260808 15:47:01.413295 15381 master_runner.cc:432] Initiating AddMaster RPC to add 127.8.39.124:43751
I20260808 15:47:01.422410 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 14863
I20260808 15:47:01.426277 15563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.415778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:38219 (local address 127.0.0.1:46666)
0808 15:47:01.416202 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:01.416216 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:01.416369 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:01.416745 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:01.416748 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:01.416982 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:01.417128 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.417136 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.418259 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.418262 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.419255 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.419266 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.420047 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.420051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.420143 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.420747 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:01.420762 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:01.421250 (+ 488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:01.424392 (+ 3142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.424396 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.424398 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.424668 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.425032 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.425035 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.425039 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.425133 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.425696 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:01.425699 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:01.425803 (+ 104us) client_negotiation.cc:769] Sending connection context
0808 15:47:01.425923 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 15:47:01.426079 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":137,"threads_started":1}
I20260808 15:47:01.426440 15544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.415914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46666 (local address 127.8.39.125:38219)
0808 15:47:01.416066 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:01.416070 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:01.416285 (+ 215us) server_negotiation.cc:407] Connection header received
0808 15:47:01.416489 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:01.416492 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:01.416545 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:01.416597 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:01.417273 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.418107 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.419416 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.419777 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.419856 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.421442 (+ 1586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:01.421446 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:01.421449 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:01.421479 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:01.424238 (+ 2759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.424803 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.424807 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.424809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.424916 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.425253 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.425260 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.425264 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.425573 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:01.425692 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:01.426005 (+ 313us) server_negotiation.cc:299] Negotiation successful
0808 15:47:01.426176 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 15:47:01.430451 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:39155
--local_ip_for_outbound_sockets=127.8.39.65
--tserver_master_addrs=127.8.39.126:45971
--webserver_port=44879
--webserver_interface=127.8.39.65
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.65.keytab
--principal=oryx/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:41173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.8.39.126:45971,127.8.39.125:38219
--tserver_master_addrs=127.8.39.126:45971,127.8.39.125:38219,127.8.39.124:43751 with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:47:01.448204 15542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.416213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45064 (local address 127.8.39.124:43751)
0808 15:47:01.416313 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:01.416317 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:01.416568 (+ 251us) server_negotiation.cc:407] Connection header received
0808 15:47:01.416724 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:01.416728 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:01.416768 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:01.416817 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:01.417493 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.418265 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.419630 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.419951 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.420017 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.444203 (+ 24186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:01.444207 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:01.444210 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:01.444231 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:01.446058 (+ 1827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.446714 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.446718 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.446719 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.446797 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.447060 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.447062 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.447064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.447500 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:01.447593 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:01.447890 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 15:47:01.448026 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":43}
I20260808 15:47:01.448356 14840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.415915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36834 (local address 127.8.39.126:45971)
0808 15:47:01.416046 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:01.416052 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:01.416739 (+ 687us) server_negotiation.cc:407] Connection header received
0808 15:47:01.416928 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:01.416931 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:01.416985 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:01.417041 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:01.417624 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.418399 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.420140 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.420515 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.420603 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.444203 (+ 23600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:01.444208 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:01.444211 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:01.444244 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:01.446221 (+ 1977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.446824 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.446828 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.446830 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.446936 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.447268 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.447272 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.447274 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.447522 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:01.447616 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:01.448051 (+ 435us) server_negotiation.cc:299] Negotiation successful
0808 15:47:01.448181 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 15:47:01.449070 15565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.415778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.0.0.1:36834)
0808 15:47:01.416657 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:01.416672 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:01.416796 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:01.417195 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:01.417197 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:01.417385 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:01.417498 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.417504 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.418561 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.418564 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.420010 (+ 1446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.420017 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.420779 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.420781 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.420857 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.443335 (+ 22478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:01.443355 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:01.443957 (+ 602us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:01.446367 (+ 2410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.446371 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.446373 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.446699 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.447044 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.447048 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.447050 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.447153 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.447663 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:01.447666 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:01.447777 (+ 111us) client_negotiation.cc:769] Sending connection context
0808 15:47:01.447867 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 15:47:01.448887 (+ 1020us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":819,"mutex_wait_us":1381,"spinlock_wait_cycles":768,"thread_start_us":99,"threads_started":1}
I20260808 15:47:01.449664 15564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.416158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:43751 (local address 127.0.0.1:45064)
0808 15:47:01.416481 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:01.416494 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:01.416623 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:01.416954 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:01.416956 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:01.417203 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:01.417373 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.417381 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.418424 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.418430 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.419506 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.419517 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.420161 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.420164 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.420253 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.443509 (+ 23256us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:01.443527 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:01.444030 (+ 503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:01.446270 (+ 2240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.446273 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.446276 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.446586 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.446894 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.446897 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.446898 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.446977 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.447626 (+ 649us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:01.447629 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:01.447711 (+ 82us) client_negotiation.cc:769] Sending connection context
0808 15:47:01.449201 (+ 1490us) client_negotiation.cc:240] Negotiation successful
0808 15:47:01.449342 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"mutex_wait_us":1,"spinlock_wait_cycles":1920,"thread_start_us":84,"threads_started":1}
Aug 08 15:47:01 dist-test-slave-8tdl krb5kdc[14755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204019, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.126@KRBTEST.COM for oryx/127.8.39.124@KRBTEST.COM
I20260808 15:47:01.463258 15542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.453485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45080 (local address 127.8.39.124:43751)
0808 15:47:01.453589 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:01.453593 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:01.453643 (+ 50us) server_negotiation.cc:407] Connection header received
0808 15:47:01.453799 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:01.453802 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:01.453851 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:01.453940 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:01.454408 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.455238 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.456534 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.456853 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.456956 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.459593 (+ 2637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:01.459597 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:01.459600 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:01.459626 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:01.461423 (+ 1797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.461919 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.461923 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.461925 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.462020 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.462304 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.462307 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.462309 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.462529 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:01.462627 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:01.462980 (+ 353us) server_negotiation.cc:299] Negotiation successful
0808 15:47:01.463100 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 15:47:01.463269 15366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.453414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:43751 (local address 127.0.0.1:45080)
0808 15:47:01.453587 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:01.453601 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:01.453683 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:01.453972 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:01.453976 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:01.454171 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:01.454281 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.454288 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.455366 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.455370 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.456308 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.456321 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.457089 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.457092 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.457191 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.457733 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:01.457749 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:01.459420 (+ 1671us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:01.461538 (+ 2118us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.461542 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.461544 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.461821 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.462110 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.462113 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.462115 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.462211 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.462619 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:01.462623 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:01.462751 (+ 128us) client_negotiation.cc:769] Sending connection context
0808 15:47:01.462872 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 15:47:01.463028 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104}
I20260808 15:47:01.464726 14801 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.8.39.124:43751: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84"
member_type: NON_VOTER
last_known_addr {
host: "127.8.39.124"
port: 43751
}
attrs {
promote: true
}
}
dest_uuid: "ee802f092ae04c278f521f27230e7f5f"
cas_config_opid_index: 5
I20260808 15:47:01.465327 14801 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: NON_VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: true } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: NON_VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: true } }
I20260808 15:47:01.466802 15371 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 482e9fc7985b4da09a1f6fe5e5f6dd84 (127.8.39.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: NON_VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: true } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: NON_VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: true } } }
I20260808 15:47:01.466943 15514 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:01.468351 15371 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.8.39.124:43751
I20260808 15:47:01.468417 15514 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 1 FOLLOWER]: Refusing update from remote peer ee802f092ae04c278f521f27230e7f5f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 15:47:01.468525 15369 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "ee802f092ae04c278f521f27230e7f5f" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: NON_VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: true } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: NON_VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: true } } }
I20260808 15:47:01.468670 15369 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [sys.catalog]: This master's current role is: LEADER
I20260808 15:47:01.468829 15381 master.cc:537] Master@127.8.39.124:43751 shutting down...
I20260808 15:47:01.469147 15369 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: NON_VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 15:47:01.470309 14787 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260808 15:47:01.473889 15381 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:47:01.474148 15381 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:47:01.474241 15381 tablet_replica.cc:330] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84: stopping tablet replica
I20260808 15:47:01.476111 15544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.466658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46670 (local address 127.8.39.125:38219)
0808 15:47:01.466827 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:01.466832 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:01.470881 (+ 4049us) server_negotiation.cc:407] Connection header received
0808 15:47:01.471087 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:01.471091 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:01.471157 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:01.471224 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:47:01.471620 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.472406 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.474103 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.474839 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.474929 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.475109 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:01.475626 (+ 517us) server_negotiation.cc:299] Negotiation successful
0808 15:47:01.475777 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 15:47:01.478278 15366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.466435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:38219 (local address 127.0.0.1:46670)
0808 15:47:01.470801 (+ 4366us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:01.470817 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:01.470962 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:01.471389 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:01.471391 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:01.471409 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:47:01.471496 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.471501 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.472648 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.472651 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.473860 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.473871 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.475316 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.475322 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.475449 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.475499 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 15:47:01.478041 (+ 2542us) client_negotiation.cc:240] Negotiation successful
0808 15:47:01.478152 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4281}
I20260808 15:47:01.478988 15130 heartbeater.cc:503] Master 127.8.39.126:45971 was elected leader, sending a full tablet report...
I20260808 15:47:01.479094 15429 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 1 LEARNER]: Refusing update from remote peer ee802f092ae04c278f521f27230e7f5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 15:47:01.479410 15366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.479120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:43751 (local address 127.0.0.1:45090)
0808 15:47:01.479267 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:01.479339 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:43751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
W20260808 15:47:01.479542 14787 consensus_peers.cc:487] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f -> Peer 482e9fc7985b4da09a1f6fe5e5f6dd84 (127.8.39.124:43751): Couldn't send request to peer 482e9fc7985b4da09a1f6fe5e5f6dd84. Status: Network error: Client connection negotiation failed: client connection to 127.8.39.124:43751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 15:47:01.479559 15369 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: NON_VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 15:47:01.480676 15429 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 482e9fc7985b4da09a1f6fe5e5f6dd84 (127.8.39.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: NON_VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: true } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: NON_VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: true } } }
I20260808 15:47:01.482546 15460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee802f092ae04c278f521f27230e7f5f. Latest consensus state: current_term: 1 leader_uuid: "ee802f092ae04c278f521f27230e7f5f" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: NON_VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: true } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: NON_VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: true } } }
I20260808 15:47:01.482651 15460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [sys.catalog]: This master's current role is: LEARNER
I20260808 15:47:01.482764 15460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ee802f092ae04c278f521f27230e7f5f" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: NON_VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: true } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: NON_VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: true } } }
I20260808 15:47:01.482829 15460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [sys.catalog]: This master's current role is: LEARNER
I20260808 15:47:01.483317 15370 raft_consensus.cc:1050] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f: attempting to promote NON_VOTER 4db134f3e18f4744b07d2f2960a474df to VOTER
I20260808 15:47:01.483757 15370 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: NON_VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: true } }
I20260808 15:47:01.484845 15429 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 1 LEARNER]: Refusing update from remote peer ee802f092ae04c278f521f27230e7f5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 15:47:01.485090 15366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.484732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:43751 (local address 127.0.0.1:45094)
0808 15:47:01.484970 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:01.485024 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:43751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260808 15:47:01.485347 15369 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260808 15:47:01.485721 15366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.485512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:43751 (local address 127.0.0.1:45098)
0808 15:47:01.485625 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:01.485666 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:43751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260808 15:47:01.485821 14787 consensus_peers.cc:487] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f -> Peer 482e9fc7985b4da09a1f6fe5e5f6dd84 (127.8.39.124:43751): Couldn't send request to peer 482e9fc7985b4da09a1f6fe5e5f6dd84. Status: Network error: Client connection negotiation failed: client connection to 127.8.39.124:43751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 15:47:01.487247 15371 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 4db134f3e18f4744b07d2f2960a474df (127.8.39.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: NON_VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: true } } }
I20260808 15:47:01.487766 15429 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 4db134f3e18f4744b07d2f2960a474df (127.8.39.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: NON_VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: true } } }
I20260808 15:47:01.488659 15371 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "ee802f092ae04c278f521f27230e7f5f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: NON_VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: true } } }
I20260808 15:47:01.488754 15371 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [sys.catalog]: This master's current role is: LEADER
I20260808 15:47:01.488870 15371 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ee802f092ae04c278f521f27230e7f5f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: NON_VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: true } } }
I20260808 15:47:01.488934 15371 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [sys.catalog]: This master's current role is: LEADER
I20260808 15:47:01.489995 15569 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ee802f092ae04c278f521f27230e7f5f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: NON_VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: true } } }
I20260808 15:47:01.490162 15569 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:47:01.490579 15381 master.cc:552] Master@127.8.39.124:43751 shutdown complete.
I20260808 15:47:01.490634 15381 master_runner.cc:305] Clearing existing system tablet
I20260808 15:47:01.490906 15381 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:01.490965 15381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:01.492273 15381 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 15:47:01.494841 15571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:01.495062 15381 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:01.495198 15381 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:47:01.495234 15381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-2/wal
uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84"
format_stamp: "Formatted at 2026-08-08 15:47:01 on dist-test-slave-8tdl"
server_key: "4b25d8ece8bb1d33193f4b7d367ec4b9"
server_key_iv: "f706d094efc727cb73e4ecbb2652058e"
server_key_version: "encryptionkey@0"
I20260808 15:47:01.497346 15381 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:47:01.499796 15381 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 15:47:01.499895 15381 log.cc:1196] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 15:47:01.500154 15381 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84: Deleting consensus metadata
I20260808 15:47:01.500321 15381 master_runner.cc:315] Copying system tablet from 127.8.39.126:45971
I20260808 15:47:01.501502 15381 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84: tablet copy: Beginning tablet copy session from remote peer at address 127.8.39.126:45971
I20260808 15:47:01.511603 14840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.502166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36848 (local address 127.8.39.126:45971)
0808 15:47:01.502297 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:01.502302 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:01.502569 (+ 267us) server_negotiation.cc:407] Connection header received
0808 15:47:01.502803 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:01.502806 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:01.502860 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:01.502913 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:01.503649 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.504489 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.505887 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.506211 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.506305 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.508058 (+ 1753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:01.508062 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:01.508065 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:01.508092 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:01.509779 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.510276 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.510280 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.510282 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.510375 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.510670 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.510690 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.510691 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.510921 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:01.511020 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:01.511318 (+ 298us) server_negotiation.cc:299] Negotiation successful
0808 15:47:01.511442 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 15:47:01.511615 15578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.502050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.0.0.1:36848)
0808 15:47:01.502471 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:01.502487 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:01.502653 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:01.503062 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:01.503065 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:01.503291 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:01.503481 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.503493 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.504686 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.504690 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.505718 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.505729 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.506511 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.506517 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.506712 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.507408 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:01.507423 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:01.507897 (+ 474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:01.509911 (+ 2014us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.509914 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.509916 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.510169 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.510475 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.510478 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.510480 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.510574 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.511024 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:01.511027 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:01.511134 (+ 107us) client_negotiation.cc:769] Sending connection context
0808 15:47:01.511245 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 15:47:01.511405 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":98,"threads_started":1}
I20260808 15:47:01.512399 14821 tablet_copy_service.cc:140] P ee802f092ae04c278f521f27230e7f5f: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 482e9fc7985b4da09a1f6fe5e5f6dd84 ({username='oryx', principal='oryx/127.8.39.124@KRBTEST.COM'} at 127.0.0.1:36848)
I20260808 15:47:01.512512 14821 tablet_copy_service.cc:161] P ee802f092ae04c278f521f27230e7f5f: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 482e9fc7985b4da09a1f6fe5e5f6dd84 at {username='oryx', principal='oryx/127.8.39.124@KRBTEST.COM'} at 127.0.0.1:36848: session id = 482e9fc7985b4da09a1f6fe5e5f6dd84-00000000000000000000000000000000
I20260808 15:47:01.513670 14821 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 15:47:01.515019 15381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 15:47:01.517529 15381 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84: tablet copy: Starting download of 0 data blocks...
I20260808 15:47:01.517747 15381 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84: tablet copy: Starting download of 1 WAL segments...
I20260808 15:47:01.519487 15381 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 15:47:01.521459 14821 tablet_copy_service.cc:342] P ee802f092ae04c278f521f27230e7f5f: Request end of tablet copy session 482e9fc7985b4da09a1f6fe5e5f6dd84-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.8.39.124@KRBTEST.COM'} at 127.0.0.1:36848
I20260808 15:47:01.521549 14821 tablet_copy_service.cc:433] P ee802f092ae04c278f521f27230e7f5f: ending tablet copy session 482e9fc7985b4da09a1f6fe5e5f6dd84-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 482e9fc7985b4da09a1f6fe5e5f6dd84
I20260808 15:47:01.529521 15381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:01.531252 15579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:01.531543 15582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:01.531807 15580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:01.532363 15381 server_base.cc:1034] running on GCE node
I20260808 15:47:01.532552 15381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:01.532924 15381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:01.534153 15381 hybrid_clock.cc:648] HybridClock initialized: now 1786204021534140 us; error 30 us; skew 500 ppm
Aug 08 15:47:01 dist-test-slave-8tdl krb5kdc[14755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204021, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:47:01.536044 15381 init.cc:377] Logged in from keytab as oryx/127.8.39.124@KRBTEST.COM (short username oryx)
I20260808 15:47:01.536583 15381 webserver.cc:460] Webserver started at http://127.8.39.124:35585/ using document root <none> and password file <none>
I20260808 15:47:01.536834 15381 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:01.536926 15381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:01.538321 15381 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 15:47:01.539532 15589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:01.539812 15381 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 15:47:01.539937 15381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-2/wal
uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84"
format_stamp: "Formatted at 2026-08-08 15:47:01 on dist-test-slave-8tdl"
server_key: "4b25d8ece8bb1d33193f4b7d367ec4b9"
server_key_iv: "f706d094efc727cb73e4ecbb2652058e"
server_key_version: "encryptionkey@0"
I20260808 15:47:01.540104 15381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:01.548705 15381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:01.551141 15381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:01.556589 15381 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.124:43751
I20260808 15:47:01.556649 15643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.124:43751 every 8 connection(s)
I20260808 15:47:01.557344 15381 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/master-2/data/info.pb
I20260808 15:47:01.559330 15644 sys_catalog.cc:263] Verifying existing consensus state
I20260808 15:47:01.560469 15644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84: Bootstrap starting.
I20260808 15:47:01.572467 15644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 15:47:01.572817 15644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84: Bootstrap complete.
I20260808 15:47:01.573557 15644 raft_consensus.cc:348] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: NON_VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: true } }
I20260808 15:47:01.573715 15644 raft_consensus.cc:729] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 482e9fc7985b4da09a1f6fe5e5f6dd84, State: Initialized, Role: LEARNER
I20260808 15:47:01.573838 15644 consensus_queue.cc:260] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: NON_VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: true } }
I20260808 15:47:01.574244 15648 sys_catalog.cc:455] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: NON_VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: true } } }
I20260808 15:47:01.574359 15644 sys_catalog.cc:564] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:47:01.574458 15648 sys_catalog.cc:458] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [sys.catalog]: This master's current role is: LEARNER
I20260808 15:47:01.577518 15659 catalog_manager.cc:1259] Loaded cluster ID: d017dce23e6f4f138f04357015c133f6
I20260808 15:47:01.577661 15659 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84: loading cluster ID for follower catalog manager: success
I20260808 15:47:01.579849 15659 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84: acquiring CA information for follower catalog manager: success
I20260808 15:47:01.581439 15659 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 15:47:01.588865 15566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:01.589140 15566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:01.589241 15566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:01.593369 15566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:01.593458 15566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:01.593559 15566 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:47:01.599140 15566 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:41173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.65.keytab
--principal=oryx/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:39155
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=44879
--tserver_master_addrs=127.8.39.126:45971,127.8.39.125:38219,127.8.39.124:43751
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15566
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:01.600306 15566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:01.601397 15566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 15:47:01.611857 15566 server_base.cc:1034] running on GCE node
W20260808 15:47:01.611809 15665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:01.611815 15664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:01.611809 15667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:01.612540 15566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:01.613219 15566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:01.614403 15566 hybrid_clock.cc:648] HybridClock initialized: now 1786204021614374 us; error 47 us; skew 500 ppm
Aug 08 15:47:01 dist-test-slave-8tdl krb5kdc[14755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204021, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:47:01.617542 15566 init.cc:377] Logged in from keytab as oryx/127.8.39.65@KRBTEST.COM (short username oryx)
I20260808 15:47:01.618453 15566 webserver.cc:460] Webserver started at http://127.8.39.65:44879/ using document root <none> and password file <none>
I20260808 15:47:01.619123 15566 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:01.619238 15566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:01.623394 15566 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 15:47:01.625619 15674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:01.627007 15566 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:47:01.627149 15566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e"
format_stamp: "Formatted at 2026-08-08 15:47:00 on dist-test-slave-8tdl"
server_key: "1cda00611b20d640bf807d3032c7739c"
server_key_iv: "1a6f97e987c4299218a7bdf62e4dcdfa"
server_key_version: "encryptionkey@0"
I20260808 15:47:01.627703 15566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:01.640372 15566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:01.643637 15566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:01.643790 15566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:01.644307 15566 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:47:01.645166 15566 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:47:01.645239 15566 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:01.645313 15566 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:47:01.645356 15566 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:01.654886 15566 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:39155
I20260808 15:47:01.655022 15791 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:39155 every 8 connection(s)
I20260808 15:47:01.655916 15566 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:47:01.661458 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 15566
I20260808 15:47:01.661661 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 15000
Aug 08 15:47:01 dist-test-slave-8tdl krb5kdc[14755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204021, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM
I20260808 15:47:01.674053 14840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.658532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:37535 (local address 127.8.39.126:45971)
0808 15:47:01.658715 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:01.658720 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:01.659128 (+ 408us) server_negotiation.cc:407] Connection header received
0808 15:47:01.660384 (+ 1256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:01.660388 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:01.660451 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:01.660539 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:01.662175 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.663316 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.665048 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.665384 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.665466 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.669054 (+ 3588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:01.669058 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:01.669061 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:01.669095 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:01.670565 (+ 1470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.671580 (+ 1015us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.671587 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.671593 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.671716 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.672326 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.672333 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.672338 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.672632 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:01.672734 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:01.673571 (+ 837us) server_negotiation.cc:299] Negotiation successful
0808 15:47:01.673746 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 15:47:01.675177 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:38557
--local_ip_for_outbound_sockets=127.8.39.66
--tserver_master_addrs=127.8.39.126:45971
--webserver_port=37907
--webserver_interface=127.8.39.66
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.66.keytab
--principal=oryx/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:41173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.8.39.126:45971,127.8.39.125:38219
--tserver_master_addrs=127.8.39.126:45971,127.8.39.125:38219,127.8.39.124:43751 with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:47:01.676326 15798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.658267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.65:37535)
0808 15:47:01.658969 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:01.659022 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:01.660158 (+ 1136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:01.660714 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:01.660721 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:01.661186 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:01.661991 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.662013 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.663515 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.663522 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.664899 (+ 1377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.664913 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.665682 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.665687 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.665908 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.666748 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:01.666773 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:01.668809 (+ 2036us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:01.670768 (+ 1959us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.670783 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.670803 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.671425 (+ 622us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.671871 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.671874 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.671876 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.672188 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.672817 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:01.672828 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:01.673242 (+ 414us) client_negotiation.cc:769] Sending connection context
0808 15:47:01.674541 (+ 1299us) client_negotiation.cc:240] Negotiation successful
0808 15:47:01.675004 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"mutex_wait_us":72,"spinlock_wait_cycles":9856,"thread_start_us":146,"threads_started":1}
Aug 08 15:47:01 dist-test-slave-8tdl krb5kdc[14755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204021, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.124@KRBTEST.COM
Aug 08 15:47:01 dist-test-slave-8tdl krb5kdc[14755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204021, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.125@KRBTEST.COM
I20260808 15:47:01.678093 15793 heartbeater.cc:347] Connected to a master server at 127.8.39.126:45971
I20260808 15:47:01.678380 15793 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:01.679145 15793 heartbeater.cc:511] Master 127.8.39.126:45971 requested a full tablet report, sending...
I20260808 15:47:01.680629 14801 ts_manager.cc:194] Re-registered known tserver with Master: b0e5806c606e4b5ea2b6c9da30c5e73e (127.8.39.65:39155)
I20260808 15:47:01.681480 14801 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.39.65@KRBTEST.COM'} at 127.8.39.65:37535
I20260808 15:47:01.683226 15544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.658027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:60905 (local address 127.8.39.125:38219)
0808 15:47:01.658187 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:01.658192 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:01.659545 (+ 1353us) server_negotiation.cc:407] Connection header received
0808 15:47:01.660401 (+ 856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:01.660404 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:01.660474 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:01.660529 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:01.671634 (+ 11105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.672467 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.673712 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.674047 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.674123 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.677720 (+ 3597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:01.677726 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:01.677731 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:01.677767 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:01.680021 (+ 2254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.680601 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.680606 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.680608 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.680709 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.681960 (+ 1251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.681966 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.681970 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.682241 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:01.682341 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:01.682822 (+ 481us) server_negotiation.cc:299] Negotiation successful
0808 15:47:01.682990 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 15:47:01.683915 15799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.658267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:38219 (local address 127.8.39.65:60905)
0808 15:47:01.659439 (+ 1172us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:01.659453 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:01.660158 (+ 705us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:01.660716 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:01.660724 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:01.661174 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:01.671482 (+ 10308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.671489 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.672627 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.672630 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.673566 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.673575 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.674296 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.674299 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.674447 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.675523 (+ 1076us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:01.675538 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:01.677521 (+ 1983us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:01.680146 (+ 2625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.680153 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.680158 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.680456 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.681696 (+ 1240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.681701 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.681706 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.681816 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.682413 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:01.682418 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:01.682540 (+ 122us) client_negotiation.cc:769] Sending connection context
0808 15:47:01.683394 (+ 854us) client_negotiation.cc:240] Negotiation successful
0808 15:47:01.683584 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1088,"mutex_wait_us":9782,"spinlock_wait_cycles":8320,"thread_start_us":147,"threads_started":1}
I20260808 15:47:01.684383 15797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.658267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:43751 (local address 127.8.39.65:52859)
0808 15:47:01.659840 (+ 1573us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:01.659853 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:01.660164 (+ 311us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:01.660760 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:01.660762 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:01.661174 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:01.671456 (+ 10282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.671472 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.672884 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.672887 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.673728 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.673736 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.674480 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.674483 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.674571 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.675211 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:01.675231 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:01.680248 (+ 5017us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:01.682635 (+ 2387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.682639 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.682641 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.682934 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.683264 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.683267 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.683268 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.683350 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.683820 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:01.683822 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:01.683915 (+ 93us) client_negotiation.cc:769] Sending connection context
0808 15:47:01.684007 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 15:47:01.684177 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1493,"mutex_wait_us":9897,"spinlock_wait_cycles":2944,"thread_start_us":125,"threads_started":1}
I20260808 15:47:01.684791 15794 heartbeater.cc:347] Connected to a master server at 127.8.39.125:38219
I20260808 15:47:01.684900 15794 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:01.684954 15796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.658413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:52859 (local address 127.8.39.124:43751)
0808 15:47:01.659692 (+ 1279us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:01.659696 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:01.659932 (+ 236us) server_negotiation.cc:407] Connection header received
0808 15:47:01.660505 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:01.660509 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:01.660563 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:01.660646 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:01.671636 (+ 10990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.672731 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.673849 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.674222 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.674307 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.680417 (+ 6110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:01.680421 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:01.680423 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:01.680453 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:01.682490 (+ 2037us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.683059 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.683062 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.683064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.683158 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.683464 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.683467 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.683469 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.683685 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:01.683777 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:01.684666 (+ 889us) server_negotiation.cc:299] Negotiation successful
0808 15:47:01.684800 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1201,"thread_start_us":93,"threads_started":1}
I20260808 15:47:01.685228 15794 heartbeater.cc:511] Master 127.8.39.125:38219 requested a full tablet report, sending...
I20260808 15:47:01.685544 15792 heartbeater.cc:347] Connected to a master server at 127.8.39.124:43751
I20260808 15:47:01.685628 15792 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:01.685777 15792 heartbeater.cc:511] Master 127.8.39.124:43751 requested a full tablet report, sending...
I20260808 15:47:01.686367 15419 ts_manager.cc:194] Registered new tserver with Master: b0e5806c606e4b5ea2b6c9da30c5e73e (127.8.39.65:39155)
I20260808 15:47:01.687500 15607 ts_manager.cc:194] Registered new tserver with Master: b0e5806c606e4b5ea2b6c9da30c5e73e (127.8.39.65:39155)
I20260808 15:47:01.747234 15267 heartbeater.cc:503] Master 127.8.39.126:45971 was elected leader, sending a full tablet report...
W20260808 15:47:01.795821 15800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:01.796140 15800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:01.796227 15800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:01.800401 15800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:01.800513 15800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:01.800621 15800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:47:01.806197 15800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:41173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.66.keytab
--principal=oryx/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:38557
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=37907
--tserver_master_addrs=127.8.39.126:45971,127.8.39.125:38219,127.8.39.124:43751
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15800
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:01.807466 15800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:01.808537 15800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:01.818230 15808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:01.818233 15806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:01.818277 15805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:01.818404 15800 server_base.cc:1034] running on GCE node
I20260808 15:47:01.819115 15800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:01.819772 15800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:01.820942 15800 hybrid_clock.cc:648] HybridClock initialized: now 1786204021820926 us; error 33 us; skew 500 ppm
Aug 08 15:47:01 dist-test-slave-8tdl krb5kdc[14755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204021, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:47:01.824082 15800 init.cc:377] Logged in from keytab as oryx/127.8.39.66@KRBTEST.COM (short username oryx)
I20260808 15:47:01.824970 15800 webserver.cc:460] Webserver started at http://127.8.39.66:37907/ using document root <none> and password file <none>
I20260808 15:47:01.825517 15800 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:01.825594 15800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:01.829540 15800 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:47:01.831743 15815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:01.833230 15800 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:47:01.833374 15800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "0768475129944942a1a39ea968bfb1f9"
format_stamp: "Formatted at 2026-08-08 15:47:00 on dist-test-slave-8tdl"
server_key: "9ae922aa0af963408066baa747565f12"
server_key_iv: "eea1fa8c25bab61a11738596401a3fa8"
server_key_version: "encryptionkey@0"
I20260808 15:47:01.834009 15800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:01.875226 15800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:01.878947 15800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:01.879166 15800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:01.879812 15800 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:47:01.880719 15800 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:47:01.880793 15800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:01.880868 15800 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:47:01.880913 15800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:01.891378 15800 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:38557
I20260808 15:47:01.891449 15931 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:38557 every 8 connection(s)
I20260808 15:47:01.892449 15800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:47:01.894507 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 15800
I20260808 15:47:01.894731 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 15135
I20260808 15:47:01.903501 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:35371
--local_ip_for_outbound_sockets=127.8.39.67
--tserver_master_addrs=127.8.39.126:45971
--webserver_port=33981
--webserver_interface=127.8.39.67
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.67.keytab
--principal=oryx/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:41173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.8.39.126:45971,127.8.39.125:38219
--tserver_master_addrs=127.8.39.126:45971,127.8.39.125:38219,127.8.39.124:43751 with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 15:47:01 dist-test-slave-8tdl krb5kdc[14755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204021, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.124@KRBTEST.COM
Aug 08 15:47:01 dist-test-slave-8tdl krb5kdc[14755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204021, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM
Aug 08 15:47:01 dist-test-slave-8tdl krb5kdc[14755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204021, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.125@KRBTEST.COM
I20260808 15:47:01.912575 14840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.895084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:37639 (local address 127.8.39.126:45971)
0808 15:47:01.895284 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:01.895289 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:01.897887 (+ 2598us) server_negotiation.cc:407] Connection header received
0808 15:47:01.898068 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:01.898071 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:01.898123 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:01.898181 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:01.899700 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.900530 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.902636 (+ 2106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.903012 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.903093 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.907553 (+ 4460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:01.907557 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:01.907559 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:01.907609 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:01.909907 (+ 2298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.910570 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.910574 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.910576 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.910714 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.911149 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.911153 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.911155 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.911389 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:01.911470 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:01.912255 (+ 785us) server_negotiation.cc:299] Negotiation successful
0808 15:47:01.912402 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113}
I20260808 15:47:01.912575 15796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.894497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:50509 (local address 127.8.39.124:43751)
0808 15:47:01.896055 (+ 1558us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:01.896062 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:01.897827 (+ 1765us) server_negotiation.cc:407] Connection header received
0808 15:47:01.898058 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:01.898064 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:01.898130 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:01.898189 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:01.899701 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.900609 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.902644 (+ 2035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.903083 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.903165 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.907474 (+ 4309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:01.907480 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:01.907485 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:01.907518 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:01.909754 (+ 2236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.910570 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.910574 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.910576 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.910708 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.911149 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.911153 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.911155 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.911383 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:01.911471 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:01.912255 (+ 784us) server_negotiation.cc:299] Negotiation successful
0808 15:47:01.912402 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158}
I20260808 15:47:01.913059 15544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.894794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:33337 (local address 127.8.39.125:38219)
0808 15:47:01.895815 (+ 1021us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:01.895822 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:01.896495 (+ 673us) server_negotiation.cc:407] Connection header received
0808 15:47:01.897565 (+ 1070us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:01.897569 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:01.897633 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:01.897717 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:01.899699 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.900523 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.902635 (+ 2112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.903016 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.903093 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.908086 (+ 4993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:01.908092 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:01.908097 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:01.908133 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:01.910757 (+ 2624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.911355 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.911362 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.911366 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.911471 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:01.911833 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:01.911839 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:01.911856 (+ 17us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:01.912142 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:01.912240 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:01.912672 (+ 432us) server_negotiation.cc:299] Negotiation successful
0808 15:47:01.912814 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":909}
I20260808 15:47:01.914475 15938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.895354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:43751 (local address 127.8.39.66:50509)
0808 15:47:01.897722 (+ 2368us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:01.897739 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:01.897934 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:01.898357 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:01.898362 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:01.899201 (+ 839us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:01.899517 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.899540 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.900780 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.900786 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.902505 (+ 1719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.902517 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.903337 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.903342 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.903896 (+ 554us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.904554 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:01.904575 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:01.907215 (+ 2640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:01.909917 (+ 2702us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.909923 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.909942 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.910445 (+ 503us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.910824 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.910827 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.910829 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.911032 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.911546 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:01.911553 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:01.911949 (+ 396us) client_negotiation.cc:769] Sending connection context
0808 15:47:01.912951 (+ 1002us) client_negotiation.cc:240] Negotiation successful
0808 15:47:01.913327 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2279,"mutex_wait_us":792,"spinlock_wait_cycles":11776,"thread_start_us":128,"threads_started":1}
I20260808 15:47:01.914476 15936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.894817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:38219 (local address 127.8.39.66:33337)
0808 15:47:01.896317 (+ 1500us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:01.896364 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:01.897341 (+ 977us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:01.898037 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:01.898047 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:01.898759 (+ 712us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:01.899523 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.899539 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.900716 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.900719 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.902495 (+ 1776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.902501 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.903307 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.903311 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.903600 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.904717 (+ 1117us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:01.904737 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:01.907941 (+ 3204us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:01.910914 (+ 2973us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.910921 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.910925 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.911218 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.911604 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.911609 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.911614 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.911711 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.912309 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:01.912313 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:01.912431 (+ 118us) client_negotiation.cc:769] Sending connection context
0808 15:47:01.913668 (+ 1237us) client_negotiation.cc:240] Negotiation successful
0808 15:47:01.913868 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1232,"mutex_wait_us":413,"spinlock_wait_cycles":5888,"thread_start_us":147,"threads_started":1}
I20260808 15:47:01.915218 15937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:01.894817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.66:37639)
0808 15:47:01.897787 (+ 2970us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:01.897802 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:01.897956 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:01.898337 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:01.898340 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:01.898644 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:01.899519 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.899539 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.900716 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.900719 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.902487 (+ 1768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:01.902499 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:01.903307 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:01.903311 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:01.903605 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:01.904406 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:01.904442 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:01.907419 (+ 2977us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:01.910022 (+ 2603us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.910027 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.910031 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.910445 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.910824 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:01.910827 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:01.910829 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:01.911032 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:01.911546 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:01.911553 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:01.911949 (+ 396us) client_negotiation.cc:769] Sending connection context
0808 15:47:01.912817 (+ 868us) client_negotiation.cc:240] Negotiation successful
0808 15:47:01.913283 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2867,"mutex_wait_us":1533,"spinlock_wait_cycles":25344,"thread_start_us":98,"threads_started":1}
I20260808 15:47:01.916034 15932 heartbeater.cc:347] Connected to a master server at 127.8.39.124:43751
I20260808 15:47:01.916039 15934 heartbeater.cc:347] Connected to a master server at 127.8.39.125:38219
I20260808 15:47:01.916046 15933 heartbeater.cc:347] Connected to a master server at 127.8.39.126:45971
I20260808 15:47:01.916301 15933 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:01.916302 15934 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:01.916301 15932 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:01.916949 15934 heartbeater.cc:511] Master 127.8.39.125:38219 requested a full tablet report, sending...
I20260808 15:47:01.916957 15933 heartbeater.cc:511] Master 127.8.39.126:45971 requested a full tablet report, sending...
I20260808 15:47:01.916965 15932 heartbeater.cc:511] Master 127.8.39.124:43751 requested a full tablet report, sending...
I20260808 15:47:01.918160 14801 ts_manager.cc:194] Re-registered known tserver with Master: 0768475129944942a1a39ea968bfb1f9 (127.8.39.66:38557)
I20260808 15:47:01.918345 15419 ts_manager.cc:194] Registered new tserver with Master: 0768475129944942a1a39ea968bfb1f9 (127.8.39.66:38557)
I20260808 15:47:01.918418 15607 ts_manager.cc:194] Registered new tserver with Master: 0768475129944942a1a39ea968bfb1f9 (127.8.39.66:38557)
I20260808 15:47:01.919019 14801 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.39.66@KRBTEST.COM'} at 127.8.39.66:37639
W20260808 15:47:02.028604 15939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:02.028860 15939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:02.028905 15939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:02.033058 15939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:02.033128 15939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:02.033186 15939 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:47:02.038573 15939 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:41173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.67.keytab
--principal=oryx/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:35371
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=33981
--tserver_master_addrs=127.8.39.126:45971,127.8.39.125:38219,127.8.39.124:43751
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15939
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:02.039667 15939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:02.040705 15939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:02.051237 15945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:02.051258 15947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:02.051254 15944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:02.051527 15939 server_base.cc:1034] running on GCE node
I20260808 15:47:02.052385 15939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:02.053037 15939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:02.054251 15939 hybrid_clock.cc:648] HybridClock initialized: now 1786204022054226 us; error 39 us; skew 500 ppm
Aug 08 15:47:02 dist-test-slave-8tdl krb5kdc[14755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204022, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:47:02.057389 15939 init.cc:377] Logged in from keytab as oryx/127.8.39.67@KRBTEST.COM (short username oryx)
I20260808 15:47:02.058350 15939 webserver.cc:460] Webserver started at http://127.8.39.67:33981/ using document root <none> and password file <none>
I20260808 15:47:02.058990 15939 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:02.059110 15939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:02.063261 15939 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:47:02.065635 15954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:02.067092 15939 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:47:02.067296 15939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "efef22d6e3874f02a4e6253d7ec88ac3"
format_stamp: "Formatted at 2026-08-08 15:47:00 on dist-test-slave-8tdl"
server_key: "b8ec7b2c1b37e56452c16453b95247eb"
server_key_iv: "6ebd47e7153331563f80ea004cd9593c"
server_key_version: "encryptionkey@0"
I20260808 15:47:02.067999 15939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:02.084228 15939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:02.087332 15939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:02.087538 15939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:02.088172 15939 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:47:02.089059 15939 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:47:02.089131 15939 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:02.089229 15939 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:47:02.089282 15939 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:02.099197 15939 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:35371
I20260808 15:47:02.099231 16071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:35371 every 8 connection(s)
I20260808 15:47:02.100234 15939 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:47:02.102780 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 15939
I20260808 15:47:02.104900 15796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:02.098526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45104 (local address 127.8.39.124:43751)
0808 15:47:02.098694 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:02.098700 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:02.098780 (+ 80us) server_negotiation.cc:407] Connection header received
0808 15:47:02.099047 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:02.099050 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:02.099128 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:02.099256 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:47:02.099530 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.100069 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.101453 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.101987 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.102075 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:02.102225 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:02.104677 (+ 2452us) server_negotiation.cc:299] Negotiation successful
0808 15:47:02.104771 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 15:47:02.105422 16066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:02.098380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:43751 (local address 127.0.0.1:45104)
0808 15:47:02.098692 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:02.098711 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:02.098847 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:02.099271 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:02.099274 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:02.099295 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:47:02.099419 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:02.099427 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.100193 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.100196 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:02.101302 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:02.101314 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.104398 (+ 3084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.104402 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:02.104519 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:02.104545 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 15:47:02.105175 (+ 630us) client_negotiation.cc:240] Negotiation successful
0808 15:47:02.105282 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":73,"threads_started":1}
I20260808 15:47:02.106102 15617 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
Aug 08 15:47:02 dist-test-slave-8tdl krb5kdc[14755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204022, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.125@KRBTEST.COM
Aug 08 15:47:02 dist-test-slave-8tdl krb5kdc[14755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204022, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.124@KRBTEST.COM
I20260808 15:47:02.119314 16085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:02.106403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36852 (local address 127.8.39.126:45971)
0808 15:47:02.108615 (+ 2212us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:02.108619 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:02.108631 (+ 12us) server_negotiation.cc:407] Connection header received
0808 15:47:02.108668 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:02.108673 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:02.108723 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:02.108807 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:02.109796 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.110590 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.111779 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.112145 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.112265 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:02.114365 (+ 2100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:02.114369 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:02.114371 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:02.114398 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:02.116739 (+ 2341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:02.117272 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:02.117276 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:02.117278 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:02.117368 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:02.117691 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:02.117695 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:02.117697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:02.117929 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:02.118071 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:02.118956 (+ 885us) server_negotiation.cc:299] Negotiation successful
0808 15:47:02.119110 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2129,"thread_start_us":68,"threads_started":1}
I20260808 15:47:02.119923 15544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:02.102049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:52253 (local address 127.8.39.125:38219)
0808 15:47:02.102225 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:02.102232 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:02.105822 (+ 3590us) server_negotiation.cc:407] Connection header received
0808 15:47:02.106026 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:02.106030 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:02.106101 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:02.106183 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:02.107651 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.108417 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.110346 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.110727 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.110793 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:02.115044 (+ 4251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:02.115049 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:02.115052 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:02.115079 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:02.117366 (+ 2287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:02.117868 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:02.117871 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:02.117873 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:02.117957 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:02.118766 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:02.118770 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:02.118771 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:02.118986 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:02.119073 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:02.119414 (+ 341us) server_negotiation.cc:299] Negotiation successful
0808 15:47:02.119545 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":63}
I20260808 15:47:02.119957 15796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:02.104161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:35421 (local address 127.8.39.124:43751)
0808 15:47:02.105076 (+ 915us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:02.105080 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:02.105094 (+ 14us) server_negotiation.cc:407] Connection header received
0808 15:47:02.105559 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:02.105564 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:02.105616 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:02.105740 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:02.107647 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.108417 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.110345 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.110707 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.110788 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:02.115043 (+ 4255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:02.115049 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:02.115053 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:02.115081 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:02.117042 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:02.117664 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:02.117670 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:02.117675 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:02.117759 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:02.118223 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:02.118229 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:02.118231 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:02.118454 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:02.118530 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:02.119238 (+ 708us) server_negotiation.cc:299] Negotiation successful
0808 15:47:02.119786 (+ 548us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":859,"thread_start_us":79,"threads_started":1}
I20260808 15:47:02.120826 16076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:02.103098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:43751 (local address 127.8.39.67:35421)
0808 15:47:02.104240 (+ 1142us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:02.104310 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:02.105321 (+ 1011us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:02.105920 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:02.105926 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:02.106618 (+ 692us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:02.107481 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:02.107501 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.108603 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.108606 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:02.110204 (+ 1598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:02.110215 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.110988 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.110991 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:02.111217 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:02.112411 (+ 1194us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:02.112422 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:02.114842 (+ 2420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:02.117171 (+ 2329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:02.117177 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:02.117192 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:02.117552 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:02.117880 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:02.117886 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:02.117890 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:02.118086 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:02.118615 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:02.118621 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:02.118951 (+ 330us) client_negotiation.cc:769] Sending connection context
0808 15:47:02.119409 (+ 458us) client_negotiation.cc:240] Negotiation successful
0808 15:47:02.119779 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":945,"mutex_wait_us":303,"thread_start_us":142,"threads_started":1}
I20260808 15:47:02.122004 16072 heartbeater.cc:347] Connected to a master server at 127.8.39.124:43751
I20260808 15:47:02.122237 16072 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:02.122242 16078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:02.103098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:38219 (local address 127.8.39.67:52253)
0808 15:47:02.105733 (+ 2635us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:02.105748 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:02.105895 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:02.106341 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:02.106344 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:02.106618 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:02.107484 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:02.107501 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.108603 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.108606 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:02.110204 (+ 1598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:02.110215 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.110981 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.110986 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:02.111842 (+ 856us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:02.112375 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:02.112396 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:02.114861 (+ 2465us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:02.117493 (+ 2632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:02.117495 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:02.117497 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:02.117755 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:02.118070 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:02.118073 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:02.118075 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:02.118165 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:02.119134 (+ 969us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:02.119136 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:02.119222 (+ 86us) client_negotiation.cc:769] Sending connection context
0808 15:47:02.120168 (+ 946us) client_negotiation.cc:240] Negotiation successful
0808 15:47:02.121851 (+ 1683us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2547,"mutex_wait_us":593,"spinlock_wait_cycles":11520,"thread_start_us":134,"threads_started":1}
I20260808 15:47:02.122881 16072 heartbeater.cc:511] Master 127.8.39.124:43751 requested a full tablet report, sending...
Aug 08 15:47:02 dist-test-slave-8tdl krb5kdc[14755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204022, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM
I20260808 15:47:02.124320 15607 ts_manager.cc:194] Registered new tserver with Master: efef22d6e3874f02a4e6253d7ec88ac3 (127.8.39.67:35371)
I20260808 15:47:02.123359 14801 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36852:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 15:47:02.126204 16074 heartbeater.cc:347] Connected to a master server at 127.8.39.125:38219
I20260808 15:47:02.126305 16074 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:02.126368 16084 sys_catalog.cc:455] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee802f092ae04c278f521f27230e7f5f. Latest consensus state: current_term: 1 leader_uuid: "ee802f092ae04c278f521f27230e7f5f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: NON_VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: true } } }
I20260808 15:47:02.126477 16074 heartbeater.cc:511] Master 127.8.39.125:38219 requested a full tablet report, sending...
I20260808 15:47:02.127027 16084 sys_catalog.cc:458] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [sys.catalog]: This master's current role is: LEARNER
I20260808 15:47:02.127208 15419 ts_manager.cc:194] Registered new tserver with Master: efef22d6e3874f02a4e6253d7ec88ac3 (127.8.39.67:35371)
I20260808 15:47:02.127594 16086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:02.107024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46678 (local address 127.8.39.125:38219)
0808 15:47:02.109045 (+ 2021us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:02.109051 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:02.109064 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:47:02.109104 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:02.109108 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:02.109160 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:02.110058 (+ 898us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:02.110154 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.111327 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.112549 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.112980 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.115868 (+ 2888us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:02.116015 (+ 147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:02.116018 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:02.116021 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:02.116041 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:02.122357 (+ 6316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:02.124542 (+ 2185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:02.124546 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:02.124547 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:02.124644 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:02.125681 (+ 1037us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:02.125685 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:02.125686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:02.125949 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:02.126100 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:02.127261 (+ 1161us) server_negotiation.cc:299] Negotiation successful
0808 15:47:02.127407 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":415,"server-negotiator.queue_time_us":1940,"thread_start_us":67,"threads_started":1}
W20260808 15:47:02.127916 14801 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:47:02.131111 15369 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ee802f092ae04c278f521f27230e7f5f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: NON_VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: true } } }
I20260808 15:47:02.131254 15369 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [sys.catalog]: This master's current role is: LEADER
I20260808 15:47:02.131834 16083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:02.108157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45116 (local address 127.8.39.124:43751)
0808 15:47:02.117511 (+ 9354us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:02.117515 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:02.117528 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:47:02.117562 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:02.117564 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:02.117619 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:02.117703 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:02.118532 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.120954 (+ 2422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.125216 (+ 4262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.125452 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.125567 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:02.127662 (+ 2095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:02.127669 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:02.127675 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:02.127703 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:02.129343 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:02.129838 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:02.129842 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:02.129844 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:02.129933 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:02.130299 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:02.130314 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:02.130317 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:02.130571 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:02.131479 (+ 908us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:02.131560 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 15:47:02.131692 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9274}
I20260808 15:47:02.135776 14840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:02.102562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:55615 (local address 127.8.39.126:45971)
0808 15:47:02.102809 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:02.102814 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:02.111030 (+ 8216us) server_negotiation.cc:407] Connection header received
0808 15:47:02.111209 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:02.111212 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:02.111253 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:02.111302 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:02.113919 (+ 2617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.114762 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.118763 (+ 4001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.119076 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.119159 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:02.128508 (+ 9349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:02.128515 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:02.128522 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:02.128555 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:02.130238 (+ 1683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:02.134261 (+ 4023us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:02.134264 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:02.134266 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:02.134370 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:02.134761 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:02.134765 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:02.134767 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:02.135038 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:02.135135 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:02.135518 (+ 383us) server_negotiation.cc:299] Negotiation successful
0808 15:47:02.135630 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176}
I20260808 15:47:02.136242 16077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:02.103098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.67:55615)
0808 15:47:02.110864 (+ 7766us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:02.110878 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:02.111100 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:02.112381 (+ 1281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:02.112384 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:02.113178 (+ 794us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:02.113348 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:02.113357 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.116378 (+ 3021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.116381 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:02.117280 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:02.117289 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.119442 (+ 2153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.119446 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:02.119534 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:02.122871 (+ 3337us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:02.122883 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:02.126904 (+ 4021us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:02.130388 (+ 3484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:02.130391 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:02.130393 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:02.134132 (+ 3739us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:02.134494 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:02.134498 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:02.134500 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:02.134599 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:02.135186 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:02.135190 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:02.135320 (+ 130us) client_negotiation.cc:769] Sending connection context
0808 15:47:02.135452 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 15:47:02.135639 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7673,"mutex_wait_us":139,"spinlock_wait_cycles":1408,"thread_start_us":138,"threads_started":1}
I20260808 15:47:02.136840 16073 heartbeater.cc:347] Connected to a master server at 127.8.39.126:45971
I20260808 15:47:02.136936 16073 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:02.137039 15369 raft_consensus.cc:1050] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f: attempting to promote NON_VOTER 482e9fc7985b4da09a1f6fe5e5f6dd84 to VOTER
I20260808 15:47:02.137140 16073 heartbeater.cc:511] Master 127.8.39.126:45971 requested a full tablet report, sending...
I20260808 15:47:02.137436 15369 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: false } }
I20260808 15:47:02.138572 14800 ts_manager.cc:194] Re-registered known tserver with Master: efef22d6e3874f02a4e6253d7ec88ac3 (127.8.39.67:35371)
I20260808 15:47:02.138648 15617 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 1 LEARNER]: Refusing update from remote peer ee802f092ae04c278f521f27230e7f5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260808 15:47:02.139223 15428 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 1 FOLLOWER]: Refusing update from remote peer ee802f092ae04c278f521f27230e7f5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260808 15:47:02.139331 14800 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.39.67@KRBTEST.COM'} at 127.8.39.67:55615
I20260808 15:47:02.139453 16092 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 15:47:02.139647 16091 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 15:47:02.141381 16091 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 7 to 10, 482e9fc7985b4da09a1f6fe5e5f6dd84 (127.8.39.124) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: false } } }
I20260808 15:47:02.141801 15428 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 7 to 10, 482e9fc7985b4da09a1f6fe5e5f6dd84 (127.8.39.124) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: false } } }
I20260808 15:47:02.143010 16091 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "ee802f092ae04c278f521f27230e7f5f" committed_config { opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: false } } }
I20260808 15:47:02.143141 16091 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [sys.catalog]: This master's current role is: LEADER
I20260808 15:47:02.143276 16091 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ee802f092ae04c278f521f27230e7f5f" committed_config { opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: false } } }
I20260808 15:47:02.143370 16091 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [sys.catalog]: This master's current role is: LEADER
I20260808 15:47:02.143596 16100 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ee802f092ae04c278f521f27230e7f5f" committed_config { opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: false } } }
I20260808 15:47:02.143724 16100 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:47:02.145922 15369 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ee802f092ae04c278f521f27230e7f5f" committed_config { opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: false } } }
I20260808 15:47:02.146031 15369 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f [sys.catalog]: This master's current role is: LEADER
I20260808 15:47:02.146513 15617 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 7 to 10, 482e9fc7985b4da09a1f6fe5e5f6dd84 (127.8.39.124) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: false } } }
I20260808 15:47:02.148499 16084 sys_catalog.cc:455] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ee802f092ae04c278f521f27230e7f5f" committed_config { opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: false } } }
I20260808 15:47:02.148627 16084 sys_catalog.cc:458] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:47:02.150074 16066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:02.144490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:35371 (local address 127.0.0.1:56828)
0808 15:47:02.144643 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:02.144659 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:02.144742 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:02.145458 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:02.145462 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:02.145478 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:47:02.145573 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:02.145581 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.146983 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.146986 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:02.147886 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:02.147895 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.149775 (+ 1880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.149778 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:02.149850 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:02.149870 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 15:47:02.149915 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 15:47:02.149976 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 15:47:02.150192 16101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:02.144685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56828 (local address 127.8.39.67:35371)
0808 15:47:02.144984 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:02.144996 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:02.145019 (+ 23us) server_negotiation.cc:407] Connection header received
0808 15:47:02.145094 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:02.145100 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:02.145321 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:02.145501 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:47:02.145667 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.146881 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.149046 (+ 2165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.149624 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.149756 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:02.149899 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:02.149962 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 15:47:02.150051 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":123,"threads_started":1}
I20260808 15:47:02.152546 16102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:02.144860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:39155 (local address 127.0.0.1:60466)
0808 15:47:02.145140 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:02.145154 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:02.145233 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:02.148220 (+ 2987us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:02.148223 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:02.148242 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:47:02.148324 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:02.148329 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.149712 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.149719 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:02.150874 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:02.150885 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.152143 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.152147 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:02.152236 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:02.152267 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 15:47:02.152344 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 15:47:02.152412 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"mutex_wait_us":1,"thread_start_us":126,"threads_started":1}
I20260808 15:47:02.152928 16103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:02.145270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60466 (local address 127.8.39.65:39155)
0808 15:47:02.147759 (+ 2489us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:02.147774 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:02.147797 (+ 23us) server_negotiation.cc:407] Connection header received
0808 15:47:02.147866 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:02.147871 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:02.148072 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:02.148233 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:47:02.148828 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.149595 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.151028 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.151817 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.151927 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:02.152072 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:02.152400 (+ 328us) server_negotiation.cc:299] Negotiation successful
0808 15:47:02.152492 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2388,"thread_start_us":110,"threads_started":1}
I20260808 15:47:02.153434 16104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:02.145488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:38557 (local address 127.0.0.1:47552)
0808 15:47:02.145705 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:02.145720 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:02.145810 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:02.147499 (+ 1689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:02.147503 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:02.147521 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:47:02.147603 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:02.147608 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.150815 (+ 3207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.150818 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:02.152011 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:02.152023 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.153047 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.153051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:02.153133 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:02.153154 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 15:47:02.153239 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 15:47:02.153310 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":31,"thread_start_us":95,"threads_started":1}
I20260808 15:47:02.153492 16105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:02.145963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47552 (local address 127.8.39.66:38557)
0808 15:47:02.147026 (+ 1063us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:02.147043 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:02.147069 (+ 26us) server_negotiation.cc:407] Connection header received
0808 15:47:02.147146 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:02.147154 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:02.147342 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:02.147496 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:47:02.147737 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.148935 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.152154 (+ 3219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.152918 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.153046 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:02.153171 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:02.153263 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 15:47:02.153343 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":125,"threads_started":1}
I20260808 15:47:02.153240 16002 tablet_service.cc:1467] Processing CreateTablet for tablet 60107f16a53349868051af8b70ff4a3e (DEFAULT_TABLE table=test-table [id=43c14f746d084ad0a3c57e21cec9cfed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:47:02.154495 16002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60107f16a53349868051af8b70ff4a3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:02.155779 15722 tablet_service.cc:1467] Processing CreateTablet for tablet 60107f16a53349868051af8b70ff4a3e (DEFAULT_TABLE table=test-table [id=43c14f746d084ad0a3c57e21cec9cfed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:47:02.156291 15864 tablet_service.cc:1467] Processing CreateTablet for tablet 60107f16a53349868051af8b70ff4a3e (DEFAULT_TABLE table=test-table [id=43c14f746d084ad0a3c57e21cec9cfed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:47:02.156782 15722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60107f16a53349868051af8b70ff4a3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:02.157188 15864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60107f16a53349868051af8b70ff4a3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:02.163590 16107 tablet_bootstrap.cc:492] T 60107f16a53349868051af8b70ff4a3e P b0e5806c606e4b5ea2b6c9da30c5e73e: Bootstrap starting.
I20260808 15:47:02.165331 16108 tablet_bootstrap.cc:492] T 60107f16a53349868051af8b70ff4a3e P 0768475129944942a1a39ea968bfb1f9: Bootstrap starting.
I20260808 15:47:02.165548 16107 tablet_bootstrap.cc:654] T 60107f16a53349868051af8b70ff4a3e P b0e5806c606e4b5ea2b6c9da30c5e73e: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:02.165902 16106 tablet_bootstrap.cc:492] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3: Bootstrap starting.
I20260808 15:47:02.166432 16107 log.cc:824] T 60107f16a53349868051af8b70ff4a3e P b0e5806c606e4b5ea2b6c9da30c5e73e: Log is configured to *not* fsync() on all Append() calls
I20260808 15:47:02.167654 16108 tablet_bootstrap.cc:654] T 60107f16a53349868051af8b70ff4a3e P 0768475129944942a1a39ea968bfb1f9: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:02.167914 16106 tablet_bootstrap.cc:654] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:02.168531 16108 log.cc:824] T 60107f16a53349868051af8b70ff4a3e P 0768475129944942a1a39ea968bfb1f9: Log is configured to *not* fsync() on all Append() calls
I20260808 15:47:02.168684 16106 log.cc:824] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3: Log is configured to *not* fsync() on all Append() calls
I20260808 15:47:02.168871 16107 tablet_bootstrap.cc:492] T 60107f16a53349868051af8b70ff4a3e P b0e5806c606e4b5ea2b6c9da30c5e73e: No bootstrap required, opened a new log
I20260808 15:47:02.169082 16107 ts_tablet_manager.cc:1397] T 60107f16a53349868051af8b70ff4a3e P b0e5806c606e4b5ea2b6c9da30c5e73e: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 15:47:02.170440 16108 tablet_bootstrap.cc:492] T 60107f16a53349868051af8b70ff4a3e P 0768475129944942a1a39ea968bfb1f9: No bootstrap required, opened a new log
I20260808 15:47:02.170636 16108 ts_tablet_manager.cc:1397] T 60107f16a53349868051af8b70ff4a3e P 0768475129944942a1a39ea968bfb1f9: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 15:47:02.173086 16107 raft_consensus.cc:348] T 60107f16a53349868051af8b70ff4a3e P b0e5806c606e4b5ea2b6c9da30c5e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35371 } } peers { permanent_uuid: "0768475129944942a1a39ea968bfb1f9" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38557 } } peers { permanent_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39155 } }
I20260808 15:47:02.173350 16107 raft_consensus.cc:374] T 60107f16a53349868051af8b70ff4a3e P b0e5806c606e4b5ea2b6c9da30c5e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:02.173416 16107 raft_consensus.cc:729] T 60107f16a53349868051af8b70ff4a3e P b0e5806c606e4b5ea2b6c9da30c5e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0e5806c606e4b5ea2b6c9da30c5e73e, State: Initialized, Role: FOLLOWER
I20260808 15:47:02.173869 16107 consensus_queue.cc:260] T 60107f16a53349868051af8b70ff4a3e P b0e5806c606e4b5ea2b6c9da30c5e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35371 } } peers { permanent_uuid: "0768475129944942a1a39ea968bfb1f9" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38557 } } peers { permanent_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39155 } }
I20260808 15:47:02.174490 15793 heartbeater.cc:503] Master 127.8.39.126:45971 was elected leader, sending a full tablet report...
I20260808 15:47:02.174626 16108 raft_consensus.cc:348] T 60107f16a53349868051af8b70ff4a3e P 0768475129944942a1a39ea968bfb1f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35371 } } peers { permanent_uuid: "0768475129944942a1a39ea968bfb1f9" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38557 } } peers { permanent_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39155 } }
I20260808 15:47:02.174893 16108 raft_consensus.cc:374] T 60107f16a53349868051af8b70ff4a3e P 0768475129944942a1a39ea968bfb1f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:02.174953 16108 raft_consensus.cc:729] T 60107f16a53349868051af8b70ff4a3e P 0768475129944942a1a39ea968bfb1f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0768475129944942a1a39ea968bfb1f9, State: Initialized, Role: FOLLOWER
I20260808 15:47:02.175274 16107 ts_tablet_manager.cc:1428] T 60107f16a53349868051af8b70ff4a3e P b0e5806c606e4b5ea2b6c9da30c5e73e: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 15:47:02.175376 16108 consensus_queue.cc:260] T 60107f16a53349868051af8b70ff4a3e P 0768475129944942a1a39ea968bfb1f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35371 } } peers { permanent_uuid: "0768475129944942a1a39ea968bfb1f9" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38557 } } peers { permanent_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39155 } }
I20260808 15:47:02.176350 16108 ts_tablet_manager.cc:1428] T 60107f16a53349868051af8b70ff4a3e P 0768475129944942a1a39ea968bfb1f9: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20260808 15:47:02.178371 15933 heartbeater.cc:503] Master 127.8.39.126:45971 was elected leader, sending a full tablet report...
I20260808 15:47:02.181314 16106 tablet_bootstrap.cc:492] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3: No bootstrap required, opened a new log
I20260808 15:47:02.181540 16106 ts_tablet_manager.cc:1397] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.003s
I20260808 15:47:02.185083 16106 raft_consensus.cc:348] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35371 } } peers { permanent_uuid: "0768475129944942a1a39ea968bfb1f9" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38557 } } peers { permanent_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39155 } }
I20260808 15:47:02.185314 16106 raft_consensus.cc:374] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:02.185402 16106 raft_consensus.cc:729] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efef22d6e3874f02a4e6253d7ec88ac3, State: Initialized, Role: FOLLOWER
I20260808 15:47:02.185878 16106 consensus_queue.cc:260] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35371 } } peers { permanent_uuid: "0768475129944942a1a39ea968bfb1f9" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38557 } } peers { permanent_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39155 } }
I20260808 15:47:02.186895 16106 ts_tablet_manager.cc:1428] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3: Time spent starting tablet: real 0.005s user 0.005s sys 0.002s
I20260808 15:47:02.187054 16073 heartbeater.cc:503] Master 127.8.39.126:45971 was elected leader, sending a full tablet report...
I20260808 15:47:02.231243 16114 raft_consensus.cc:482] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:47:02.231478 16114 raft_consensus.cc:504] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35371 } } peers { permanent_uuid: "0768475129944942a1a39ea968bfb1f9" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38557 } } peers { permanent_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39155 } }
I20260808 15:47:02.232688 16114 leader_election.cc:288] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0768475129944942a1a39ea968bfb1f9 (127.8.39.66:38557), b0e5806c606e4b5ea2b6c9da30c5e73e (127.8.39.65:39155)
I20260808 15:47:02.238245 16105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:02.233152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:40917 (local address 127.8.39.66:38557)
0808 15:47:02.233313 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:02.233319 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:02.233445 (+ 126us) server_negotiation.cc:407] Connection header received
0808 15:47:02.233534 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:02.233537 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:02.233598 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:02.233684 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:47:02.234060 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.234953 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.236851 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.237494 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.237619 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:02.237691 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:02.238016 (+ 325us) server_negotiation.cc:299] Negotiation successful
0808 15:47:02.238107 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 15:47:02.238238 16078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:02.233007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:38557 (local address 127.8.39.67:40917)
0808 15:47:02.233356 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:02.233370 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:02.233448 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:02.233694 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:02.233696 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:02.233708 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:47:02.233898 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:02.233905 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.235057 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.235061 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:02.236693 (+ 1632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:02.236705 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.237626 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.237630 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:02.237772 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:02.237898 (+ 126us) client_negotiation.cc:769] Sending connection context
0808 15:47:02.237984 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 15:47:02.238071 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"mutex_wait_us":509}
I20260808 15:47:02.238245 16077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:02.232989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:39155 (local address 127.8.39.67:48311)
0808 15:47:02.233175 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:02.233193 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:02.233291 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:02.233671 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:02.233675 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:02.233694 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:47:02.233898 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:02.233905 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.235057 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.235061 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:02.236693 (+ 1632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:02.236705 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.237626 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.237630 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:02.237888 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:02.237931 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 15:47:02.238025 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 15:47:02.238076 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85,"mutex_wait_us":261}
I20260808 15:47:02.238325 16103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:02.233086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:48311 (local address 127.8.39.65:39155)
0808 15:47:02.233207 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:02.233214 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:02.233234 (+ 20us) server_negotiation.cc:407] Connection header received
0808 15:47:02.233459 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:02.233466 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:02.233539 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:02.233638 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:47:02.234061 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.234924 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.236841 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.237492 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.237610 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:02.237738 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:02.238126 (+ 388us) server_negotiation.cc:299] Negotiation successful
0808 15:47:02.238203 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 15:47:02.239058 15886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60107f16a53349868051af8b70ff4a3e" candidate_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0768475129944942a1a39ea968bfb1f9" is_pre_election: true
I20260808 15:47:02.239130 15744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60107f16a53349868051af8b70ff4a3e" candidate_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" is_pre_election: true
I20260808 15:47:02.239419 15886 raft_consensus.cc:2454] T 60107f16a53349868051af8b70ff4a3e P 0768475129944942a1a39ea968bfb1f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efef22d6e3874f02a4e6253d7ec88ac3 in term 0.
I20260808 15:47:02.239435 15744 raft_consensus.cc:2454] T 60107f16a53349868051af8b70ff4a3e P b0e5806c606e4b5ea2b6c9da30c5e73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efef22d6e3874f02a4e6253d7ec88ac3 in term 0.
I20260808 15:47:02.239952 15958 leader_election.cc:302] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0768475129944942a1a39ea968bfb1f9, b0e5806c606e4b5ea2b6c9da30c5e73e, efef22d6e3874f02a4e6253d7ec88ac3; no voters:
I20260808 15:47:02.240259 16114 raft_consensus.cc:2781] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:47:02.240345 16114 raft_consensus.cc:482] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:47:02.240389 16114 raft_consensus.cc:3037] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:02.241597 16114 raft_consensus.cc:504] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35371 } } peers { permanent_uuid: "0768475129944942a1a39ea968bfb1f9" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38557 } } peers { permanent_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39155 } }
I20260808 15:47:02.241966 16114 leader_election.cc:288] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3 [CANDIDATE]: Term 1 election: Requested vote from peers 0768475129944942a1a39ea968bfb1f9 (127.8.39.66:38557), b0e5806c606e4b5ea2b6c9da30c5e73e (127.8.39.65:39155)
I20260808 15:47:02.242296 15886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60107f16a53349868051af8b70ff4a3e" candidate_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0768475129944942a1a39ea968bfb1f9"
I20260808 15:47:02.242379 15744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60107f16a53349868051af8b70ff4a3e" candidate_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e"
I20260808 15:47:02.242430 15886 raft_consensus.cc:3037] T 60107f16a53349868051af8b70ff4a3e P 0768475129944942a1a39ea968bfb1f9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:02.242548 15744 raft_consensus.cc:3037] T 60107f16a53349868051af8b70ff4a3e P b0e5806c606e4b5ea2b6c9da30c5e73e [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:02.243659 15744 raft_consensus.cc:2454] T 60107f16a53349868051af8b70ff4a3e P b0e5806c606e4b5ea2b6c9da30c5e73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efef22d6e3874f02a4e6253d7ec88ac3 in term 1.
I20260808 15:47:02.243664 15886 raft_consensus.cc:2454] T 60107f16a53349868051af8b70ff4a3e P 0768475129944942a1a39ea968bfb1f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efef22d6e3874f02a4e6253d7ec88ac3 in term 1.
I20260808 15:47:02.243968 15956 leader_election.cc:302] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0768475129944942a1a39ea968bfb1f9, b0e5806c606e4b5ea2b6c9da30c5e73e, efef22d6e3874f02a4e6253d7ec88ac3; no voters:
I20260808 15:47:02.244181 16114 raft_consensus.cc:2781] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:47:02.244380 16114 raft_consensus.cc:686] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3 [term 1 LEADER]: Becoming Leader. State: Replica: efef22d6e3874f02a4e6253d7ec88ac3, State: Running, Role: LEADER
I20260808 15:47:02.244908 16114 consensus_queue.cc:237] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35371 } } peers { permanent_uuid: "0768475129944942a1a39ea968bfb1f9" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38557 } } peers { permanent_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39155 } }
I20260808 15:47:02.248298 14801 catalog_manager.cc:5495] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3 reported cstate change: term changed from 0 to 1, leader changed from <none> to efef22d6e3874f02a4e6253d7ec88ac3 (127.8.39.67). New cstate: current_term: 1 leader_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0768475129944942a1a39ea968bfb1f9" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260808 15:47:02.281526 16101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:02.277631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56844 (local address 127.8.39.67:35371)
0808 15:47:02.277758 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:02.277762 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:02.277777 (+ 15us) server_negotiation.cc:407] Connection header received
0808 15:47:02.277933 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:02.277935 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:02.278000 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:02.278103 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:47:02.278382 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.279014 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.280011 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.280254 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.280346 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:02.280688 (+ 342us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:47:02.281148 (+ 460us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:47:02.281242 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:02.281342 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 15:47:02.281393 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 15:47:02.288004 15744 raft_consensus.cc:1261] T 60107f16a53349868051af8b70ff4a3e P b0e5806c606e4b5ea2b6c9da30c5e73e [term 1 FOLLOWER]: Refusing update from remote peer efef22d6e3874f02a4e6253d7ec88ac3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:47:02.288004 15886 raft_consensus.cc:1261] T 60107f16a53349868051af8b70ff4a3e P 0768475129944942a1a39ea968bfb1f9 [term 1 FOLLOWER]: Refusing update from remote peer efef22d6e3874f02a4e6253d7ec88ac3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:47:02.288805 16115 consensus_queue.cc:1035] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:47:02.289031 16114 consensus_queue.cc:1035] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0768475129944942a1a39ea968bfb1f9" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:47:02.302177 16119 mvcc.cc:205] Tried to move back new op lower bound from 7316291675284066304 to 7316291675117682688. Current Snapshot: MvccSnapshot[applied={T|T < 7316291675284066304}]
I20260808 15:47:02.310822 14801 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:47:02.310989 14801 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:47:02.315496 14801 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ee802f092ae04c278f521f27230e7f5f: Sending DeleteTablet for 3 replicas of tablet 60107f16a53349868051af8b70ff4a3e
I20260808 15:47:02.316777 15722 tablet_service.cc:1514] Processing DeleteTablet for tablet 60107f16a53349868051af8b70ff4a3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:47:02 UTC) from {username='oryx', principal='oryx/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:60466
I20260808 15:47:02.317013 16002 tablet_service.cc:1514] Processing DeleteTablet for tablet 60107f16a53349868051af8b70ff4a3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:47:02 UTC) from {username='oryx', principal='oryx/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:56828
I20260808 15:47:02.317456 16127 tablet_replica.cc:330] T 60107f16a53349868051af8b70ff4a3e P b0e5806c606e4b5ea2b6c9da30c5e73e: stopping tablet replica
I20260808 15:47:02.317456 16128 tablet_replica.cc:330] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3: stopping tablet replica
I20260808 15:47:02.317781 16127 raft_consensus.cc:2229] T 60107f16a53349868051af8b70ff4a3e P b0e5806c606e4b5ea2b6c9da30c5e73e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:47:02.317781 16128 raft_consensus.cc:2229] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:47:02.318113 16127 raft_consensus.cc:2258] T 60107f16a53349868051af8b70ff4a3e P b0e5806c606e4b5ea2b6c9da30c5e73e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:47:02.318148 16128 raft_consensus.cc:2258] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:47:02.320187 16128 ts_tablet_manager.cc:1905] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:47:02.320187 16127 ts_tablet_manager.cc:1905] T 60107f16a53349868051af8b70ff4a3e P b0e5806c606e4b5ea2b6c9da30c5e73e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:47:02.320228 15864 tablet_service.cc:1514] Processing DeleteTablet for tablet 60107f16a53349868051af8b70ff4a3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:47:02 UTC) from {username='oryx', principal='oryx/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:47552
I20260808 15:47:02.320678 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 14768
I20260808 15:47:02.324414 16128 ts_tablet_manager.cc:1918] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:47:02.324530 16128 log.cc:1196] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/60107f16a53349868051af8b70ff4a3e
I20260808 15:47:02.324870 16127 ts_tablet_manager.cc:1918] T 60107f16a53349868051af8b70ff4a3e P b0e5806c606e4b5ea2b6c9da30c5e73e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:47:02.324913 16128 ts_tablet_manager.cc:1939] T 60107f16a53349868051af8b70ff4a3e P efef22d6e3874f02a4e6253d7ec88ac3: Deleting consensus metadata
I20260808 15:47:02.324977 16127 log.cc:1196] T 60107f16a53349868051af8b70ff4a3e P b0e5806c606e4b5ea2b6c9da30c5e73e: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-0/wal/wals/60107f16a53349868051af8b70ff4a3e
I20260808 15:47:02.325284 16127 ts_tablet_manager.cc:1939] T 60107f16a53349868051af8b70ff4a3e P b0e5806c606e4b5ea2b6c9da30c5e73e: Deleting consensus metadata
I20260808 15:47:02.326931 16130 tablet_replica.cc:330] T 60107f16a53349868051af8b70ff4a3e P 0768475129944942a1a39ea968bfb1f9: stopping tablet replica
I20260808 15:47:02.327296 16130 raft_consensus.cc:2229] T 60107f16a53349868051af8b70ff4a3e P 0768475129944942a1a39ea968bfb1f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:47:02.327665 16130 raft_consensus.cc:2258] T 60107f16a53349868051af8b70ff4a3e P 0768475129944942a1a39ea968bfb1f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:47:02.329355 16130 ts_tablet_manager.cc:1905] T 60107f16a53349868051af8b70ff4a3e P 0768475129944942a1a39ea968bfb1f9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 15:47:02.332441 15676 connection.cc:535] server connection from 127.0.0.1:60466 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 15:47:02.332476 16130 ts_tablet_manager.cc:1918] T 60107f16a53349868051af8b70ff4a3e P 0768475129944942a1a39ea968bfb1f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:47:02.332576 16130 log.cc:1196] T 60107f16a53349868051af8b70ff4a3e P 0768475129944942a1a39ea968bfb1f9: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/wal/wals/60107f16a53349868051af8b70ff4a3e
W20260808 15:47:02.332837 15956 connection.cc:535] server connection from 127.0.0.1:56828 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 15:47:02.333029 16130 ts_tablet_manager.cc:1939] T 60107f16a53349868051af8b70ff4a3e P 0768475129944942a1a39ea968bfb1f9: Deleting consensus metadata
W20260808 15:47:02.334237 15817 connection.cc:441] server connection from 127.0.0.1:47552 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47552 (request call id 1) could send its response
I20260808 15:47:02.339102 16086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:02.318715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46686 (local address 127.8.39.125:38219)
0808 15:47:02.318845 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:02.318852 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:02.326939 (+ 8087us) server_negotiation.cc:407] Connection header received
0808 15:47:02.327232 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:02.327235 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:02.327289 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:02.327347 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:02.328593 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.329388 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.330638 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.331053 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.331141 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:02.333723 (+ 2582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:02.333727 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:02.333730 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:02.333759 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:02.335826 (+ 2067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:02.336391 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:02.336396 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:02.336401 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:02.336579 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:02.336915 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:02.336919 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:02.336920 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:02.337202 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:02.337338 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:02.338769 (+ 1431us) server_negotiation.cc:299] Negotiation successful
0808 15:47:02.338924 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 15:47:02.349282 15544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:02.336490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46688 (local address 127.8.39.125:38219)
0808 15:47:02.336615 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:02.336621 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:02.337471 (+ 850us) server_negotiation.cc:407] Connection header received
0808 15:47:02.337660 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:02.337663 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:02.337708 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:02.337762 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:02.339705 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.340416 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.341548 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.341855 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.341942 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:02.344375 (+ 2433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:02.344378 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:02.344381 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:02.344407 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:02.346858 (+ 2451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:02.347495 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:02.347500 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:02.347503 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:02.347655 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:02.348174 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:02.348177 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:02.348179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:02.348435 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:02.348569 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:02.348973 (+ 404us) server_negotiation.cc:299] Negotiation successful
0808 15:47:02.349108 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 15:47:02.349931 16083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:02.318521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45120 (local address 127.8.39.124:43751)
0808 15:47:02.318664 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:02.318670 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:02.338171 (+ 19501us) server_negotiation.cc:407] Connection header received
0808 15:47:02.338224 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:02.338229 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:02.338301 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:02.338393 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:02.339332 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.340154 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.341290 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.341647 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.341730 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:02.344371 (+ 2641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:02.344375 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:02.344387 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:02.344411 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:02.347341 (+ 2930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:02.348112 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:02.348116 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:02.348118 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:02.348272 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:02.348627 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:02.348631 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:02.348633 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:02.348896 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:02.349023 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:02.349625 (+ 602us) server_negotiation.cc:299] Negotiation successful
0808 15:47:02.349766 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 15:47:02.350157 15796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:02.337049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45136 (local address 127.8.39.124:43751)
0808 15:47:02.337177 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:02.337182 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:02.337840 (+ 658us) server_negotiation.cc:407] Connection header received
0808 15:47:02.338158 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:02.338162 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:02.338222 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:02.338281 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:02.340306 (+ 2025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.341148 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.342540 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:02.342925 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:02.343048 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:02.344798 (+ 1750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:02.344802 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:02.344807 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:02.344835 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:02.346875 (+ 2040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:02.348609 (+ 1734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:02.348613 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:02.348614 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:02.348721 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:02.349030 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:02.349033 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:02.349035 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:02.349230 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:02.349336 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:02.349736 (+ 400us) server_negotiation.cc:299] Negotiation successful
0808 15:47:02.349882 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 15:47:03.304388 16139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:03.303858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.65:45573)
0808 15:47:03.304233 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:03.304309 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":101,"threads_started":1}
I20260808 15:47:03.304382 16138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:03.303857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.66:35343)
0808 15:47:03.304164 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:03.304265 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":87,"threads_started":1}
W20260808 15:47:03.305032 15793 heartbeater.cc:644] Failed to heartbeat to 127.8.39.126:45971 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
W20260808 15:47:03.305032 15933 heartbeater.cc:644] Failed to heartbeat to 127.8.39.126:45971 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
I20260808 15:47:03.306860 16140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:03.306354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.67:56379)
0808 15:47:03.306603 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:03.306754 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":98,"threads_started":1}
W20260808 15:47:03.307132 16073 heartbeater.cc:644] Failed to heartbeat to 127.8.39.126:45971 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
I20260808 15:47:03.816699 16141 raft_consensus.cc:482] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee802f092ae04c278f521f27230e7f5f)
I20260808 15:47:03.816699 16142 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee802f092ae04c278f521f27230e7f5f)
I20260808 15:47:03.816916 16141 raft_consensus.cc:504] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: false } }
I20260808 15:47:03.816975 16142 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: false } }
I20260808 15:47:03.818019 16141 leader_election.cc:288] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee802f092ae04c278f521f27230e7f5f (127.8.39.126:45971), 4db134f3e18f4744b07d2f2960a474df (127.8.39.125:38219)
I20260808 15:47:03.818032 16142 leader_election.cc:288] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee802f092ae04c278f521f27230e7f5f (127.8.39.126:45971), 482e9fc7985b4da09a1f6fe5e5f6dd84 (127.8.39.124:43751)
I20260808 15:47:03.818557 16143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:03.818125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.0.0.1:37344)
0808 15:47:03.818353 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:03.818434 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":64,"threads_started":1}
W20260808 15:47:03.818848 15592 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
I20260808 15:47:03.819276 16147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:03.818540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.0.0.1:37340)
0808 15:47:03.819098 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:03.819178 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":50,"threads_started":1}
W20260808 15:47:03.819453 15404 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
I20260808 15:47:03.819974 16143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:03.819746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.0.0.1:37352)
0808 15:47:03.819862 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:03.819913 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 15:47:03.820226 15592 leader_election.cc:334] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee802f092ae04c278f521f27230e7f5f (127.8.39.126:45971): Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
I20260808 15:47:03.820300 16147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:03.820095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.0.0.1:37354)
0808 15:47:03.820185 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:03.820234 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260808 15:47:03.820421 15404 leader_election.cc:334] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee802f092ae04c278f521f27230e7f5f (127.8.39.126:45971): Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
I20260808 15:47:03.822786 16145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:03.818310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:43751 (local address 127.0.0.1:45142)
0808 15:47:03.818763 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:03.818779 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:03.818879 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:03.819212 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:03.819215 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:03.819237 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:47:03.819323 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:03.819329 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:03.820449 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:03.820452 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:03.821503 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:03.821511 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:03.822328 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:03.822331 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:03.822455 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:03.822481 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 15:47:03.822555 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 15:47:03.822629 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"spinlock_wait_cycles":768,"thread_start_us":81,"threads_started":1}
I20260808 15:47:03.822799 16146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:03.818482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45142 (local address 127.8.39.124:43751)
0808 15:47:03.818973 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:03.818978 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:03.818991 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:47:03.819041 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:03.819044 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:03.819092 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:03.819423 (+ 331us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:47:03.819520 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:03.820339 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:03.821617 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:03.822202 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:03.822315 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:03.822399 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:03.822589 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 15:47:03.822653 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":431,"thread_start_us":81,"threads_started":1}
I20260808 15:47:03.823285 15617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4db134f3e18f4744b07d2f2960a474df" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" is_pre_election: true
I20260808 15:47:03.823506 15617 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db134f3e18f4744b07d2f2960a474df in term 1.
I20260808 15:47:03.823549 16144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:03.818240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:38219 (local address 127.0.0.1:46704)
0808 15:47:03.818626 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:03.818641 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:03.818766 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:03.819306 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:03.819309 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:03.819324 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:47:03.820155 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:03.820163 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:03.821181 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:03.821183 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:03.822290 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:03.822298 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:03.823148 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:03.823152 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:03.823247 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:03.823264 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 15:47:03.823356 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 15:47:03.823424 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"mutex_wait_us":297,"thread_start_us":73,"threads_started":1}
I20260808 15:47:03.823549 16148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:03.818743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46704 (local address 127.8.39.125:38219)
0808 15:47:03.818974 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:03.818978 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:03.818991 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:47:03.819042 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:03.819044 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:03.819086 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:03.819176 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:47:03.820281 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:03.821060 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:03.822403 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:03.823021 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:03.823123 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:03.823174 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:03.823378 (+ 204us) server_negotiation.cc:299] Negotiation successful
0808 15:47:03.823444 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"spinlock_wait_cycles":4736,"thread_start_us":65,"threads_started":1}
I20260808 15:47:03.823961 15405 leader_election.cc:302] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e9fc7985b4da09a1f6fe5e5f6dd84, 4db134f3e18f4744b07d2f2960a474df; no voters: ee802f092ae04c278f521f27230e7f5f
I20260808 15:47:03.823967 15428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4db134f3e18f4744b07d2f2960a474df" is_pre_election: true
I20260808 15:47:03.824213 15428 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e9fc7985b4da09a1f6fe5e5f6dd84 in term 1.
I20260808 15:47:03.824307 16142 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 15:47:03.824363 16142 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee802f092ae04c278f521f27230e7f5f)
I20260808 15:47:03.824419 16142 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 1 FOLLOWER]: Advancing to term 2
I20260808 15:47:03.824599 15590 leader_election.cc:302] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 482e9fc7985b4da09a1f6fe5e5f6dd84, 4db134f3e18f4744b07d2f2960a474df; no voters: ee802f092ae04c278f521f27230e7f5f
I20260808 15:47:03.824819 16141 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 15:47:03.824874 16141 raft_consensus.cc:482] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee802f092ae04c278f521f27230e7f5f)
I20260808 15:47:03.824911 16141 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 1 FOLLOWER]: Advancing to term 2
I20260808 15:47:03.825824 16142 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 2 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: false } }
I20260808 15:47:03.826174 16141 raft_consensus.cc:504] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: false } }
I20260808 15:47:03.826256 16142 leader_election.cc:288] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [CANDIDATE]: Term 2 election: Requested vote from peers ee802f092ae04c278f521f27230e7f5f (127.8.39.126:45971), 482e9fc7985b4da09a1f6fe5e5f6dd84 (127.8.39.124:43751)
I20260808 15:47:03.826589 16141 leader_election.cc:288] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [CANDIDATE]: Term 2 election: Requested vote from peers ee802f092ae04c278f521f27230e7f5f (127.8.39.126:45971), 4db134f3e18f4744b07d2f2960a474df (127.8.39.125:38219)
I20260808 15:47:03.826756 16145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:03.826443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.0.0.1:37362)
0808 15:47:03.826598 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:03.826661 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260808 15:47:03.826788 15617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4db134f3e18f4744b07d2f2960a474df" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84"
I20260808 15:47:03.826958 15617 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4db134f3e18f4744b07d2f2960a474df in current term 2: Already voted for candidate 482e9fc7985b4da09a1f6fe5e5f6dd84 in this term.
I20260808 15:47:03.827092 16144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:03.826721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.0.0.1:37366)
0808 15:47:03.826935 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:03.826990 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 15:47:03.827396 15428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4db134f3e18f4744b07d2f2960a474df"
I20260808 15:47:03.827515 16147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:03.827249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.0.0.1:37374)
0808 15:47:03.827343 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:03.827396 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 15:47:03.827584 15428 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 482e9fc7985b4da09a1f6fe5e5f6dd84 in current term 2: Already voted for candidate 4db134f3e18f4744b07d2f2960a474df in this term.
W20260808 15:47:03.827746 15404 leader_election.cc:334] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ee802f092ae04c278f521f27230e7f5f (127.8.39.126:45971): Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
I20260808 15:47:03.827826 15404 leader_election.cc:302] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db134f3e18f4744b07d2f2960a474df; no voters: 482e9fc7985b4da09a1f6fe5e5f6dd84, ee802f092ae04c278f521f27230e7f5f
I20260808 15:47:03.827965 16144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:03.827748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.0.0.1:37386)
0808 15:47:03.827850 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:03.827904 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 15:47:03.827972 16142 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260808 15:47:03.828080 15592 leader_election.cc:334] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ee802f092ae04c278f521f27230e7f5f (127.8.39.126:45971): Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
I20260808 15:47:03.828238 15590 leader_election.cc:302] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482e9fc7985b4da09a1f6fe5e5f6dd84; no voters: 4db134f3e18f4744b07d2f2960a474df, ee802f092ae04c278f521f27230e7f5f
I20260808 15:47:03.828406 16141 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260808 15:47:04.306067 16152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:04.305590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.65:34551)
0808 15:47:04.305868 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:04.305956 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":109,"threads_started":1}
I20260808 15:47:04.306466 16154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:04.305589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.66:58019)
0808 15:47:04.306341 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:04.306394 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":674,"thread_start_us":95,"threads_started":1}
I20260808 15:47:04.307968 16155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:04.307608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.67:52701)
0808 15:47:04.307838 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:04.307894 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":97,"threads_started":1}
I20260808 15:47:05.307585 16156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.306825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.65:37343)
0808 15:47:05.307313 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.307458 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":95,"threads_started":1}
I20260808 15:47:05.307593 16157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.307206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.66:41373)
0808 15:47:05.307429 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.307495 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":69,"threads_started":1}
I20260808 15:47:05.308935 16158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.308588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.67:46239)
0808 15:47:05.308810 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.308860 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":78,"threads_started":1}
I20260808 15:47:05.584854 16159 raft_consensus.cc:482] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:47:05.585049 16159 raft_consensus.cc:504] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: false } }
I20260808 15:47:05.585599 16159 leader_election.cc:288] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee802f092ae04c278f521f27230e7f5f (127.8.39.126:45971), 4db134f3e18f4744b07d2f2960a474df (127.8.39.125:38219)
I20260808 15:47:05.586205 15428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4db134f3e18f4744b07d2f2960a474df" is_pre_election: true
I20260808 15:47:05.586272 16160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.585775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.0.0.1:37482)
0808 15:47:05.586097 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.586182 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":74,"threads_started":1}
I20260808 15:47:05.586350 15428 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482e9fc7985b4da09a1f6fe5e5f6dd84 in term 2.
I20260808 15:47:05.586773 15590 leader_election.cc:302] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e9fc7985b4da09a1f6fe5e5f6dd84, 4db134f3e18f4744b07d2f2960a474df; no voters:
I20260808 15:47:05.586997 16159 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260808 15:47:05.587087 16159 raft_consensus.cc:482] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:47:05.587132 16159 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 2 FOLLOWER]: Advancing to term 3
I20260808 15:47:05.587284 16160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.587013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.0.0.1:37492)
0808 15:47:05.587143 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.587211 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 15:47:05.587414 15592 leader_election.cc:334] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ee802f092ae04c278f521f27230e7f5f (127.8.39.126:45971): Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
I20260808 15:47:05.588406 16159 raft_consensus.cc:504] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: false } }
I20260808 15:47:05.588805 16159 leader_election.cc:288] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [CANDIDATE]: Term 3 election: Requested vote from peers ee802f092ae04c278f521f27230e7f5f (127.8.39.126:45971), 4db134f3e18f4744b07d2f2960a474df (127.8.39.125:38219)
I20260808 15:47:05.589183 16160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.588929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.0.0.1:37498)
0808 15:47:05.589018 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.589107 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 15:47:05.589277 15428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4db134f3e18f4744b07d2f2960a474df"
I20260808 15:47:05.589421 15428 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 2 FOLLOWER]: Advancing to term 3
I20260808 15:47:05.590428 15428 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482e9fc7985b4da09a1f6fe5e5f6dd84 in term 3.
I20260808 15:47:05.590786 15590 leader_election.cc:302] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482e9fc7985b4da09a1f6fe5e5f6dd84, 4db134f3e18f4744b07d2f2960a474df; no voters:
I20260808 15:47:05.590969 16159 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 15:47:05.591171 16160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.590970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.0.0.1:37502)
0808 15:47:05.591061 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.591111 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 15:47:05.591187 16159 raft_consensus.cc:686] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [term 3 LEADER]: Becoming Leader. State: Replica: 482e9fc7985b4da09a1f6fe5e5f6dd84, State: Running, Role: LEADER
W20260808 15:47:05.591293 15592 leader_election.cc:334] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ee802f092ae04c278f521f27230e7f5f (127.8.39.126:45971): Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
I20260808 15:47:05.591526 16159 consensus_queue.cc:237] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: false } }
I20260808 15:47:05.592684 16162 sys_catalog.cc:455] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 482e9fc7985b4da09a1f6fe5e5f6dd84. Latest consensus state: current_term: 3 leader_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" committed_config { opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: false } } }
I20260808 15:47:05.592777 16162 sys_catalog.cc:458] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [sys.catalog]: This master's current role is: LEADER
I20260808 15:47:05.593142 16164 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:47:05.595963 16164 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:47:05.596390 16164 catalog_manager.cc:1259] Loaded cluster ID: d017dce23e6f4f138f04357015c133f6
I20260808 15:47:05.596467 16164 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:47:05.597177 16164 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:47:05.597595 16164 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84: Loaded TSK: 0
I20260808 15:47:05.598316 16164 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:47:05.673908 15606 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45136:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:47:05.677897 15606 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:47:05.681573 16160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.681283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.0.0.1:37518)
0808 15:47:05.681421 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.681496 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 15:47:05.681694 15428 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [term 3 FOLLOWER]: Refusing update from remote peer 482e9fc7985b4da09a1f6fe5e5f6dd84: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260808 15:47:05.682219 16159 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260808 15:47:05.682365 16160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.682093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.0.0.1:37528)
0808 15:47:05.682245 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.682302 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260808 15:47:05.682538 15592 consensus_peers.cc:487] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 -> Peer ee802f092ae04c278f521f27230e7f5f (127.8.39.126:45971): Couldn't send request to peer ee802f092ae04c278f521f27230e7f5f. Status: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 15:47:05.683776 16166 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 482e9fc7985b4da09a1f6fe5e5f6dd84. Latest consensus state: current_term: 3 leader_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" committed_config { opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: false } } }
I20260808 15:47:05.684006 16166 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:47:05.685269 16162 sys_catalog.cc:455] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" committed_config { opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: false } } }
I20260808 15:47:05.685611 16162 sys_catalog.cc:458] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84 [sys.catalog]: This master's current role is: LEADER
I20260808 15:47:05.685565 16166 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" committed_config { opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "ee802f092ae04c278f521f27230e7f5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45971 } } peers { permanent_uuid: "4db134f3e18f4744b07d2f2960a474df" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 38219 } attrs { promote: false } } peers { permanent_uuid: "482e9fc7985b4da09a1f6fe5e5f6dd84" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 43751 } attrs { promote: false } } }
I20260808 15:47:05.685761 16166 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4db134f3e18f4744b07d2f2960a474df [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:47:05.696928 16172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.691983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:39155 (local address 127.0.0.1:36730)
0808 15:47:05.692597 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.692612 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:05.692739 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:05.693159 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:05.693162 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:05.693179 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:47:05.693299 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:05.693306 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:05.694366 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:05.694369 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:05.695543 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:05.695555 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:05.696445 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:05.696450 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:05.696555 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:05.696589 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 15:47:05.696665 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 15:47:05.696750 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"mutex_wait_us":53,"thread_start_us":107,"threads_started":1}
I20260808 15:47:05.697077 16160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.691711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:35371 (local address 127.0.0.1:60334)
0808 15:47:05.691846 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.691865 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:05.691971 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:05.693190 (+ 1219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:05.693194 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:05.693212 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:47:05.693324 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:05.693331 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:05.694172 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:05.694178 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:05.695669 (+ 1491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:05.695680 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:05.696597 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:05.696601 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:05.696697 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:05.696718 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 15:47:05.696800 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 15:47:05.696869 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52,"mutex_wait_us":80}
I20260808 15:47:05.697474 16174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.692349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36730 (local address 127.8.39.65:39155)
0808 15:47:05.692599 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:05.692607 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:05.692699 (+ 92us) server_negotiation.cc:407] Connection header received
0808 15:47:05.692871 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:05.692874 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:05.692931 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:05.693029 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:47:05.693425 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:05.694241 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:05.695675 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:05.696319 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:05.696421 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:05.696495 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:05.697235 (+ 740us) server_negotiation.cc:299] Negotiation successful
0808 15:47:05.697332 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":72,"threads_started":1}
I20260808 15:47:05.697525 16173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.692261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60334 (local address 127.8.39.67:35371)
0808 15:47:05.692937 (+ 676us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:05.692942 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:05.692958 (+ 16us) server_negotiation.cc:407] Connection header received
0808 15:47:05.693017 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:05.693020 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:05.693068 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:05.693184 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:47:05.693468 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:05.694045 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:05.695823 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:05.696486 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:05.696600 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:05.696691 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:05.697282 (+ 591us) server_negotiation.cc:299] Negotiation successful
0808 15:47:05.697371 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":68,"threads_started":1}
I20260808 15:47:05.697784 16175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.692385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:38557 (local address 127.0.0.1:57964)
0808 15:47:05.692813 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.692830 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:05.692926 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:05.693413 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:05.693416 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:05.693430 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:47:05.693509 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:05.693515 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:05.694486 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:05.694489 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:05.695945 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:05.695954 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:05.696822 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:05.696826 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:05.696910 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:05.696933 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 15:47:05.697017 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 15:47:05.697101 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"mutex_wait_us":29,"thread_start_us":110,"threads_started":1}
I20260808 15:47:05.698027 16002 tablet_service.cc:1467] Processing CreateTablet for tablet eb0ffab4da464fec89c6b34c2cf01360 (DEFAULT_TABLE table=test-table [id=fb5bcd01968245abbc6a79976a552541]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:47:05.698043 15722 tablet_service.cc:1467] Processing CreateTablet for tablet eb0ffab4da464fec89c6b34c2cf01360 (DEFAULT_TABLE table=test-table [id=fb5bcd01968245abbc6a79976a552541]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:47:05.698323 15722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb0ffab4da464fec89c6b34c2cf01360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:05.698323 16002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb0ffab4da464fec89c6b34c2cf01360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:05.700924 16177 tablet_bootstrap.cc:492] T eb0ffab4da464fec89c6b34c2cf01360 P efef22d6e3874f02a4e6253d7ec88ac3: Bootstrap starting.
I20260808 15:47:05.701030 16176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.692845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57964 (local address 127.8.39.66:38557)
0808 15:47:05.693100 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:05.693104 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:05.693119 (+ 15us) server_negotiation.cc:407] Connection header received
0808 15:47:05.693171 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:05.693173 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:05.693216 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:05.693296 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:47:05.693636 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:05.694376 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:05.696127 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:05.696722 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:05.696823 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:05.696882 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:05.697422 (+ 540us) server_negotiation.cc:299] Negotiation successful
0808 15:47:05.697505 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":78,"threads_started":1}
I20260808 15:47:05.701531 15864 tablet_service.cc:1467] Processing CreateTablet for tablet eb0ffab4da464fec89c6b34c2cf01360 (DEFAULT_TABLE table=test-table [id=fb5bcd01968245abbc6a79976a552541]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:47:05.701797 15864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb0ffab4da464fec89c6b34c2cf01360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:05.702131 16177 tablet_bootstrap.cc:654] T eb0ffab4da464fec89c6b34c2cf01360 P efef22d6e3874f02a4e6253d7ec88ac3: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:05.702878 16178 tablet_bootstrap.cc:492] T eb0ffab4da464fec89c6b34c2cf01360 P b0e5806c606e4b5ea2b6c9da30c5e73e: Bootstrap starting.
I20260808 15:47:05.703750 16178 tablet_bootstrap.cc:654] T eb0ffab4da464fec89c6b34c2cf01360 P b0e5806c606e4b5ea2b6c9da30c5e73e: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:05.704459 16180 tablet_bootstrap.cc:492] T eb0ffab4da464fec89c6b34c2cf01360 P 0768475129944942a1a39ea968bfb1f9: Bootstrap starting.
I20260808 15:47:05.705093 16177 tablet_bootstrap.cc:492] T eb0ffab4da464fec89c6b34c2cf01360 P efef22d6e3874f02a4e6253d7ec88ac3: No bootstrap required, opened a new log
I20260808 15:47:05.705188 16177 ts_tablet_manager.cc:1397] T eb0ffab4da464fec89c6b34c2cf01360 P efef22d6e3874f02a4e6253d7ec88ac3: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260808 15:47:05.705245 16178 tablet_bootstrap.cc:492] T eb0ffab4da464fec89c6b34c2cf01360 P b0e5806c606e4b5ea2b6c9da30c5e73e: No bootstrap required, opened a new log
I20260808 15:47:05.705327 16178 ts_tablet_manager.cc:1397] T eb0ffab4da464fec89c6b34c2cf01360 P b0e5806c606e4b5ea2b6c9da30c5e73e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 15:47:05.705489 16180 tablet_bootstrap.cc:654] T eb0ffab4da464fec89c6b34c2cf01360 P 0768475129944942a1a39ea968bfb1f9: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:05.705638 16177 raft_consensus.cc:348] T eb0ffab4da464fec89c6b34c2cf01360 P efef22d6e3874f02a4e6253d7ec88ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35371 } } peers { permanent_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39155 } } peers { permanent_uuid: "0768475129944942a1a39ea968bfb1f9" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38557 } }
I20260808 15:47:05.705761 16177 raft_consensus.cc:374] T eb0ffab4da464fec89c6b34c2cf01360 P efef22d6e3874f02a4e6253d7ec88ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:05.705809 16177 raft_consensus.cc:729] T eb0ffab4da464fec89c6b34c2cf01360 P efef22d6e3874f02a4e6253d7ec88ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efef22d6e3874f02a4e6253d7ec88ac3, State: Initialized, Role: FOLLOWER
I20260808 15:47:05.705776 16178 raft_consensus.cc:348] T eb0ffab4da464fec89c6b34c2cf01360 P b0e5806c606e4b5ea2b6c9da30c5e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35371 } } peers { permanent_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39155 } } peers { permanent_uuid: "0768475129944942a1a39ea968bfb1f9" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38557 } }
I20260808 15:47:05.705888 16178 raft_consensus.cc:374] T eb0ffab4da464fec89c6b34c2cf01360 P b0e5806c606e4b5ea2b6c9da30c5e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:05.705932 16178 raft_consensus.cc:729] T eb0ffab4da464fec89c6b34c2cf01360 P b0e5806c606e4b5ea2b6c9da30c5e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0e5806c606e4b5ea2b6c9da30c5e73e, State: Initialized, Role: FOLLOWER
I20260808 15:47:05.705964 16177 consensus_queue.cc:260] T eb0ffab4da464fec89c6b34c2cf01360 P efef22d6e3874f02a4e6253d7ec88ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35371 } } peers { permanent_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39155 } } peers { permanent_uuid: "0768475129944942a1a39ea968bfb1f9" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38557 } }
I20260808 15:47:05.706064 16178 consensus_queue.cc:260] T eb0ffab4da464fec89c6b34c2cf01360 P b0e5806c606e4b5ea2b6c9da30c5e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35371 } } peers { permanent_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39155 } } peers { permanent_uuid: "0768475129944942a1a39ea968bfb1f9" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38557 } }
I20260808 15:47:05.706354 16177 ts_tablet_manager.cc:1428] T eb0ffab4da464fec89c6b34c2cf01360 P efef22d6e3874f02a4e6253d7ec88ac3: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260808 15:47:05.706427 16178 ts_tablet_manager.cc:1428] T eb0ffab4da464fec89c6b34c2cf01360 P b0e5806c606e4b5ea2b6c9da30c5e73e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:47:05.707237 16180 tablet_bootstrap.cc:492] T eb0ffab4da464fec89c6b34c2cf01360 P 0768475129944942a1a39ea968bfb1f9: No bootstrap required, opened a new log
I20260808 15:47:05.707307 16158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.706852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.67:40823)
0808 15:47:05.707167 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.707232 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229}
I20260808 15:47:05.707333 16180 ts_tablet_manager.cc:1397] T eb0ffab4da464fec89c6b34c2cf01360 P 0768475129944942a1a39ea968bfb1f9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 15:47:05.707834 16180 raft_consensus.cc:348] T eb0ffab4da464fec89c6b34c2cf01360 P 0768475129944942a1a39ea968bfb1f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35371 } } peers { permanent_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39155 } } peers { permanent_uuid: "0768475129944942a1a39ea968bfb1f9" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38557 } }
I20260808 15:47:05.707967 16180 raft_consensus.cc:374] T eb0ffab4da464fec89c6b34c2cf01360 P 0768475129944942a1a39ea968bfb1f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:05.708012 16180 raft_consensus.cc:729] T eb0ffab4da464fec89c6b34c2cf01360 P 0768475129944942a1a39ea968bfb1f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0768475129944942a1a39ea968bfb1f9, State: Initialized, Role: FOLLOWER
I20260808 15:47:05.708143 16180 consensus_queue.cc:260] T eb0ffab4da464fec89c6b34c2cf01360 P 0768475129944942a1a39ea968bfb1f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35371 } } peers { permanent_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39155 } } peers { permanent_uuid: "0768475129944942a1a39ea968bfb1f9" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38557 } }
I20260808 15:47:05.708564 16180 ts_tablet_manager.cc:1428] T eb0ffab4da464fec89c6b34c2cf01360 P 0768475129944942a1a39ea968bfb1f9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:47:05.709259 16157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.708836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.66:35229)
0808 15:47:05.709127 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.709184 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218}
I20260808 15:47:05.709321 15792 heartbeater.cc:503] Master 127.8.39.124:43751 was elected leader, sending a full tablet report...
I20260808 15:47:05.709568 16156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.709139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.65:40093)
0808 15:47:05.709445 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.709500 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231}
I20260808 15:47:05.710258 16156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.710023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.65:33695)
0808 15:47:05.710154 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.710208 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 15:47:05.711791 16072 heartbeater.cc:503] Master 127.8.39.124:43751 was elected leader, sending a full tablet report...
I20260808 15:47:05.711907 16157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.711610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.66:59349)
0808 15:47:05.711784 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.711838 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260808 15:47:05.712596 15932 heartbeater.cc:503] Master 127.8.39.124:43751 was elected leader, sending a full tablet report...
I20260808 15:47:05.712895 16158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.712614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.67:49707)
0808 15:47:05.712769 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.712823 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260808 15:47:05.795631 16184 raft_consensus.cc:482] T eb0ffab4da464fec89c6b34c2cf01360 P b0e5806c606e4b5ea2b6c9da30c5e73e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:47:05.795789 16184 raft_consensus.cc:504] T eb0ffab4da464fec89c6b34c2cf01360 P b0e5806c606e4b5ea2b6c9da30c5e73e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35371 } } peers { permanent_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39155 } } peers { permanent_uuid: "0768475129944942a1a39ea968bfb1f9" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38557 } }
I20260808 15:47:05.797163 16184 leader_election.cc:288] T eb0ffab4da464fec89c6b34c2cf01360 P b0e5806c606e4b5ea2b6c9da30c5e73e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efef22d6e3874f02a4e6253d7ec88ac3 (127.8.39.67:35371), 0768475129944942a1a39ea968bfb1f9 (127.8.39.66:38557)
I20260808 15:47:05.801023 16173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.797518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:40249 (local address 127.8.39.67:35371)
0808 15:47:05.797657 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:05.797662 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:05.797740 (+ 78us) server_negotiation.cc:407] Connection header received
0808 15:47:05.797915 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:05.797918 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:05.797965 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:05.798057 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:47:05.798344 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:05.798931 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:05.800036 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:05.800433 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:05.800560 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:05.800629 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:05.800824 (+ 195us) server_negotiation.cc:299] Negotiation successful
0808 15:47:05.800900 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 15:47:05.801023 16156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.797430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:35371 (local address 127.8.39.65:40249)
0808 15:47:05.797637 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.797653 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:05.797778 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:05.798070 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:05.798073 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:05.798092 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:47:05.798226 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:05.798232 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:05.799074 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:05.799077 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:05.799901 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:05.799909 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:05.800583 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:05.800587 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:05.800689 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:05.800718 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 15:47:05.800809 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 15:47:05.800880 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121}
I20260808 15:47:05.801115 16176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.797561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:39041 (local address 127.8.39.66:38557)
0808 15:47:05.797684 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:05.797691 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:05.797941 (+ 250us) server_negotiation.cc:407] Connection header received
0808 15:47:05.798107 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:05.798111 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:05.798151 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:05.798234 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:47:05.798512 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:05.799087 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:05.800104 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:05.800522 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:05.800638 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:05.800703 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:05.800909 (+ 206us) server_negotiation.cc:299] Negotiation successful
0808 15:47:05.800984 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 15:47:05.801193 16186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.797463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:38557 (local address 127.8.39.65:39041)
0808 15:47:05.797835 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.797846 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:05.797986 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:05.798243 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:05.798246 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:05.798262 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:47:05.798395 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:05.798400 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:05.799201 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:05.799205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:05.799970 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:05.799979 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:05.800643 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:05.800646 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:05.800769 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:05.800793 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 15:47:05.800894 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 15:47:05.800974 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":123,"threads_started":1}
I20260808 15:47:05.801649 16024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb0ffab4da464fec89c6b34c2cf01360" candidate_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" is_pre_election: true
I20260808 15:47:05.801712 15886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb0ffab4da464fec89c6b34c2cf01360" candidate_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0768475129944942a1a39ea968bfb1f9" is_pre_election: true
I20260808 15:47:05.801838 15886 raft_consensus.cc:2454] T eb0ffab4da464fec89c6b34c2cf01360 P 0768475129944942a1a39ea968bfb1f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e5806c606e4b5ea2b6c9da30c5e73e in term 0.
I20260808 15:47:05.801898 16024 raft_consensus.cc:2454] T eb0ffab4da464fec89c6b34c2cf01360 P efef22d6e3874f02a4e6253d7ec88ac3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e5806c606e4b5ea2b6c9da30c5e73e in term 0.
I20260808 15:47:05.802294 15678 leader_election.cc:302] T eb0ffab4da464fec89c6b34c2cf01360 P b0e5806c606e4b5ea2b6c9da30c5e73e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0768475129944942a1a39ea968bfb1f9, b0e5806c606e4b5ea2b6c9da30c5e73e; no voters:
I20260808 15:47:05.802532 16184 raft_consensus.cc:2781] T eb0ffab4da464fec89c6b34c2cf01360 P b0e5806c606e4b5ea2b6c9da30c5e73e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:47:05.802595 16184 raft_consensus.cc:482] T eb0ffab4da464fec89c6b34c2cf01360 P b0e5806c606e4b5ea2b6c9da30c5e73e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:47:05.802632 16184 raft_consensus.cc:3037] T eb0ffab4da464fec89c6b34c2cf01360 P b0e5806c606e4b5ea2b6c9da30c5e73e [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:05.803725 16184 raft_consensus.cc:504] T eb0ffab4da464fec89c6b34c2cf01360 P b0e5806c606e4b5ea2b6c9da30c5e73e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35371 } } peers { permanent_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39155 } } peers { permanent_uuid: "0768475129944942a1a39ea968bfb1f9" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38557 } }
I20260808 15:47:05.804075 16184 leader_election.cc:288] T eb0ffab4da464fec89c6b34c2cf01360 P b0e5806c606e4b5ea2b6c9da30c5e73e [CANDIDATE]: Term 1 election: Requested vote from peers efef22d6e3874f02a4e6253d7ec88ac3 (127.8.39.67:35371), 0768475129944942a1a39ea968bfb1f9 (127.8.39.66:38557)
I20260808 15:47:05.804388 16024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb0ffab4da464fec89c6b34c2cf01360" candidate_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efef22d6e3874f02a4e6253d7ec88ac3"
I20260808 15:47:05.804517 16024 raft_consensus.cc:3037] T eb0ffab4da464fec89c6b34c2cf01360 P efef22d6e3874f02a4e6253d7ec88ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:05.804517 15886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb0ffab4da464fec89c6b34c2cf01360" candidate_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0768475129944942a1a39ea968bfb1f9"
I20260808 15:47:05.804648 15886 raft_consensus.cc:3037] T eb0ffab4da464fec89c6b34c2cf01360 P 0768475129944942a1a39ea968bfb1f9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:05.805528 16024 raft_consensus.cc:2454] T eb0ffab4da464fec89c6b34c2cf01360 P efef22d6e3874f02a4e6253d7ec88ac3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e5806c606e4b5ea2b6c9da30c5e73e in term 1.
I20260808 15:47:05.805651 15886 raft_consensus.cc:2454] T eb0ffab4da464fec89c6b34c2cf01360 P 0768475129944942a1a39ea968bfb1f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e5806c606e4b5ea2b6c9da30c5e73e in term 1.
I20260808 15:47:05.805935 15678 leader_election.cc:302] T eb0ffab4da464fec89c6b34c2cf01360 P b0e5806c606e4b5ea2b6c9da30c5e73e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0768475129944942a1a39ea968bfb1f9, b0e5806c606e4b5ea2b6c9da30c5e73e; no voters:
I20260808 15:47:05.806149 16184 raft_consensus.cc:2781] T eb0ffab4da464fec89c6b34c2cf01360 P b0e5806c606e4b5ea2b6c9da30c5e73e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:47:05.806408 16184 raft_consensus.cc:686] T eb0ffab4da464fec89c6b34c2cf01360 P b0e5806c606e4b5ea2b6c9da30c5e73e [term 1 LEADER]: Becoming Leader. State: Replica: b0e5806c606e4b5ea2b6c9da30c5e73e, State: Running, Role: LEADER
I20260808 15:47:05.806664 16184 consensus_queue.cc:237] T eb0ffab4da464fec89c6b34c2cf01360 P b0e5806c606e4b5ea2b6c9da30c5e73e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35371 } } peers { permanent_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39155 } } peers { permanent_uuid: "0768475129944942a1a39ea968bfb1f9" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38557 } }
I20260808 15:47:05.807171 16186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.806902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.65:51355)
0808 15:47:05.807062 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.807111 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260808 15:47:05.809367 15606 catalog_manager.cc:5495] T eb0ffab4da464fec89c6b34c2cf01360 P b0e5806c606e4b5ea2b6c9da30c5e73e reported cstate change: term changed from 0 to 1, leader changed from <none> to b0e5806c606e4b5ea2b6c9da30c5e73e (127.8.39.65). New cstate: current_term: 1 leader_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e5806c606e4b5ea2b6c9da30c5e73e" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0768475129944942a1a39ea968bfb1f9" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38557 } health_report { overall_health: UNKNOWN } } }
I20260808 15:47:05.851526 16174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.847837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36732 (local address 127.8.39.65:39155)
0808 15:47:05.848000 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:05.848004 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:05.848023 (+ 19us) server_negotiation.cc:407] Connection header received
0808 15:47:05.848107 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:05.848109 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:05.848171 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:05.848268 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:47:05.848481 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:05.849098 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:05.849963 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:05.850194 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:05.850286 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:05.850539 (+ 253us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:47:05.851092 (+ 553us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:47:05.851233 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:05.851275 (+ 42us) server_negotiation.cc:299] Negotiation successful
0808 15:47:05.851327 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260808 15:47:05.854339 16075 tablet.cc:2369] T eb0ffab4da464fec89c6b34c2cf01360 P efef22d6e3874f02a4e6253d7ec88ac3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:47:05.854446 15886 raft_consensus.cc:1261] T eb0ffab4da464fec89c6b34c2cf01360 P 0768475129944942a1a39ea968bfb1f9 [term 1 FOLLOWER]: Refusing update from remote peer b0e5806c606e4b5ea2b6c9da30c5e73e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:47:05.854627 16024 raft_consensus.cc:1261] T eb0ffab4da464fec89c6b34c2cf01360 P efef22d6e3874f02a4e6253d7ec88ac3 [term 1 FOLLOWER]: Refusing update from remote peer b0e5806c606e4b5ea2b6c9da30c5e73e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:47:05.855115 16187 consensus_queue.cc:1035] T eb0ffab4da464fec89c6b34c2cf01360 P b0e5806c606e4b5ea2b6c9da30c5e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0768475129944942a1a39ea968bfb1f9" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 38557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:47:05.855309 16184 consensus_queue.cc:1035] T eb0ffab4da464fec89c6b34c2cf01360 P b0e5806c606e4b5ea2b6c9da30c5e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "efef22d6e3874f02a4e6253d7ec88ac3" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:47:05.857432 16157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.857138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.66:44551)
0808 15:47:05.857293 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.857354 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260808 15:47:05.858629 16158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.858018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.67:48543)
0808 15:47:05.858489 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.858552 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389}
I20260808 15:47:05.861620 16186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.861279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.65:52463)
0808 15:47:05.861469 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.861529 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260808 15:47:05.862257 16158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.861894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.67:59017)
0808 15:47:05.862115 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.862177 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
I20260808 15:47:05.862810 16192 mvcc.cc:205] Tried to move back new op lower bound from 7316291689894432768 to 7316291689707065344. Current Snapshot: MvccSnapshot[applied={T|T < 7316291689894432768}]
I20260808 15:47:05.863642 16157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.863318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.66:48515)
0808 15:47:05.863498 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.863560 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260808 15:47:05.863678 16191 mvcc.cc:205] Tried to move back new op lower bound from 7316291689894432768 to 7316291689707065344. Current Snapshot: MvccSnapshot[applied={T|T < 7316291689894432768 or (T in {7316291689894432768})}]
I20260808 15:47:05.865866 16186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.865595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45971 (local address 127.8.39.65:57629)
0808 15:47:05.865723 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.865789 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:45971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 15:47:05.871657 15607 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45136:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:47:05.871863 15607 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45136:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:47:05.876025 15607 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 482e9fc7985b4da09a1f6fe5e5f6dd84: Sending DeleteTablet for 3 replicas of tablet eb0ffab4da464fec89c6b34c2cf01360
I20260808 15:47:05.876838 16002 tablet_service.cc:1514] Processing DeleteTablet for tablet eb0ffab4da464fec89c6b34c2cf01360 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:47:05 UTC) from {username='oryx', principal='oryx/127.8.39.124@KRBTEST.COM'} at 127.0.0.1:60334
I20260808 15:47:05.877296 16200 tablet_replica.cc:330] T eb0ffab4da464fec89c6b34c2cf01360 P efef22d6e3874f02a4e6253d7ec88ac3: stopping tablet replica
I20260808 15:47:05.877384 15722 tablet_service.cc:1514] Processing DeleteTablet for tablet eb0ffab4da464fec89c6b34c2cf01360 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:47:05 UTC) from {username='oryx', principal='oryx/127.8.39.124@KRBTEST.COM'} at 127.0.0.1:36730
I20260808 15:47:05.877596 16200 raft_consensus.cc:2229] T eb0ffab4da464fec89c6b34c2cf01360 P efef22d6e3874f02a4e6253d7ec88ac3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:47:05.877720 15864 tablet_service.cc:1514] Processing DeleteTablet for tablet eb0ffab4da464fec89c6b34c2cf01360 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:47:05 UTC) from {username='oryx', principal='oryx/127.8.39.124@KRBTEST.COM'} at 127.0.0.1:57964
I20260808 15:47:05.877817 16200 raft_consensus.cc:2258] T eb0ffab4da464fec89c6b34c2cf01360 P efef22d6e3874f02a4e6253d7ec88ac3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:47:05.878123 16202 tablet_replica.cc:330] T eb0ffab4da464fec89c6b34c2cf01360 P 0768475129944942a1a39ea968bfb1f9: stopping tablet replica
I20260808 15:47:05.878247 16202 raft_consensus.cc:2229] T eb0ffab4da464fec89c6b34c2cf01360 P 0768475129944942a1a39ea968bfb1f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:47:05.878393 16202 raft_consensus.cc:2258] T eb0ffab4da464fec89c6b34c2cf01360 P 0768475129944942a1a39ea968bfb1f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:47:05.878827 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 15566
I20260808 15:47:05.881407 16202 ts_tablet_manager.cc:1905] T eb0ffab4da464fec89c6b34c2cf01360 P 0768475129944942a1a39ea968bfb1f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:47:05.881800 16200 ts_tablet_manager.cc:1905] T eb0ffab4da464fec89c6b34c2cf01360 P efef22d6e3874f02a4e6253d7ec88ac3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:47:05.883915 16202 ts_tablet_manager.cc:1918] T eb0ffab4da464fec89c6b34c2cf01360 P 0768475129944942a1a39ea968bfb1f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:47:05.883988 16202 log.cc:1196] T eb0ffab4da464fec89c6b34c2cf01360 P 0768475129944942a1a39ea968bfb1f9: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-1/wal/wals/eb0ffab4da464fec89c6b34c2cf01360
I20260808 15:47:05.884029 16200 ts_tablet_manager.cc:1918] T eb0ffab4da464fec89c6b34c2cf01360 P efef22d6e3874f02a4e6253d7ec88ac3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:47:05.884122 16200 log.cc:1196] T eb0ffab4da464fec89c6b34c2cf01360 P efef22d6e3874f02a4e6253d7ec88ac3: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/eb0ffab4da464fec89c6b34c2cf01360
I20260808 15:47:05.884281 16202 ts_tablet_manager.cc:1939] T eb0ffab4da464fec89c6b34c2cf01360 P 0768475129944942a1a39ea968bfb1f9: Deleting consensus metadata
I20260808 15:47:05.884454 16200 ts_tablet_manager.cc:1939] T eb0ffab4da464fec89c6b34c2cf01360 P efef22d6e3874f02a4e6253d7ec88ac3: Deleting consensus metadata
I20260808 15:47:05.885119 15593 catalog_manager.cc:4841] TS 0768475129944942a1a39ea968bfb1f9 (127.8.39.66:38557): tablet eb0ffab4da464fec89c6b34c2cf01360 (table test-table [id=fb5bcd01968245abbc6a79976a552541]) successfully deleted
I20260808 15:47:05.885272 15592 catalog_manager.cc:4841] TS efef22d6e3874f02a4e6253d7ec88ac3 (127.8.39.67:35371): tablet eb0ffab4da464fec89c6b34c2cf01360 (table test-table [id=fb5bcd01968245abbc6a79976a552541]) successfully deleted
I20260808 15:47:05.889917 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 15800
I20260808 15:47:05.890435 16175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:05.889993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:39155 (local address 127.0.0.1:36748)
0808 15:47:05.890230 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:05.890296 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.65:39155: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
W20260808 15:47:05.891651 15591 catalog_manager.cc:4584] TS b0e5806c606e4b5ea2b6c9da30c5e73e (127.8.39.65:39155): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet eb0ffab4da464fec89c6b34c2cf01360: Network error: Client connection negotiation failed: client connection to 127.8.39.65:39155: connect: Connection refused (error 111)
I20260808 15:47:05.897375 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 15939
I20260808 15:47:05.905635 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 15272
I20260808 15:47:05.913291 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 15381
2026-08-08T15:47:05Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7386 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:47:05 dist-test-slave-8tdl krb5kdc[16205](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:47:05 dist-test-slave-8tdl krb5kdc[16205](info): set up 2 sockets
Aug 08 15:47:05 dist-test-slave-8tdl krb5kdc[16205](info): commencing operation
krb5kdc: starting...
W20260808 15:47:07.014667 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.075s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:47:07 dist-test-slave-8tdl krb5kdc[16205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:47:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:47:07Z Disabled control of system clock
WARNING: no policy specified for oryx/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.126.keytab.
Entry for principal oryx/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.126.keytab.
I20260808 15:47:07.147399 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:41439
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.126.keytab
--principal=oryx/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:37137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:41439
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:47:07.262034 16218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:07.262346 16218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:07.262428 16218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:07.266453 16218 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:47:07.266551 16218 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 15:47:07.266582 16218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:07.266625 16218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:07.266659 16218 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:47:07.266729 16218 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:47:07.273643 16218 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:37137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:41439
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.126.keytab
--principal=oryx/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:41439
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16218
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:07.274899 16218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:07.275964 16218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:07.284775 16223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:07.284770 16224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:07.284809 16218 server_base.cc:1034] running on GCE node
W20260808 15:47:07.284770 16226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:07.285667 16218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:07.287313 16218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:07.288506 16218 hybrid_clock.cc:648] HybridClock initialized: now 1786204027288473 us; error 51 us; skew 500 ppm
Aug 08 15:47:07 dist-test-slave-8tdl krb5kdc[16205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204027, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:47:07.291442 16218 init.cc:377] Logged in from keytab as oryx/127.8.39.126@KRBTEST.COM (short username oryx)
I20260808 15:47:07.292410 16218 webserver.cc:460] Webserver started at http://127.8.39.126:37711/ using document root <none> and password file <none>
I20260808 15:47:07.292974 16218 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:07.293066 16218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:07.293303 16218 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:47:07.295432 16218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "5e1777b3ca284b9eb791bd7090096e26"
format_stamp: "Formatted at 2026-08-08 15:47:07 on dist-test-slave-8tdl"
server_key: "5fa631c3c6c559b04737c7354a28c17e"
server_key_iv: "450ea6814334a8dbaf13df8d4033613f"
server_key_version: "encryptionkey@0"
I20260808 15:47:07.296025 16218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "5e1777b3ca284b9eb791bd7090096e26"
format_stamp: "Formatted at 2026-08-08 15:47:07 on dist-test-slave-8tdl"
server_key: "5fa631c3c6c559b04737c7354a28c17e"
server_key_iv: "450ea6814334a8dbaf13df8d4033613f"
server_key_version: "encryptionkey@0"
I20260808 15:47:07.299799 16218 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260808 15:47:07.302193 16233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:07.303447 16218 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 15:47:07.303586 16218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "5e1777b3ca284b9eb791bd7090096e26"
format_stamp: "Formatted at 2026-08-08 15:47:07 on dist-test-slave-8tdl"
server_key: "5fa631c3c6c559b04737c7354a28c17e"
server_key_iv: "450ea6814334a8dbaf13df8d4033613f"
server_key_version: "encryptionkey@0"
I20260808 15:47:07.303699 16218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:07.320101 16218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:07.323128 16218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:07.323339 16218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:07.331825 16218 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:41439
I20260808 15:47:07.331856 16296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:41439 every 8 connection(s)
I20260808 15:47:07.332777 16218 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:47:07.334960 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 16218
I20260808 15:47:07.335071 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:47:07.335399 8349 external_mini_cluster.cc:1428] Setting key 758c1be9ecef739a6d1ded1f6002eb54
I20260808 15:47:07.335662 16297 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:07.342953 16297 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26: Bootstrap starting.
Aug 08 15:47:07 dist-test-slave-8tdl krb5kdc[16205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM
I20260808 15:47:07.345661 16297 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:07.346562 16297 log.cc:824] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26: Log is configured to *not* fsync() on all Append() calls
I20260808 15:47:07.348752 16297 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26: No bootstrap required, opened a new log
I20260808 15:47:07.351697 16300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:07.336864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33010 (local address 127.8.39.126:41439)
0808 15:47:07.337295 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:07.337313 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:07.337355 (+ 42us) server_negotiation.cc:407] Connection header received
0808 15:47:07.338377 (+ 1022us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:07.338401 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:07.338865 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:07.339233 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:07.340031 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:07.341548 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:07.342500 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:07.343224 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:07.343383 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:07.346227 (+ 2844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:07.346234 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:07.346250 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:07.346283 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:07.348744 (+ 2461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:07.349252 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:07.349257 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:07.349261 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:07.349384 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:07.349745 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:07.349749 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:07.349750 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:07.350155 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:07.350350 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:07.350655 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 15:47:07.350972 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":112,"threads_started":1}
I20260808 15:47:07.352111 16297 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e1777b3ca284b9eb791bd7090096e26" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41439 } }
I20260808 15:47:07.352368 16297 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:07.352443 16297 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e1777b3ca284b9eb791bd7090096e26, State: Initialized, Role: FOLLOWER
I20260808 15:47:07.352978 16297 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e1777b3ca284b9eb791bd7090096e26" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41439 } }
I20260808 15:47:07.353140 16297 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:47:07.353207 16297 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:47:07.353312 16297 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:07.354461 16297 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e1777b3ca284b9eb791bd7090096e26" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41439 } }
I20260808 15:47:07.354835 16297 leader_election.cc:302] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5e1777b3ca284b9eb791bd7090096e26; no voters:
I20260808 15:47:07.355111 16297 leader_election.cc:288] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:47:07.355265 16302 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:47:07.355506 16302 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26 [term 1 LEADER]: Becoming Leader. State: Replica: 5e1777b3ca284b9eb791bd7090096e26, State: Running, Role: LEADER
I20260808 15:47:07.355824 16302 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e1777b3ca284b9eb791bd7090096e26" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41439 } }
I20260808 15:47:07.356472 16297 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:47:07.357844 16303 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5e1777b3ca284b9eb791bd7090096e26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e1777b3ca284b9eb791bd7090096e26" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41439 } } }
I20260808 15:47:07.357977 16303 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26 [sys.catalog]: This master's current role is: LEADER
I20260808 15:47:07.358209 16304 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e1777b3ca284b9eb791bd7090096e26. Latest consensus state: current_term: 1 leader_uuid: "5e1777b3ca284b9eb791bd7090096e26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e1777b3ca284b9eb791bd7090096e26" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41439 } } }
I20260808 15:47:07.358301 16304 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26 [sys.catalog]: This master's current role is: LEADER
I20260808 15:47:07.358454 16311 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:47:07.361009 16311 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:47:07.366236 16311 catalog_manager.cc:1347] Generated new cluster ID: f0ee361d82804cd3ae15879124d069eb
I20260808 15:47:07.366309 16311 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:47:07.382200 16311 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:47:07.383278 16311 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:47:07.393183 16311 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26: Generated new TSK 0
I20260808 15:47:07.393901 16311 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.8.39.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.39.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.39.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.65.keytab.
Entry for principal oryx/127.8.39.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.65.keytab.
I20260808 15:47:07.430639 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:0
--local_ip_for_outbound_sockets=127.8.39.65
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41439
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.65.keytab
--principal=oryx/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:37137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:47:07.545527 16323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:07.545794 16323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:07.545838 16323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:07.550014 16323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:07.550079 16323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:07.550119 16323 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 15:47:07.550190 16323 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:47:07.555567 16323 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:37137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.65.keytab
--principal=oryx/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.39.126:41439
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:07.557185 16323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:07.558357 16323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:07.568506 16331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:07.568516 16329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:07.568516 16328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:07.568710 16323 server_base.cc:1034] running on GCE node
I20260808 15:47:07.569198 16323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:07.569860 16323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:07.571030 16323 hybrid_clock.cc:648] HybridClock initialized: now 1786204027570993 us; error 51 us; skew 500 ppm
Aug 08 15:47:07 dist-test-slave-8tdl krb5kdc[16205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204027, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:47:07.573781 16323 init.cc:377] Logged in from keytab as oryx/127.8.39.65@KRBTEST.COM (short username oryx)
I20260808 15:47:07.574642 16323 webserver.cc:460] Webserver started at http://127.8.39.65:45549/ using document root <none> and password file <none>
I20260808 15:47:07.575260 16323 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:07.575379 16323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:07.575613 16323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:47:07.577767 16323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-0/data/instance:
uuid: "0bd01d96196949bbb7303b7d4d722d69"
format_stamp: "Formatted at 2026-08-08 15:47:07 on dist-test-slave-8tdl"
server_key: "f2983fa404624fa5f31968058932f44c"
server_key_iv: "f25f357787c4c848cef032407994686f"
server_key_version: "encryptionkey@0"
I20260808 15:47:07.578346 16323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance:
uuid: "0bd01d96196949bbb7303b7d4d722d69"
format_stamp: "Formatted at 2026-08-08 15:47:07 on dist-test-slave-8tdl"
server_key: "f2983fa404624fa5f31968058932f44c"
server_key_iv: "f25f357787c4c848cef032407994686f"
server_key_version: "encryptionkey@0"
I20260808 15:47:07.582098 16323 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260808 15:47:07.584674 16338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:07.585999 16323 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:47:07.586148 16323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "0bd01d96196949bbb7303b7d4d722d69"
format_stamp: "Formatted at 2026-08-08 15:47:07 on dist-test-slave-8tdl"
server_key: "f2983fa404624fa5f31968058932f44c"
server_key_iv: "f25f357787c4c848cef032407994686f"
server_key_version: "encryptionkey@0"
I20260808 15:47:07.586265 16323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:07.604535 16323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:07.608107 16323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:07.608356 16323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:07.610145 16323 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:47:07.610229 16323 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:07.610311 16323 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:47:07.610371 16323 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 15:47:07 dist-test-slave-8tdl krb5kdc[16205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204027, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM
I20260808 15:47:07.623178 16323 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:35353
I20260808 15:47:07.623247 16460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:35353 every 8 connection(s)
I20260808 15:47:07.624188 16323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:47:07.625859 16347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:07.611389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41439 (local address 127.8.39.65:54029)
0808 15:47:07.611905 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:07.611973 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:07.613237 (+ 1264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:07.613957 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:07.613968 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:07.614362 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:07.614948 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:07.614964 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:07.615964 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:07.615967 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:07.616878 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:07.616892 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:07.617420 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:07.617424 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:07.617624 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:07.618255 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:07.618271 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:07.620514 (+ 2243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:07.622910 (+ 2396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:07.622916 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:07.622930 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:07.623332 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:07.623649 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:07.623653 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:07.623655 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:07.623795 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:07.624207 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:07.624213 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:07.624530 (+ 317us) client_negotiation.cc:769] Sending connection context
0808 15:47:07.624719 (+ 189us) client_negotiation.cc:240] Negotiation successful
0808 15:47:07.625072 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":105,"threads_started":1}
I20260808 15:47:07.626495 16300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:07.610920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:54029 (local address 127.8.39.126:41439)
0808 15:47:07.611095 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:07.611104 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:07.612106 (+ 1002us) server_negotiation.cc:407] Connection header received
0808 15:47:07.613513 (+ 1407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:07.613517 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:07.613584 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:07.613679 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:07.615112 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:07.615828 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:07.617013 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:07.617255 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:07.617371 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:07.620729 (+ 3358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:07.620735 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:07.620742 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:07.620784 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:07.622788 (+ 2004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:07.623437 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:07.623443 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:07.623444 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:07.623555 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:07.623902 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:07.623905 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:07.623907 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:07.624101 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:07.624208 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:07.626268 (+ 2060us) server_negotiation.cc:299] Negotiation successful
0808 15:47:07.626382 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 15:47:07.627676 16461 heartbeater.cc:347] Connected to a master server at 127.8.39.126:41439
I20260808 15:47:07.627866 16461 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:07.628319 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 16323
I20260808 15:47:07.628470 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance
I20260808 15:47:07.628454 16461 heartbeater.cc:511] Master 127.8.39.126:41439 requested a full tablet report, sending...
I20260808 15:47:07.628885 8349 external_mini_cluster.cc:1428] Setting key d8b2158e2e48658fd933422fa318de66
I20260808 15:47:07.630525 16249 ts_manager.cc:194] Registered new tserver with Master: 0bd01d96196949bbb7303b7d4d722d69 (127.8.39.65:35353)
I20260808 15:47:07.632174 16249 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.39.65@KRBTEST.COM'} at 127.8.39.65:54029
I20260808 15:47:07.638821 16300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:07.630107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:44665 (local address 127.8.39.126:41439)
0808 15:47:07.630820 (+ 713us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:07.630825 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:07.630837 (+ 12us) server_negotiation.cc:407] Connection header received
0808 15:47:07.630869 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:07.630871 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:07.630906 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:07.631004 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:07.631496 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:07.632072 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:07.633414 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:07.633737 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:07.633849 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:07.635369 (+ 1520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:07.635372 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:07.635374 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:07.635395 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:07.636853 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:07.637410 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:07.637412 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:07.637413 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:07.637505 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:07.637849 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:07.637851 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:07.637852 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:07.638028 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:07.638107 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:07.638469 (+ 362us) server_negotiation.cc:299] Negotiation successful
0808 15:47:07.638610 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":629}
I20260808 15:47:07.638922 16467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:07.629999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41439 (local address 127.8.39.65:44665)
0808 15:47:07.630321 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:07.630338 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:07.630436 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:07.631029 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:07.631032 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:07.631261 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:07.631365 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:07.631370 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:07.632203 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:07.632207 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:07.633272 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:07.633287 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:07.633878 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:07.633883 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:07.634022 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:07.634626 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:07.634648 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:07.635229 (+ 581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:07.636968 (+ 1739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:07.636975 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:07.636981 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:07.637300 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:07.637605 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:07.637611 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:07.637616 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:07.637737 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:07.638135 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:07.638140 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:07.638284 (+ 144us) client_negotiation.cc:769] Sending connection context
0808 15:47:07.638432 (+ 148us) client_negotiation.cc:240] Negotiation successful
0808 15:47:07.638626 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":102,"threads_started":1}
WARNING: no policy specified for oryx/127.8.39.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.39.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.39.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.66.keytab.
Entry for principal oryx/127.8.39.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.66.keytab.
I20260808 15:47:07.660071 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:0
--local_ip_for_outbound_sockets=127.8.39.66
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41439
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.66.keytab
--principal=oryx/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:37137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:47:07.788648 16470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:07.788947 16470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:07.789001 16470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:07.793787 16470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:07.793871 16470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:07.793918 16470 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 15:47:07.793998 16470 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:47:07.800300 16470 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:37137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.66.keytab
--principal=oryx/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.39.126:41439
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16470
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:07.801565 16470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:07.802826 16470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:07.813335 16478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:07.813335 16476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:07.813341 16475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:07.813567 16470 server_base.cc:1034] running on GCE node
I20260808 15:47:07.814189 16470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:07.815039 16470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:07.816258 16470 hybrid_clock.cc:648] HybridClock initialized: now 1786204027816223 us; error 45 us; skew 500 ppm
Aug 08 15:47:07 dist-test-slave-8tdl krb5kdc[16205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204027, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:47:07.819325 16470 init.cc:377] Logged in from keytab as oryx/127.8.39.66@KRBTEST.COM (short username oryx)
I20260808 15:47:07.820202 16470 webserver.cc:460] Webserver started at http://127.8.39.66:38207/ using document root <none> and password file <none>
I20260808 15:47:07.820773 16470 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:07.820837 16470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:07.821061 16470 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:47:07.823199 16470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-1/data/instance:
uuid: "35c4340a499e4784a5f41ad4ae0340b8"
format_stamp: "Formatted at 2026-08-08 15:47:07 on dist-test-slave-8tdl"
server_key: "e871e1b16c530053bcad840fedd833f5"
server_key_iv: "2d5784c8bf4dc0c3b0e54126f4633861"
server_key_version: "encryptionkey@0"
I20260808 15:47:07.823781 16470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance:
uuid: "35c4340a499e4784a5f41ad4ae0340b8"
format_stamp: "Formatted at 2026-08-08 15:47:07 on dist-test-slave-8tdl"
server_key: "e871e1b16c530053bcad840fedd833f5"
server_key_iv: "2d5784c8bf4dc0c3b0e54126f4633861"
server_key_version: "encryptionkey@0"
I20260808 15:47:07.827864 16470 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 15:47:07.830381 16486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:07.831713 16470 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:47:07.831811 16470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "35c4340a499e4784a5f41ad4ae0340b8"
format_stamp: "Formatted at 2026-08-08 15:47:07 on dist-test-slave-8tdl"
server_key: "e871e1b16c530053bcad840fedd833f5"
server_key_iv: "2d5784c8bf4dc0c3b0e54126f4633861"
server_key_version: "encryptionkey@0"
I20260808 15:47:07.831952 16470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:07.842979 16470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:07.846312 16470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:07.846544 16470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:07.848204 16470 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:47:07.848280 16470 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:07.848352 16470 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:47:07.848403 16470 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 15:47:07 dist-test-slave-8tdl krb5kdc[16205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204027, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM
I20260808 15:47:07.860342 16470 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:40921
I20260808 15:47:07.860654 16604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:40921 every 8 connection(s)
I20260808 15:47:07.861382 16470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:47:07.863518 16300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:07.849218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:49661 (local address 127.8.39.126:41439)
0808 15:47:07.849355 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:07.849359 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:07.850433 (+ 1074us) server_negotiation.cc:407] Connection header received
0808 15:47:07.851612 (+ 1179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:07.851617 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:07.851691 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:07.851800 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:07.853391 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:07.854306 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:07.855734 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:07.855966 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:07.856090 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:07.859393 (+ 3303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:07.859400 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:07.859406 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:07.859445 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:07.861117 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:07.861761 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:07.861765 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:07.861767 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:07.861859 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:07.862246 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:07.862250 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:07.862251 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:07.862487 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:07.862609 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:07.863197 (+ 588us) server_negotiation.cc:299] Negotiation successful
0808 15:47:07.863332 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 15:47:07.864264 16495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:07.849766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41439 (local address 127.8.39.66:49661)
0808 15:47:07.850271 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:07.850316 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:07.851371 (+ 1055us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:07.851990 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:07.851998 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:07.852503 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:07.853200 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:07.853221 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:07.854447 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:07.854451 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:07.855611 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:07.855623 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:07.856148 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:07.856152 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:07.856328 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:07.856960 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:07.857002 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:07.859199 (+ 2197us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:07.861244 (+ 2045us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:07.861249 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:07.861264 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:07.861647 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:07.861958 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:07.861961 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:07.861963 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:07.862113 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:07.862605 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:07.862611 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:07.862934 (+ 323us) client_negotiation.cc:769] Sending connection context
0808 15:47:07.863131 (+ 197us) client_negotiation.cc:240] Negotiation successful
0808 15:47:07.863452 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":148,"threads_started":1}
I20260808 15:47:07.865549 16605 heartbeater.cc:347] Connected to a master server at 127.8.39.126:41439
I20260808 15:47:07.865707 16605 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:07.866209 16605 heartbeater.cc:511] Master 127.8.39.126:41439 requested a full tablet report, sending...
I20260808 15:47:07.867332 16250 ts_manager.cc:194] Registered new tserver with Master: 35c4340a499e4784a5f41ad4ae0340b8 (127.8.39.66:40921)
I20260808 15:47:07.868196 16250 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.39.66@KRBTEST.COM'} at 127.8.39.66:49661
I20260808 15:47:07.868268 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 16470
I20260808 15:47:07.868396 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance
I20260808 15:47:07.868786 8349 external_mini_cluster.cc:1428] Setting key c25bcb9b46792a799687ae25c7f219df
I20260808 15:47:07.875687 16300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:07.868094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:39677 (local address 127.8.39.126:41439)
0808 15:47:07.868202 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:07.868207 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:07.868482 (+ 275us) server_negotiation.cc:407] Connection header received
0808 15:47:07.868639 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:07.868642 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:07.868683 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:07.868772 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:07.869257 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:07.869994 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:07.871026 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:07.871244 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:07.871353 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:07.872445 (+ 1092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:07.872450 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:07.872458 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:07.872479 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:07.873890 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:07.874364 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:07.874368 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:07.874369 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:07.874450 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:07.874798 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:07.874801 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:07.874803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:07.875029 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:07.875161 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:07.875418 (+ 257us) server_negotiation.cc:299] Negotiation successful
0808 15:47:07.875528 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 15:47:07.875699 16611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:07.868024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41439 (local address 127.8.39.66:39677)
0808 15:47:07.868366 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:07.868417 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:07.868527 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:07.868788 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:07.868790 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:07.869009 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:07.869104 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:07.869131 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:07.870153 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:07.870156 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:07.870904 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:07.870914 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:07.871357 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:07.871361 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:07.871449 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:07.871978 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:07.871991 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:07.872297 (+ 306us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:07.874046 (+ 1749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:07.874049 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:07.874052 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:07.874252 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:07.874546 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:07.874550 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:07.874552 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:07.874647 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:07.875150 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:07.875153 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:07.875255 (+ 102us) client_negotiation.cc:769] Sending connection context
0808 15:47:07.875365 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 15:47:07.875524 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":105,"threads_started":1}
WARNING: no policy specified for oryx/127.8.39.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.39.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.39.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.67.keytab.
Entry for principal oryx/127.8.39.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.67.keytab.
I20260808 15:47:07.897297 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:0
--local_ip_for_outbound_sockets=127.8.39.67
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41439
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.67.keytab
--principal=oryx/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:37137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:47:08.012351 16614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:08.012665 16614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:08.012755 16614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:08.016973 16614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:08.017072 16614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:08.017144 16614 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 15:47:08.017230 16614 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:47:08.022639 16614 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:37137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.67.keytab
--principal=oryx/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.39.126:41439
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:08.023891 16614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:08.024958 16614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:08.034843 16620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:08.034973 16622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:08.034902 16619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:08.035177 16614 server_base.cc:1034] running on GCE node
I20260808 15:47:08.035676 16614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:08.036406 16614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:08.037597 16614 hybrid_clock.cc:648] HybridClock initialized: now 1786204028037574 us; error 41 us; skew 500 ppm
Aug 08 15:47:08 dist-test-slave-8tdl krb5kdc[16205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204028, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:47:08.040512 16614 init.cc:377] Logged in from keytab as oryx/127.8.39.67@KRBTEST.COM (short username oryx)
I20260808 15:47:08.041348 16614 webserver.cc:460] Webserver started at http://127.8.39.67:37021/ using document root <none> and password file <none>
I20260808 15:47:08.041891 16614 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:08.042021 16614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:08.042259 16614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:47:08.044370 16614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-2/data/instance:
uuid: "d13f0987f7054b72b940d1326216fa15"
format_stamp: "Formatted at 2026-08-08 15:47:08 on dist-test-slave-8tdl"
server_key: "03e05064a8a9516d4df58ae8e2bc4ae2"
server_key_iv: "4d99b07a8f97ed7f7815878cde3d83f5"
server_key_version: "encryptionkey@0"
I20260808 15:47:08.044960 16614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance:
uuid: "d13f0987f7054b72b940d1326216fa15"
format_stamp: "Formatted at 2026-08-08 15:47:08 on dist-test-slave-8tdl"
server_key: "03e05064a8a9516d4df58ae8e2bc4ae2"
server_key_iv: "4d99b07a8f97ed7f7815878cde3d83f5"
server_key_version: "encryptionkey@0"
I20260808 15:47:08.048738 16614 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260808 15:47:08.051206 16629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:08.052433 16614 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:47:08.052567 16614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "d13f0987f7054b72b940d1326216fa15"
format_stamp: "Formatted at 2026-08-08 15:47:08 on dist-test-slave-8tdl"
server_key: "03e05064a8a9516d4df58ae8e2bc4ae2"
server_key_iv: "4d99b07a8f97ed7f7815878cde3d83f5"
server_key_version: "encryptionkey@0"
I20260808 15:47:08.052680 16614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:08.066892 16614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:08.070351 16614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:08.070569 16614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:08.072113 16614 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:47:08.072188 16614 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:08.072255 16614 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:47:08.072300 16614 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 15:47:08 dist-test-slave-8tdl krb5kdc[16205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204028, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM
I20260808 15:47:08.084592 16614 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:35061
I20260808 15:47:08.084615 16750 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:35061 every 8 connection(s)
I20260808 15:47:08.085785 16614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:47:08.088096 16300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.073103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:40145 (local address 127.8.39.126:41439)
0808 15:47:08.073239 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:08.073243 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:08.074451 (+ 1208us) server_negotiation.cc:407] Connection header received
0808 15:47:08.075773 (+ 1322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:08.075777 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:08.075841 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:08.075945 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:08.077791 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.078722 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.080149 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.080582 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.080709 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.083863 (+ 3154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:08.083867 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:08.083870 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:08.083904 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:08.085862 (+ 1958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:08.086516 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:08.086521 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:08.086525 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:08.086627 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:08.087084 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:08.087086 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:08.087087 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:08.087265 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:08.087345 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:08.087803 (+ 458us) server_negotiation.cc:299] Negotiation successful
0808 15:47:08.087976 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 15:47:08.088845 16640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.073750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41439 (local address 127.8.39.67:40145)
0808 15:47:08.074270 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:08.074315 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:08.075519 (+ 1204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:08.076291 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:08.076301 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:08.076774 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:08.077544 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:08.077571 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.078888 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.078893 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:08.079997 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:08.080008 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.080798 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.080803 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:08.081089 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.081752 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:08.081768 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:08.083670 (+ 1902us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:08.085997 (+ 2327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:08.086003 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:08.086016 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:08.086384 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:08.086797 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:08.086801 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:08.086803 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:08.086980 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:08.087376 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:08.087382 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:08.087600 (+ 218us) client_negotiation.cc:769] Sending connection context
0808 15:47:08.087752 (+ 152us) client_negotiation.cc:240] Negotiation successful
0808 15:47:08.088014 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":138,"threads_started":1}
I20260808 15:47:08.090088 16751 heartbeater.cc:347] Connected to a master server at 127.8.39.126:41439
I20260808 15:47:08.090227 16751 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:08.090807 16751 heartbeater.cc:511] Master 127.8.39.126:41439 requested a full tablet report, sending...
I20260808 15:47:08.091979 16249 ts_manager.cc:194] Registered new tserver with Master: d13f0987f7054b72b940d1326216fa15 (127.8.39.67:35061)
I20260808 15:47:08.092763 16249 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.39.67@KRBTEST.COM'} at 127.8.39.67:40145
I20260808 15:47:08.095010 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 16614
I20260808 15:47:08.095155 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance
I20260808 15:47:08.095476 8349 external_mini_cluster.cc:1428] Setting key 29ca7a4e82837b4767dfa0c2c89660c8
I20260808 15:47:08.097872 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:47:08.100914 16757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.092530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41439 (local address 127.8.39.67:56851)
0808 15:47:08.092864 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:08.092880 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:08.092975 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:08.093271 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:08.093274 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:08.093480 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:08.093582 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:08.093588 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.094552 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.094555 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:08.095447 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:08.095457 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.096136 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.096140 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:08.096235 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.096806 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:08.096820 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:08.097265 (+ 445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:08.099203 (+ 1938us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:08.099210 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:08.099216 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:08.099530 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:08.099802 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:08.099808 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:08.099813 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:08.099938 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:08.100360 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:08.100367 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:08.100506 (+ 139us) client_negotiation.cc:769] Sending connection context
0808 15:47:08.100647 (+ 141us) client_negotiation.cc:240] Negotiation successful
0808 15:47:08.100767 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":100,"threads_started":1}
I20260808 15:47:08.101071 16300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.092624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:56851 (local address 127.8.39.126:41439)
0808 15:47:08.092737 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:08.092743 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:08.092937 (+ 194us) server_negotiation.cc:407] Connection header received
0808 15:47:08.093071 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:08.093076 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:08.093124 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:08.093246 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:08.093696 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.094422 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.095654 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.096001 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.096122 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.097401 (+ 1279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:08.097415 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:08.097418 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:08.097446 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:08.099088 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:08.099633 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:08.099635 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:08.099637 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:08.099708 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:08.100069 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:08.100072 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:08.100073 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:08.100251 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:08.100341 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:08.100738 (+ 397us) server_negotiation.cc:299] Negotiation successful
0808 15:47:08.100873 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
Aug 08 15:47:08 dist-test-slave-8tdl krb5kdc[16205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204028, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 15:47:08 dist-test-slave-8tdl krb5kdc[16205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:08 dist-test-slave-8tdl krb5kdc[16205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 15:47:08.125622 16300 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:08.119080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33020 (local address 127.8.39.126:41439)
0808 15:47:08.119237 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:08.119244 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:08.119263 (+ 19us) server_negotiation.cc:407] Connection header received
0808 15:47:08.119314 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:08.119317 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:08.119366 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:08.119476 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:08.120232 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.120777 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.121688 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.121911 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.122023 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.125456 (+ 3433us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33020: BlockingRecv error: recv got EOF from 127.0.0.1:33020 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 08 15:47:08 dist-test-slave-8tdl krb5kdc[16205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204028, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM
I20260808 15:47:08.136055 16300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.127253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33032 (local address 127.8.39.126:41439)
0808 15:47:08.127371 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:08.127375 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:08.127524 (+ 149us) server_negotiation.cc:407] Connection header received
0808 15:47:08.127621 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:08.127623 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:08.127662 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:08.127764 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:08.128486 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.129075 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.129913 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.130121 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.130203 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.132799 (+ 2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:08.132802 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:08.132804 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:08.132827 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:08.134186 (+ 1359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:08.134599 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:08.134601 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:08.134602 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:08.134852 (+ 250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:08.135218 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:08.135220 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:08.135221 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:08.135421 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:08.135527 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:08.135787 (+ 260us) server_negotiation.cc:299] Negotiation successful
0808 15:47:08.135928 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 15:47:08.139823 16249 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33032:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:47:08.142988 16249 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:47:08.158808 16781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.152693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60034 (local address 127.8.39.65:35353)
0808 15:47:08.153328 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:08.153334 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:08.153641 (+ 307us) server_negotiation.cc:407] Connection header received
0808 15:47:08.153720 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:08.153724 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:08.153902 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:08.154053 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:47:08.154337 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.155503 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.157260 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.157997 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.158120 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.158332 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:08.158524 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 15:47:08.158627 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":85,"threads_started":1}
I20260808 15:47:08.158809 16777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.152240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:35353 (local address 127.0.0.1:60034)
0808 15:47:08.153426 (+ 1186us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:08.153437 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:08.153548 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:08.154052 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:08.154056 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:08.154081 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:47:08.154203 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:08.154210 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.155627 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.155630 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:08.157099 (+ 1469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:08.157106 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.158122 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.158126 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:08.158298 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.158349 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 15:47:08.158493 (+ 144us) client_negotiation.cc:240] Negotiation successful
0808 15:47:08.158627 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1121,"mutex_wait_us":225,"thread_start_us":128,"threads_started":1}
I20260808 15:47:08.159353 16779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.151978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:40921 (local address 127.0.0.1:39324)
0808 15:47:08.153130 (+ 1152us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:08.153145 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:08.153235 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:08.153800 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:08.153804 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:08.153825 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:47:08.153953 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:08.153968 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.155297 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.155305 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:08.156793 (+ 1488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:08.156805 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.158386 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.158390 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:08.158553 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.158646 (+ 93us) client_negotiation.cc:769] Sending connection context
0808 15:47:08.158752 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 15:47:08.158856 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1087,"mutex_wait_us":48,"thread_start_us":95,"threads_started":1}
I20260808 15:47:08.159790 16778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.151946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37954 (local address 127.8.39.67:35061)
0808 15:47:08.152447 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:08.152464 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:08.153046 (+ 582us) server_negotiation.cc:407] Connection header received
0808 15:47:08.153137 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:08.153145 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:08.153379 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:08.153546 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:47:08.153860 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.155483 (+ 1623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.157114 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.158032 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.158134 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.158307 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:08.159425 (+ 1118us) server_negotiation.cc:299] Negotiation successful
0808 15:47:08.159635 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":132,"threads_started":1}
I20260808 15:47:08.159804 16780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.152653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39324 (local address 127.8.39.66:40921)
0808 15:47:08.153106 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:08.153118 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:08.153347 (+ 229us) server_negotiation.cc:407] Connection header received
0808 15:47:08.153438 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:08.153446 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:08.153633 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:08.153821 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:47:08.154133 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.155169 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.156933 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.157999 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.158123 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.158307 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:08.159561 (+ 1254us) server_negotiation.cc:299] Negotiation successful
0808 15:47:08.159658 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":113,"threads_started":1}
I20260808 15:47:08.160266 16775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.151786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:35061 (local address 127.0.0.1:37954)
0808 15:47:08.152647 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:08.152702 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:08.152874 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:08.153548 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:08.153554 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:08.153576 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:47:08.153728 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:08.153735 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.155627 (+ 1892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.155630 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:08.156978 (+ 1348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:08.156989 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.158386 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.158390 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:08.158586 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.158654 (+ 68us) client_negotiation.cc:769] Sending connection context
0808 15:47:08.158791 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 15:47:08.158856 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":686,"mutex_wait_us":131,"thread_start_us":91,"threads_started":1}
I20260808 15:47:08.162091 16390 tablet_service.cc:1467] Processing CreateTablet for tablet efa63392cab34dd9910e70806a35d98b (DEFAULT_TABLE table=test-table [id=e1809efcdd2e403b8d62c0923aff3954]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:47:08.162590 16538 tablet_service.cc:1467] Processing CreateTablet for tablet efa63392cab34dd9910e70806a35d98b (DEFAULT_TABLE table=test-table [id=e1809efcdd2e403b8d62c0923aff3954]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:47:08.163368 16390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efa63392cab34dd9910e70806a35d98b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:08.163077 16683 tablet_service.cc:1467] Processing CreateTablet for tablet efa63392cab34dd9910e70806a35d98b (DEFAULT_TABLE table=test-table [id=e1809efcdd2e403b8d62c0923aff3954]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:47:08.163748 16538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efa63392cab34dd9910e70806a35d98b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:08.164022 16683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efa63392cab34dd9910e70806a35d98b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:08.171151 16782 tablet_bootstrap.cc:492] T efa63392cab34dd9910e70806a35d98b P 0bd01d96196949bbb7303b7d4d722d69: Bootstrap starting.
I20260808 15:47:08.172077 16783 tablet_bootstrap.cc:492] T efa63392cab34dd9910e70806a35d98b P d13f0987f7054b72b940d1326216fa15: Bootstrap starting.
I20260808 15:47:08.172171 16784 tablet_bootstrap.cc:492] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8: Bootstrap starting.
I20260808 15:47:08.174911 16784 tablet_bootstrap.cc:654] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:08.176093 16784 log.cc:824] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8: Log is configured to *not* fsync() on all Append() calls
I20260808 15:47:08.177281 16782 tablet_bootstrap.cc:654] T efa63392cab34dd9910e70806a35d98b P 0bd01d96196949bbb7303b7d4d722d69: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:08.177688 16783 tablet_bootstrap.cc:654] T efa63392cab34dd9910e70806a35d98b P d13f0987f7054b72b940d1326216fa15: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:08.178241 16782 log.cc:824] T efa63392cab34dd9910e70806a35d98b P 0bd01d96196949bbb7303b7d4d722d69: Log is configured to *not* fsync() on all Append() calls
I20260808 15:47:08.178459 16783 log.cc:824] T efa63392cab34dd9910e70806a35d98b P d13f0987f7054b72b940d1326216fa15: Log is configured to *not* fsync() on all Append() calls
I20260808 15:47:08.178655 16784 tablet_bootstrap.cc:492] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8: No bootstrap required, opened a new log
I20260808 15:47:08.178990 16784 ts_tablet_manager.cc:1397] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.006s
I20260808 15:47:08.180538 16783 tablet_bootstrap.cc:492] T efa63392cab34dd9910e70806a35d98b P d13f0987f7054b72b940d1326216fa15: No bootstrap required, opened a new log
I20260808 15:47:08.180537 16782 tablet_bootstrap.cc:492] T efa63392cab34dd9910e70806a35d98b P 0bd01d96196949bbb7303b7d4d722d69: No bootstrap required, opened a new log
I20260808 15:47:08.180735 16782 ts_tablet_manager.cc:1397] T efa63392cab34dd9910e70806a35d98b P 0bd01d96196949bbb7303b7d4d722d69: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20260808 15:47:08.180735 16783 ts_tablet_manager.cc:1397] T efa63392cab34dd9910e70806a35d98b P d13f0987f7054b72b940d1326216fa15: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.002s
I20260808 15:47:08.183007 16784 raft_consensus.cc:348] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } }
I20260808 15:47:08.183328 16784 raft_consensus.cc:374] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:08.183403 16784 raft_consensus.cc:729] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35c4340a499e4784a5f41ad4ae0340b8, State: Initialized, Role: FOLLOWER
I20260808 15:47:08.183898 16784 consensus_queue.cc:260] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } }
I20260808 15:47:08.184659 16605 heartbeater.cc:503] Master 127.8.39.126:41439 was elected leader, sending a full tablet report...
I20260808 15:47:08.184880 16783 raft_consensus.cc:348] T efa63392cab34dd9910e70806a35d98b P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } }
I20260808 15:47:08.185091 16784 ts_tablet_manager.cc:1428] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8: Time spent starting tablet: real 0.006s user 0.004s sys 0.002s
I20260808 15:47:08.185145 16783 raft_consensus.cc:374] T efa63392cab34dd9910e70806a35d98b P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:08.185197 16783 raft_consensus.cc:729] T efa63392cab34dd9910e70806a35d98b P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d13f0987f7054b72b940d1326216fa15, State: Initialized, Role: FOLLOWER
I20260808 15:47:08.185312 16782 raft_consensus.cc:348] T efa63392cab34dd9910e70806a35d98b P 0bd01d96196949bbb7303b7d4d722d69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } }
I20260808 15:47:08.185555 16782 raft_consensus.cc:374] T efa63392cab34dd9910e70806a35d98b P 0bd01d96196949bbb7303b7d4d722d69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:08.185603 16782 raft_consensus.cc:729] T efa63392cab34dd9910e70806a35d98b P 0bd01d96196949bbb7303b7d4d722d69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bd01d96196949bbb7303b7d4d722d69, State: Initialized, Role: FOLLOWER
I20260808 15:47:08.185663 16783 consensus_queue.cc:260] T efa63392cab34dd9910e70806a35d98b P d13f0987f7054b72b940d1326216fa15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } }
I20260808 15:47:08.186033 16782 consensus_queue.cc:260] T efa63392cab34dd9910e70806a35d98b P 0bd01d96196949bbb7303b7d4d722d69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } }
I20260808 15:47:08.186446 16751 heartbeater.cc:503] Master 127.8.39.126:41439 was elected leader, sending a full tablet report...
I20260808 15:47:08.186964 16782 ts_tablet_manager.cc:1428] T efa63392cab34dd9910e70806a35d98b P 0bd01d96196949bbb7303b7d4d722d69: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 15:47:08.187667 16783 ts_tablet_manager.cc:1428] T efa63392cab34dd9910e70806a35d98b P d13f0987f7054b72b940d1326216fa15: Time spent starting tablet: real 0.007s user 0.005s sys 0.002s
I20260808 15:47:08.188112 16461 heartbeater.cc:503] Master 127.8.39.126:41439 was elected leader, sending a full tablet report...
I20260808 15:47:08.211305 16788 raft_consensus.cc:482] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:47:08.211522 16788 raft_consensus.cc:504] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } }
I20260808 15:47:08.212692 16788 leader_election.cc:288] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d13f0987f7054b72b940d1326216fa15 (127.8.39.67:35061), 0bd01d96196949bbb7303b7d4d722d69 (127.8.39.65:35353)
I20260808 15:47:08.217272 16495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.213078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:35353 (local address 127.8.39.66:34309)
0808 15:47:08.213202 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:08.213220 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:08.213350 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:08.213757 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:08.213760 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:08.213780 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:47:08.213920 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:08.213928 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.215098 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.215102 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:08.215975 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:08.215985 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.216749 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.216752 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:08.216910 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.216929 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 15:47:08.217028 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 15:47:08.217111 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":38}
I20260808 15:47:08.217272 16781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.213349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:34309 (local address 127.8.39.65:35353)
0808 15:47:08.213506 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:08.213510 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:08.213524 (+ 14us) server_negotiation.cc:407] Connection header received
0808 15:47:08.213577 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:08.213580 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:08.213624 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:08.213736 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:47:08.214081 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.214968 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.216119 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.216611 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.216744 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.216812 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:08.217062 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 15:47:08.217143 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 15:47:08.218075 16412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa63392cab34dd9910e70806a35d98b" candidate_uuid: "35c4340a499e4784a5f41ad4ae0340b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd01d96196949bbb7303b7d4d722d69" is_pre_election: true
I20260808 15:47:08.218207 16778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.213184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:48169 (local address 127.8.39.67:35061)
0808 15:47:08.213331 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:08.213351 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:08.214120 (+ 769us) server_negotiation.cc:407] Connection header received
0808 15:47:08.214279 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:08.214283 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:08.214342 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:08.214428 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:47:08.215287 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.215865 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.217029 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.217634 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.217761 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.217835 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:08.218041 (+ 206us) server_negotiation.cc:299] Negotiation successful
0808 15:47:08.218101 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 15:47:08.218268 16791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.213077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:35061 (local address 127.8.39.66:48169)
0808 15:47:08.214001 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:08.214018 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:08.214154 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:08.214474 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:08.214477 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:08.214500 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:47:08.215146 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:08.215157 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.215998 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.216005 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:08.216892 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:08.216901 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.217794 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.217798 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:08.217905 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.217929 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 15:47:08.218019 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 15:47:08.218094 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":843,"mutex_wait_us":366,"thread_start_us":178,"threads_started":1}
I20260808 15:47:08.218485 16412 raft_consensus.cc:2454] T efa63392cab34dd9910e70806a35d98b P 0bd01d96196949bbb7303b7d4d722d69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35c4340a499e4784a5f41ad4ae0340b8 in term 0.
I20260808 15:47:08.219101 16704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa63392cab34dd9910e70806a35d98b" candidate_uuid: "35c4340a499e4784a5f41ad4ae0340b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d13f0987f7054b72b940d1326216fa15" is_pre_election: true
I20260808 15:47:08.219163 16487 leader_election.cc:302] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd01d96196949bbb7303b7d4d722d69, 35c4340a499e4784a5f41ad4ae0340b8; no voters:
I20260808 15:47:08.219460 16704 raft_consensus.cc:2454] T efa63392cab34dd9910e70806a35d98b P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35c4340a499e4784a5f41ad4ae0340b8 in term 0.
I20260808 15:47:08.219483 16788 raft_consensus.cc:2781] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:47:08.219579 16788 raft_consensus.cc:482] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:47:08.219630 16788 raft_consensus.cc:3037] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:08.220947 16788 raft_consensus.cc:504] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } }
I20260808 15:47:08.221339 16788 leader_election.cc:288] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8 [CANDIDATE]: Term 1 election: Requested vote from peers d13f0987f7054b72b940d1326216fa15 (127.8.39.67:35061), 0bd01d96196949bbb7303b7d4d722d69 (127.8.39.65:35353)
I20260808 15:47:08.221688 16704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa63392cab34dd9910e70806a35d98b" candidate_uuid: "35c4340a499e4784a5f41ad4ae0340b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d13f0987f7054b72b940d1326216fa15"
I20260808 15:47:08.221858 16704 raft_consensus.cc:3037] T efa63392cab34dd9910e70806a35d98b P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:08.221937 16412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa63392cab34dd9910e70806a35d98b" candidate_uuid: "35c4340a499e4784a5f41ad4ae0340b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd01d96196949bbb7303b7d4d722d69"
I20260808 15:47:08.222105 16412 raft_consensus.cc:3037] T efa63392cab34dd9910e70806a35d98b P 0bd01d96196949bbb7303b7d4d722d69 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:08.223147 16704 raft_consensus.cc:2454] T efa63392cab34dd9910e70806a35d98b P d13f0987f7054b72b940d1326216fa15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35c4340a499e4784a5f41ad4ae0340b8 in term 1.
I20260808 15:47:08.223479 16490 leader_election.cc:302] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35c4340a499e4784a5f41ad4ae0340b8, d13f0987f7054b72b940d1326216fa15; no voters:
I20260808 15:47:08.223598 16412 raft_consensus.cc:2454] T efa63392cab34dd9910e70806a35d98b P 0bd01d96196949bbb7303b7d4d722d69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35c4340a499e4784a5f41ad4ae0340b8 in term 1.
I20260808 15:47:08.223683 16788 raft_consensus.cc:2781] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:47:08.223974 16788 raft_consensus.cc:686] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8 [term 1 LEADER]: Becoming Leader. State: Replica: 35c4340a499e4784a5f41ad4ae0340b8, State: Running, Role: LEADER
I20260808 15:47:08.224344 16788 consensus_queue.cc:237] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } }
I20260808 15:47:08.228099 16248 catalog_manager.cc:5495] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35c4340a499e4784a5f41ad4ae0340b8 (127.8.39.66). New cstate: current_term: 1 leader_uuid: "35c4340a499e4784a5f41ad4ae0340b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } health_report { overall_health: UNKNOWN } } }
I20260808 15:47:08.259074 16780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.255385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39326 (local address 127.8.39.66:40921)
0808 15:47:08.255517 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:08.255521 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:08.255534 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:47:08.255608 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:08.255610 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:08.255665 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:08.255787 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:47:08.255962 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.256557 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.257476 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.257771 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.257892 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.258154 (+ 262us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:47:08.258633 (+ 479us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:47:08.258798 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:08.258871 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 15:47:08.258930 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 15:47:08.265117 16412 raft_consensus.cc:1261] T efa63392cab34dd9910e70806a35d98b P 0bd01d96196949bbb7303b7d4d722d69 [term 1 FOLLOWER]: Refusing update from remote peer 35c4340a499e4784a5f41ad4ae0340b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:47:08.265486 16704 raft_consensus.cc:1261] T efa63392cab34dd9910e70806a35d98b P d13f0987f7054b72b940d1326216fa15 [term 1 FOLLOWER]: Refusing update from remote peer 35c4340a499e4784a5f41ad4ae0340b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:47:08.265945 16792 consensus_queue.cc:1035] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:47:08.266158 16788 consensus_queue.cc:1035] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:47:08.273605 16795 mvcc.cc:205] Tried to move back new op lower bound from 7316291699766505472 to 7316291699609653248. Current Snapshot: MvccSnapshot[applied={T|T < 7316291699766505472}]
I20260808 15:47:08.274932 16797 mvcc.cc:205] Tried to move back new op lower bound from 7316291699766505472 to 7316291699609653248. Current Snapshot: MvccSnapshot[applied={T|T < 7316291699766505472}]
I20260808 15:47:08.279038 16796 mvcc.cc:205] Tried to move back new op lower bound from 7316291699766505472 to 7316291699609653248. Current Snapshot: MvccSnapshot[applied={T|T < 7316291699766505472}]
I20260808 15:47:08.282462 16250 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33032:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:47:08.282639 16250 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33032:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:47:08.285256 16250 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26: Sending DeleteTablet for 3 replicas of tablet efa63392cab34dd9910e70806a35d98b
I20260808 15:47:08.286094 16683 tablet_service.cc:1514] Processing DeleteTablet for tablet efa63392cab34dd9910e70806a35d98b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:47:08 UTC) from {username='oryx', principal='oryx/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:37954
I20260808 15:47:08.286105 16390 tablet_service.cc:1514] Processing DeleteTablet for tablet efa63392cab34dd9910e70806a35d98b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:47:08 UTC) from {username='oryx', principal='oryx/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:60034
I20260808 15:47:08.286614 16538 tablet_service.cc:1514] Processing DeleteTablet for tablet efa63392cab34dd9910e70806a35d98b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:47:08 UTC) from {username='oryx', principal='oryx/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:39324
I20260808 15:47:08.286841 16805 tablet_replica.cc:330] T efa63392cab34dd9910e70806a35d98b P d13f0987f7054b72b940d1326216fa15: stopping tablet replica
I20260808 15:47:08.287140 16806 tablet_replica.cc:330] T efa63392cab34dd9910e70806a35d98b P 0bd01d96196949bbb7303b7d4d722d69: stopping tablet replica
I20260808 15:47:08.287091 16248 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33032:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 15:47:08.287431 16805 raft_consensus.cc:2229] T efa63392cab34dd9910e70806a35d98b P d13f0987f7054b72b940d1326216fa15 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:47:08.287431 16806 raft_consensus.cc:2229] T efa63392cab34dd9910e70806a35d98b P 0bd01d96196949bbb7303b7d4d722d69 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260808 15:47:08.287531 16248 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:47:08.287849 16805 raft_consensus.cc:2258] T efa63392cab34dd9910e70806a35d98b P d13f0987f7054b72b940d1326216fa15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:47:08.287977 16807 tablet_replica.cc:330] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8: stopping tablet replica
I20260808 15:47:08.288241 16807 raft_consensus.cc:2229] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:47:08.288617 16807 raft_consensus.cc:2258] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:47:08.288955 16806 raft_consensus.cc:2258] T efa63392cab34dd9910e70806a35d98b P 0bd01d96196949bbb7303b7d4d722d69 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:47:08.289520 16805 ts_tablet_manager.cc:1905] T efa63392cab34dd9910e70806a35d98b P d13f0987f7054b72b940d1326216fa15: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:47:08.290556 16807 ts_tablet_manager.cc:1905] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:47:08.291652 16806 ts_tablet_manager.cc:1905] T efa63392cab34dd9910e70806a35d98b P 0bd01d96196949bbb7303b7d4d722d69: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:47:08.292503 16805 ts_tablet_manager.cc:1918] T efa63392cab34dd9910e70806a35d98b P d13f0987f7054b72b940d1326216fa15: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:47:08.292601 16805 log.cc:1196] T efa63392cab34dd9910e70806a35d98b P d13f0987f7054b72b940d1326216fa15: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/efa63392cab34dd9910e70806a35d98b
I20260808 15:47:08.292932 16805 ts_tablet_manager.cc:1939] T efa63392cab34dd9910e70806a35d98b P d13f0987f7054b72b940d1326216fa15: Deleting consensus metadata
I20260808 15:47:08.293689 16390 tablet_service.cc:1467] Processing CreateTablet for tablet 3da0114cb7c24c41b8a49deea202eb17 (DEFAULT_TABLE table=test-table [id=c0a668eb1e834975b929dad4085427a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:47:08.293948 16390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3da0114cb7c24c41b8a49deea202eb17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:08.295086 16538 tablet_service.cc:1467] Processing CreateTablet for tablet 3da0114cb7c24c41b8a49deea202eb17 (DEFAULT_TABLE table=test-table [id=c0a668eb1e834975b929dad4085427a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:47:08.295320 16538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3da0114cb7c24c41b8a49deea202eb17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:08.296022 16807 ts_tablet_manager.cc:1918] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:47:08.296106 16807 log.cc:1196] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-1/wal/wals/efa63392cab34dd9910e70806a35d98b
I20260808 15:47:08.296453 16807 ts_tablet_manager.cc:1939] T efa63392cab34dd9910e70806a35d98b P 35c4340a499e4784a5f41ad4ae0340b8: Deleting consensus metadata
I20260808 15:47:08.297559 16784 tablet_bootstrap.cc:492] T 3da0114cb7c24c41b8a49deea202eb17 P 35c4340a499e4784a5f41ad4ae0340b8: Bootstrap starting.
I20260808 15:47:08.297610 16782 tablet_bootstrap.cc:492] T 3da0114cb7c24c41b8a49deea202eb17 P 0bd01d96196949bbb7303b7d4d722d69: Bootstrap starting.
I20260808 15:47:08.298475 16236 catalog_manager.cc:4841] TS 35c4340a499e4784a5f41ad4ae0340b8 (127.8.39.66:40921): tablet efa63392cab34dd9910e70806a35d98b (table test-table [id=e1809efcdd2e403b8d62c0923aff3954]) successfully deleted
I20260808 15:47:08.298631 16782 tablet_bootstrap.cc:654] T 3da0114cb7c24c41b8a49deea202eb17 P 0bd01d96196949bbb7303b7d4d722d69: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:08.298736 16806 ts_tablet_manager.cc:1918] T efa63392cab34dd9910e70806a35d98b P 0bd01d96196949bbb7303b7d4d722d69: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:47:08.298831 16806 log.cc:1196] T efa63392cab34dd9910e70806a35d98b P 0bd01d96196949bbb7303b7d4d722d69: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-0/wal/wals/efa63392cab34dd9910e70806a35d98b
I20260808 15:47:08.299104 16784 tablet_bootstrap.cc:654] T 3da0114cb7c24c41b8a49deea202eb17 P 35c4340a499e4784a5f41ad4ae0340b8: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:08.299167 16806 ts_tablet_manager.cc:1939] T efa63392cab34dd9910e70806a35d98b P 0bd01d96196949bbb7303b7d4d722d69: Deleting consensus metadata
I20260808 15:47:08.299793 16237 catalog_manager.cc:4841] TS d13f0987f7054b72b940d1326216fa15 (127.8.39.67:35061): tablet efa63392cab34dd9910e70806a35d98b (table test-table [id=e1809efcdd2e403b8d62c0923aff3954]) successfully deleted
I20260808 15:47:08.300414 16234 catalog_manager.cc:4841] TS 0bd01d96196949bbb7303b7d4d722d69 (127.8.39.65:35353): tablet efa63392cab34dd9910e70806a35d98b (table test-table [id=e1809efcdd2e403b8d62c0923aff3954]) successfully deleted
I20260808 15:47:08.300913 16782 tablet_bootstrap.cc:492] T 3da0114cb7c24c41b8a49deea202eb17 P 0bd01d96196949bbb7303b7d4d722d69: No bootstrap required, opened a new log
I20260808 15:47:08.301002 16782 ts_tablet_manager.cc:1397] T 3da0114cb7c24c41b8a49deea202eb17 P 0bd01d96196949bbb7303b7d4d722d69: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 15:47:08.301048 16683 tablet_service.cc:1467] Processing CreateTablet for tablet 3da0114cb7c24c41b8a49deea202eb17 (DEFAULT_TABLE table=test-table [id=c0a668eb1e834975b929dad4085427a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:47:08.301347 16683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3da0114cb7c24c41b8a49deea202eb17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:08.301700 16782 raft_consensus.cc:348] T 3da0114cb7c24c41b8a49deea202eb17 P 0bd01d96196949bbb7303b7d4d722d69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:08.301822 16782 raft_consensus.cc:374] T 3da0114cb7c24c41b8a49deea202eb17 P 0bd01d96196949bbb7303b7d4d722d69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:08.301852 16782 raft_consensus.cc:729] T 3da0114cb7c24c41b8a49deea202eb17 P 0bd01d96196949bbb7303b7d4d722d69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bd01d96196949bbb7303b7d4d722d69, State: Initialized, Role: FOLLOWER
I20260808 15:47:08.302001 16782 consensus_queue.cc:260] T 3da0114cb7c24c41b8a49deea202eb17 P 0bd01d96196949bbb7303b7d4d722d69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:08.302332 16782 ts_tablet_manager.cc:1428] T 3da0114cb7c24c41b8a49deea202eb17 P 0bd01d96196949bbb7303b7d4d722d69: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260808 15:47:08.303593 16783 tablet_bootstrap.cc:492] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15: Bootstrap starting.
I20260808 15:47:08.304649 16783 tablet_bootstrap.cc:654] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:08.305684 16784 tablet_bootstrap.cc:492] T 3da0114cb7c24c41b8a49deea202eb17 P 35c4340a499e4784a5f41ad4ae0340b8: No bootstrap required, opened a new log
I20260808 15:47:08.305805 16784 ts_tablet_manager.cc:1397] T 3da0114cb7c24c41b8a49deea202eb17 P 35c4340a499e4784a5f41ad4ae0340b8: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s
I20260808 15:47:08.305848 16783 tablet_bootstrap.cc:492] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15: No bootstrap required, opened a new log
I20260808 15:47:08.305934 16783 ts_tablet_manager.cc:1397] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260808 15:47:08.306252 16784 raft_consensus.cc:348] T 3da0114cb7c24c41b8a49deea202eb17 P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:08.306389 16784 raft_consensus.cc:374] T 3da0114cb7c24c41b8a49deea202eb17 P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:08.306352 16783 raft_consensus.cc:348] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:08.306432 16784 raft_consensus.cc:729] T 3da0114cb7c24c41b8a49deea202eb17 P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35c4340a499e4784a5f41ad4ae0340b8, State: Initialized, Role: FOLLOWER
I20260808 15:47:08.306450 16783 raft_consensus.cc:374] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:08.306481 16783 raft_consensus.cc:729] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d13f0987f7054b72b940d1326216fa15, State: Initialized, Role: FOLLOWER
I20260808 15:47:08.306581 16784 consensus_queue.cc:260] T 3da0114cb7c24c41b8a49deea202eb17 P 35c4340a499e4784a5f41ad4ae0340b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:08.306623 16783 consensus_queue.cc:260] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:08.306900 16784 ts_tablet_manager.cc:1428] T 3da0114cb7c24c41b8a49deea202eb17 P 35c4340a499e4784a5f41ad4ae0340b8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:47:08.308159 16783 ts_tablet_manager.cc:1428] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260808 15:47:08.336961 16752 tablet.cc:2369] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:47:08.363013 16606 tablet.cc:2369] T 3da0114cb7c24c41b8a49deea202eb17 P 35c4340a499e4784a5f41ad4ae0340b8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:47:08.375785 16462 tablet.cc:2369] T 3da0114cb7c24c41b8a49deea202eb17 P 0bd01d96196949bbb7303b7d4d722d69: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:47:08.496347 16789 raft_consensus.cc:482] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:47:08.496510 16789 raft_consensus.cc:504] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:08.497532 16789 leader_election.cc:288] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bd01d96196949bbb7303b7d4d722d69 (127.8.39.65:35353), 35c4340a499e4784a5f41ad4ae0340b8 (127.8.39.66:40921)
I20260808 15:47:08.502494 16640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.497788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:35353 (local address 127.8.39.67:34593)
0808 15:47:08.497928 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:08.497941 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:08.498065 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:08.498432 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:08.498438 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:08.498456 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:47:08.498591 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:08.498596 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.499667 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.499669 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:08.501011 (+ 1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:08.501022 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.501937 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.501942 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:08.502086 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.502135 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 15:47:08.502218 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 15:47:08.502327 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":51}
I20260808 15:47:08.502506 16780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.497915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:59557 (local address 127.8.39.66:40921)
0808 15:47:08.498069 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:08.498074 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:08.498372 (+ 298us) server_negotiation.cc:407] Connection header received
0808 15:47:08.498549 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:08.498552 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:08.498596 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:08.498681 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:47:08.498968 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.499677 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.501163 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.501794 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.501922 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.501986 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:08.502288 (+ 302us) server_negotiation.cc:299] Negotiation successful
0808 15:47:08.502377 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 15:47:08.502506 16781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.498015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:34593 (local address 127.8.39.65:35353)
0808 15:47:08.498160 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:08.498164 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:08.498181 (+ 17us) server_negotiation.cc:407] Connection header received
0808 15:47:08.498241 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:08.498250 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:08.498291 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:08.498389 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:47:08.498739 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.499556 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.501163 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.501816 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.501916 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.501984 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:08.502288 (+ 304us) server_negotiation.cc:299] Negotiation successful
0808 15:47:08.502378 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 15:47:08.502506 16811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.497788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:40921 (local address 127.8.39.67:59557)
0808 15:47:08.498271 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:08.498282 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:08.498407 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:08.498734 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:08.498737 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:08.498761 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:47:08.498855 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:08.498859 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.499783 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.499786 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:08.501031 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:08.501037 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.501945 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.501948 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:08.502119 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.502140 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 15:47:08.502218 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 15:47:08.502324 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":430,"mutex_wait_us":287,"thread_start_us":94,"threads_started":1}
I20260808 15:47:08.503211 16410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3da0114cb7c24c41b8a49deea202eb17" candidate_uuid: "d13f0987f7054b72b940d1326216fa15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd01d96196949bbb7303b7d4d722d69" is_pre_election: true
I20260808 15:47:08.503386 16410 raft_consensus.cc:2454] T 3da0114cb7c24c41b8a49deea202eb17 P 0bd01d96196949bbb7303b7d4d722d69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d13f0987f7054b72b940d1326216fa15 in term 0.
I20260808 15:47:08.503432 16559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3da0114cb7c24c41b8a49deea202eb17" candidate_uuid: "d13f0987f7054b72b940d1326216fa15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c4340a499e4784a5f41ad4ae0340b8" is_pre_election: true
I20260808 15:47:08.503726 16559 raft_consensus.cc:2454] T 3da0114cb7c24c41b8a49deea202eb17 P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d13f0987f7054b72b940d1326216fa15 in term 0.
I20260808 15:47:08.503821 16630 leader_election.cc:302] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd01d96196949bbb7303b7d4d722d69, d13f0987f7054b72b940d1326216fa15; no voters:
I20260808 15:47:08.504115 16789 raft_consensus.cc:2781] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:47:08.504189 16789 raft_consensus.cc:482] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:47:08.504227 16789 raft_consensus.cc:3037] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:08.505308 16789 raft_consensus.cc:504] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:08.505659 16789 leader_election.cc:288] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15 [CANDIDATE]: Term 1 election: Requested vote from peers 0bd01d96196949bbb7303b7d4d722d69 (127.8.39.65:35353), 35c4340a499e4784a5f41ad4ae0340b8 (127.8.39.66:40921)
I20260808 15:47:08.505992 16410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3da0114cb7c24c41b8a49deea202eb17" candidate_uuid: "d13f0987f7054b72b940d1326216fa15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd01d96196949bbb7303b7d4d722d69"
I20260808 15:47:08.506023 16559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3da0114cb7c24c41b8a49deea202eb17" candidate_uuid: "d13f0987f7054b72b940d1326216fa15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c4340a499e4784a5f41ad4ae0340b8"
I20260808 15:47:08.506100 16410 raft_consensus.cc:3037] T 3da0114cb7c24c41b8a49deea202eb17 P 0bd01d96196949bbb7303b7d4d722d69 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:08.506158 16559 raft_consensus.cc:3037] T 3da0114cb7c24c41b8a49deea202eb17 P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:08.507280 16410 raft_consensus.cc:2454] T 3da0114cb7c24c41b8a49deea202eb17 P 0bd01d96196949bbb7303b7d4d722d69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d13f0987f7054b72b940d1326216fa15 in term 1.
I20260808 15:47:08.507288 16559 raft_consensus.cc:2454] T 3da0114cb7c24c41b8a49deea202eb17 P 35c4340a499e4784a5f41ad4ae0340b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d13f0987f7054b72b940d1326216fa15 in term 1.
I20260808 15:47:08.507570 16630 leader_election.cc:302] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd01d96196949bbb7303b7d4d722d69, d13f0987f7054b72b940d1326216fa15; no voters:
I20260808 15:47:08.507766 16789 raft_consensus.cc:2781] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:47:08.507973 16789 raft_consensus.cc:686] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15 [term 1 LEADER]: Becoming Leader. State: Replica: d13f0987f7054b72b940d1326216fa15, State: Running, Role: LEADER
I20260808 15:47:08.508251 16789 consensus_queue.cc:237] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:08.510735 16250 catalog_manager.cc:5495] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15 reported cstate change: term changed from 0 to 1, leader changed from <none> to d13f0987f7054b72b940d1326216fa15 (127.8.39.67). New cstate: current_term: 1 leader_uuid: "d13f0987f7054b72b940d1326216fa15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } health_report { overall_health: HEALTHY } } }
Aug 08 15:47:08 dist-test-slave-8tdl krb5kdc[16205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204027, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.126@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM
I20260808 15:47:08.573267 16819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.564525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41439 (local address 127.0.0.1:33038)
0808 15:47:08.564827 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:08.564841 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:08.565012 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:08.565258 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:08.565261 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:08.565741 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:08.565874 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:08.565883 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.566734 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.566737 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:08.567352 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:08.567362 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.567817 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.567819 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:08.567884 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.568480 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:08.568493 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:08.569966 (+ 1473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:08.571700 (+ 1734us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:08.571708 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:08.571713 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:08.571951 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:08.572227 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:08.572229 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:08.572230 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:08.572319 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:08.572756 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:08.572762 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:08.572869 (+ 107us) client_negotiation.cc:769] Sending connection context
0808 15:47:08.572969 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 15:47:08.573078 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":93,"threads_started":1}
I20260808 15:47:08.573271 16300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.564609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33038 (local address 127.8.39.126:41439)
0808 15:47:08.564750 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:08.564756 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:08.564934 (+ 178us) server_negotiation.cc:407] Connection header received
0808 15:47:08.565103 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:08.565108 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:08.565154 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:08.565240 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:08.566004 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.566580 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.567464 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.567710 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.567798 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.570134 (+ 2336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:08.570137 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:08.570139 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:08.570162 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:08.571594 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:08.572042 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:08.572045 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:08.572046 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:08.572122 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:08.572438 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:08.572440 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:08.572441 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:08.572636 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:08.572719 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:08.573036 (+ 317us) server_negotiation.cc:299] Negotiation successful
0808 15:47:08.573135 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 15:47:08.577380 16250 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:33038:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 15:47:08.578063 16250 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:47:08.583030 16390 tablet_service.cc:1467] Processing CreateTablet for tablet 5a7d17dafa744fe092e3d9bfed434660 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ec7b8463ca1543c99291268fca66812a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 15:47:08.583020 16538 tablet_service.cc:1467] Processing CreateTablet for tablet 5a7d17dafa744fe092e3d9bfed434660 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ec7b8463ca1543c99291268fca66812a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 15:47:08.583206 16683 tablet_service.cc:1467] Processing CreateTablet for tablet 5a7d17dafa744fe092e3d9bfed434660 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ec7b8463ca1543c99291268fca66812a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 15:47:08.583484 16538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a7d17dafa744fe092e3d9bfed434660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:08.583477 16390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a7d17dafa744fe092e3d9bfed434660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:08.583565 16683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a7d17dafa744fe092e3d9bfed434660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:08.585783 16784 tablet_bootstrap.cc:492] T 5a7d17dafa744fe092e3d9bfed434660 P 35c4340a499e4784a5f41ad4ae0340b8: Bootstrap starting.
I20260808 15:47:08.586594 16783 tablet_bootstrap.cc:492] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15: Bootstrap starting.
I20260808 15:47:08.586836 16782 tablet_bootstrap.cc:492] T 5a7d17dafa744fe092e3d9bfed434660 P 0bd01d96196949bbb7303b7d4d722d69: Bootstrap starting.
I20260808 15:47:08.586930 16784 tablet_bootstrap.cc:654] T 5a7d17dafa744fe092e3d9bfed434660 P 35c4340a499e4784a5f41ad4ae0340b8: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:08.587667 16783 tablet_bootstrap.cc:654] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:08.587862 16782 tablet_bootstrap.cc:654] T 5a7d17dafa744fe092e3d9bfed434660 P 0bd01d96196949bbb7303b7d4d722d69: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:08.588505 16784 tablet_bootstrap.cc:492] T 5a7d17dafa744fe092e3d9bfed434660 P 35c4340a499e4784a5f41ad4ae0340b8: No bootstrap required, opened a new log
I20260808 15:47:08.588626 16784 ts_tablet_manager.cc:1397] T 5a7d17dafa744fe092e3d9bfed434660 P 35c4340a499e4784a5f41ad4ae0340b8: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 15:47:08.589056 16784 raft_consensus.cc:348] T 5a7d17dafa744fe092e3d9bfed434660 P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:08.589206 16784 raft_consensus.cc:374] T 5a7d17dafa744fe092e3d9bfed434660 P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:08.589255 16784 raft_consensus.cc:729] T 5a7d17dafa744fe092e3d9bfed434660 P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35c4340a499e4784a5f41ad4ae0340b8, State: Initialized, Role: FOLLOWER
I20260808 15:47:08.589303 16782 tablet_bootstrap.cc:492] T 5a7d17dafa744fe092e3d9bfed434660 P 0bd01d96196949bbb7303b7d4d722d69: No bootstrap required, opened a new log
I20260808 15:47:08.589424 16782 ts_tablet_manager.cc:1397] T 5a7d17dafa744fe092e3d9bfed434660 P 0bd01d96196949bbb7303b7d4d722d69: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 15:47:08.589408 16784 consensus_queue.cc:260] T 5a7d17dafa744fe092e3d9bfed434660 P 35c4340a499e4784a5f41ad4ae0340b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:08.589701 16802 tablet_replica.cc:439] T 5a7d17dafa744fe092e3d9bfed434660 P 35c4340a499e4784a5f41ad4ae0340b8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } } }
I20260808 15:47:08.589751 16784 ts_tablet_manager.cc:1428] T 5a7d17dafa744fe092e3d9bfed434660 P 35c4340a499e4784a5f41ad4ae0340b8: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 15:47:08.589836 16802 tablet_replica.cc:442] T 5a7d17dafa744fe092e3d9bfed434660 P 35c4340a499e4784a5f41ad4ae0340b8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:47:08.589906 16782 raft_consensus.cc:348] T 5a7d17dafa744fe092e3d9bfed434660 P 0bd01d96196949bbb7303b7d4d722d69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:08.590072 16782 raft_consensus.cc:374] T 5a7d17dafa744fe092e3d9bfed434660 P 0bd01d96196949bbb7303b7d4d722d69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:08.590132 16782 raft_consensus.cc:729] T 5a7d17dafa744fe092e3d9bfed434660 P 0bd01d96196949bbb7303b7d4d722d69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bd01d96196949bbb7303b7d4d722d69, State: Initialized, Role: FOLLOWER
I20260808 15:47:08.590751 16783 tablet_bootstrap.cc:492] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15: No bootstrap required, opened a new log
I20260808 15:47:08.590842 16783 ts_tablet_manager.cc:1397] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260808 15:47:08.591373 16783 raft_consensus.cc:348] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:08.591517 16783 raft_consensus.cc:374] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:08.591574 16783 raft_consensus.cc:729] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d13f0987f7054b72b940d1326216fa15, State: Initialized, Role: FOLLOWER
I20260808 15:47:08.591729 16783 consensus_queue.cc:260] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:08.591985 16789 tablet_replica.cc:439] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } } }
I20260808 15:47:08.592156 16789 tablet_replica.cc:442] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:47:08.592065 16783 ts_tablet_manager.cc:1428] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 15:47:08.592171 16782 consensus_queue.cc:260] T 5a7d17dafa744fe092e3d9bfed434660 P 0bd01d96196949bbb7303b7d4d722d69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:08.592465 16790 tablet_replica.cc:439] T 5a7d17dafa744fe092e3d9bfed434660 P 0bd01d96196949bbb7303b7d4d722d69: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } } }
I20260808 15:47:08.592613 16790 tablet_replica.cc:442] T 5a7d17dafa744fe092e3d9bfed434660 P 0bd01d96196949bbb7303b7d4d722d69: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:47:08.593055 16782 ts_tablet_manager.cc:1428] T 5a7d17dafa744fe092e3d9bfed434660 P 0bd01d96196949bbb7303b7d4d722d69: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260808 15:47:08.642081 16789 raft_consensus.cc:482] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:47:08.642232 16789 raft_consensus.cc:504] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:08.642601 16789 leader_election.cc:288] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bd01d96196949bbb7303b7d4d722d69 (127.8.39.65:35353), 35c4340a499e4784a5f41ad4ae0340b8 (127.8.39.66:40921)
I20260808 15:47:08.643128 16559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a7d17dafa744fe092e3d9bfed434660" candidate_uuid: "d13f0987f7054b72b940d1326216fa15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c4340a499e4784a5f41ad4ae0340b8" is_pre_election: true
I20260808 15:47:08.643127 16410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a7d17dafa744fe092e3d9bfed434660" candidate_uuid: "d13f0987f7054b72b940d1326216fa15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd01d96196949bbb7303b7d4d722d69" is_pre_election: true
I20260808 15:47:08.643290 16559 raft_consensus.cc:2454] T 5a7d17dafa744fe092e3d9bfed434660 P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d13f0987f7054b72b940d1326216fa15 in term 0.
I20260808 15:47:08.643290 16410 raft_consensus.cc:2454] T 5a7d17dafa744fe092e3d9bfed434660 P 0bd01d96196949bbb7303b7d4d722d69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d13f0987f7054b72b940d1326216fa15 in term 0.
I20260808 15:47:08.643631 16632 leader_election.cc:302] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0bd01d96196949bbb7303b7d4d722d69, 35c4340a499e4784a5f41ad4ae0340b8, d13f0987f7054b72b940d1326216fa15; no voters:
I20260808 15:47:08.643868 16789 raft_consensus.cc:2781] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:47:08.643947 16789 raft_consensus.cc:482] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:47:08.643996 16789 raft_consensus.cc:3037] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:08.644986 16789 raft_consensus.cc:504] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:08.645321 16789 leader_election.cc:288] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15 [CANDIDATE]: Term 1 election: Requested vote from peers 0bd01d96196949bbb7303b7d4d722d69 (127.8.39.65:35353), 35c4340a499e4784a5f41ad4ae0340b8 (127.8.39.66:40921)
I20260808 15:47:08.645784 16559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a7d17dafa744fe092e3d9bfed434660" candidate_uuid: "d13f0987f7054b72b940d1326216fa15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c4340a499e4784a5f41ad4ae0340b8"
I20260808 15:47:08.645783 16410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a7d17dafa744fe092e3d9bfed434660" candidate_uuid: "d13f0987f7054b72b940d1326216fa15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd01d96196949bbb7303b7d4d722d69"
I20260808 15:47:08.645927 16410 raft_consensus.cc:3037] T 5a7d17dafa744fe092e3d9bfed434660 P 0bd01d96196949bbb7303b7d4d722d69 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:08.645927 16559 raft_consensus.cc:3037] T 5a7d17dafa744fe092e3d9bfed434660 P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:08.647184 16559 raft_consensus.cc:2454] T 5a7d17dafa744fe092e3d9bfed434660 P 35c4340a499e4784a5f41ad4ae0340b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d13f0987f7054b72b940d1326216fa15 in term 1.
I20260808 15:47:08.647183 16410 raft_consensus.cc:2454] T 5a7d17dafa744fe092e3d9bfed434660 P 0bd01d96196949bbb7303b7d4d722d69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d13f0987f7054b72b940d1326216fa15 in term 1.
I20260808 15:47:08.647508 16632 leader_election.cc:302] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35c4340a499e4784a5f41ad4ae0340b8, d13f0987f7054b72b940d1326216fa15; no voters:
I20260808 15:47:08.647761 16789 raft_consensus.cc:2781] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:47:08.647867 16789 raft_consensus.cc:686] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15 [term 1 LEADER]: Becoming Leader. State: Replica: d13f0987f7054b72b940d1326216fa15, State: Running, Role: LEADER
I20260808 15:47:08.648001 16789 consensus_queue.cc:237] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:08.648638 16812 tablet_replica.cc:439] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15: TxnStatusTablet state changed. Reason: New leader d13f0987f7054b72b940d1326216fa15. Latest consensus state: current_term: 1 leader_uuid: "d13f0987f7054b72b940d1326216fa15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } } }
I20260808 15:47:08.648749 16812 tablet_replica.cc:442] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15: This TxnStatusTablet replica's current role is: LEADER
I20260808 15:47:08.649029 16824 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 15:47:08.649201 16824 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 15:47:08.649770 16250 catalog_manager.cc:5495] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15 reported cstate change: term changed from 0 to 1, leader changed from <none> to d13f0987f7054b72b940d1326216fa15 (127.8.39.67). New cstate: current_term: 1 leader_uuid: "d13f0987f7054b72b940d1326216fa15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } health_report { overall_health: HEALTHY } } }
I20260808 15:47:08.676486 16819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.671883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:35061 (local address 127.0.0.1:37962)
0808 15:47:08.672127 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:08.672142 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:08.672279 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:08.672625 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:08.672628 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:08.672638 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 15:47:08.672755 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:08.672760 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.673815 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.673821 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:08.674576 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:08.674587 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.675170 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.675174 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:08.675282 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.675336 (+ 54us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 15:47:08.676146 (+ 810us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 15:47:08.676168 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 15:47:08.676243 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 15:47:08.676342 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92}
I20260808 15:47:08.676508 16778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.672148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37962 (local address 127.8.39.67:35061)
0808 15:47:08.672312 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:08.672317 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:08.672334 (+ 17us) server_negotiation.cc:407] Connection header received
0808 15:47:08.672426 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:08.672429 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:08.672494 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:08.672595 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:47:08.672888 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.673408 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.674746 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.675032 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.675174 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.675525 (+ 351us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:47:08.676014 (+ 489us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:47:08.676152 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:08.676255 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 15:47:08.676320 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 15:47:08.679683 16410 raft_consensus.cc:1261] T 5a7d17dafa744fe092e3d9bfed434660 P 0bd01d96196949bbb7303b7d4d722d69 [term 1 FOLLOWER]: Refusing update from remote peer d13f0987f7054b72b940d1326216fa15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:47:08.679848 16559 raft_consensus.cc:1261] T 5a7d17dafa744fe092e3d9bfed434660 P 35c4340a499e4784a5f41ad4ae0340b8 [term 1 FOLLOWER]: Refusing update from remote peer d13f0987f7054b72b940d1326216fa15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:47:08.680245 16789 consensus_queue.cc:1035] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:47:08.680457 16812 consensus_queue.cc:1035] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:47:08.682003 16790 tablet_replica.cc:439] T 5a7d17dafa744fe092e3d9bfed434660 P 0bd01d96196949bbb7303b7d4d722d69: TxnStatusTablet state changed. Reason: New leader d13f0987f7054b72b940d1326216fa15. Latest consensus state: current_term: 1 leader_uuid: "d13f0987f7054b72b940d1326216fa15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } } }
I20260808 15:47:08.682129 16790 tablet_replica.cc:442] T 5a7d17dafa744fe092e3d9bfed434660 P 0bd01d96196949bbb7303b7d4d722d69: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:47:08.684564 16802 tablet_replica.cc:439] T 5a7d17dafa744fe092e3d9bfed434660 P 35c4340a499e4784a5f41ad4ae0340b8: TxnStatusTablet state changed. Reason: New leader d13f0987f7054b72b940d1326216fa15. Latest consensus state: current_term: 1 leader_uuid: "d13f0987f7054b72b940d1326216fa15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } } }
I20260808 15:47:08.684690 16802 tablet_replica.cc:442] T 5a7d17dafa744fe092e3d9bfed434660 P 35c4340a499e4784a5f41ad4ae0340b8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:47:08.686074 16812 tablet_replica.cc:439] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d13f0987f7054b72b940d1326216fa15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } } }
I20260808 15:47:08.686193 16812 tablet_replica.cc:442] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15: This TxnStatusTablet replica's current role is: LEADER
I20260808 15:47:08.687295 16789 tablet_replica.cc:439] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d13f0987f7054b72b940d1326216fa15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } } }
I20260808 15:47:08.687485 16789 tablet_replica.cc:442] T 5a7d17dafa744fe092e3d9bfed434660 P d13f0987f7054b72b940d1326216fa15: This TxnStatusTablet replica's current role is: LEADER
I20260808 15:47:08.687424 16802 tablet_replica.cc:439] T 5a7d17dafa744fe092e3d9bfed434660 P 35c4340a499e4784a5f41ad4ae0340b8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d13f0987f7054b72b940d1326216fa15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } } }
I20260808 15:47:08.687541 16802 tablet_replica.cc:442] T 5a7d17dafa744fe092e3d9bfed434660 P 35c4340a499e4784a5f41ad4ae0340b8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:47:08.688086 16790 tablet_replica.cc:439] T 5a7d17dafa744fe092e3d9bfed434660 P 0bd01d96196949bbb7303b7d4d722d69: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d13f0987f7054b72b940d1326216fa15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } } }
I20260808 15:47:08.688196 16790 tablet_replica.cc:442] T 5a7d17dafa744fe092e3d9bfed434660 P 0bd01d96196949bbb7303b7d4d722d69: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 15:47:08.695196 16778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.691640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37964 (local address 127.8.39.67:35061)
0808 15:47:08.691740 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:08.691745 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:08.691821 (+ 76us) server_negotiation.cc:407] Connection header received
0808 15:47:08.691953 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:08.691955 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:08.692006 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:08.692095 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:47:08.692315 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.692799 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.694032 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.694255 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.694342 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.694625 (+ 283us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:47:08.694737 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:47:08.694803 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:08.694979 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 15:47:08.695024 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 15:47:08.706830 16778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.703186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:48491 (local address 127.8.39.67:35061)
0808 15:47:08.703310 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:08.703314 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:08.703569 (+ 255us) server_negotiation.cc:407] Connection header received
0808 15:47:08.703684 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:08.703686 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:08.703726 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:08.703785 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:47:08.704039 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.704513 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.705740 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.705975 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.706060 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.706374 (+ 314us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:47:08.706437 (+ 63us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:47:08.706489 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:08.706612 (+ 123us) server_negotiation.cc:299] Negotiation successful
0808 15:47:08.706709 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":45}
I20260808 15:47:08.706943 16832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.703093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:35061 (local address 127.8.39.67:48491)
0808 15:47:08.703468 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:08.703490 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:08.703594 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:08.703814 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:08.703817 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:08.703824 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 15:47:08.703939 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:08.703945 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.704611 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.704614 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:08.705621 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:08.705631 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.706105 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.706108 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:08.706198 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.706247 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 15:47:08.706521 (+ 274us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 15:47:08.706528 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 15:47:08.706593 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 15:47:08.706730 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":19,"thread_start_us":97,"threads_started":1}
I20260808 15:47:08.713881 16558 raft_consensus.cc:1261] T 3da0114cb7c24c41b8a49deea202eb17 P 35c4340a499e4784a5f41ad4ae0340b8 [term 1 FOLLOWER]: Refusing update from remote peer d13f0987f7054b72b940d1326216fa15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:47:08.713968 16410 raft_consensus.cc:1261] T 3da0114cb7c24c41b8a49deea202eb17 P 0bd01d96196949bbb7303b7d4d722d69 [term 1 FOLLOWER]: Refusing update from remote peer d13f0987f7054b72b940d1326216fa15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:47:08.714299 16812 consensus_queue.cc:1035] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:47:08.714526 16829 consensus_queue.cc:1035] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:47:08.758404 16249 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33032:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:47:08.758567 16249 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33032:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:47:08.760833 16249 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26: Sending DeleteTablet for 3 replicas of tablet 3da0114cb7c24c41b8a49deea202eb17
I20260808 15:47:08.761467 16390 tablet_service.cc:1514] Processing DeleteTablet for tablet 3da0114cb7c24c41b8a49deea202eb17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:47:08 UTC) from {username='oryx', principal='oryx/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:60034
I20260808 15:47:08.761520 16538 tablet_service.cc:1514] Processing DeleteTablet for tablet 3da0114cb7c24c41b8a49deea202eb17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:47:08 UTC) from {username='oryx', principal='oryx/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:39324
I20260808 15:47:08.761713 16806 tablet_replica.cc:330] T 3da0114cb7c24c41b8a49deea202eb17 P 0bd01d96196949bbb7303b7d4d722d69: stopping tablet replica
I20260808 15:47:08.761729 16807 tablet_replica.cc:330] T 3da0114cb7c24c41b8a49deea202eb17 P 35c4340a499e4784a5f41ad4ae0340b8: stopping tablet replica
I20260808 15:47:08.761844 16806 raft_consensus.cc:2229] T 3da0114cb7c24c41b8a49deea202eb17 P 0bd01d96196949bbb7303b7d4d722d69 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:47:08.761940 16807 raft_consensus.cc:2229] T 3da0114cb7c24c41b8a49deea202eb17 P 35c4340a499e4784a5f41ad4ae0340b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:47:08.762010 16806 raft_consensus.cc:2258] T 3da0114cb7c24c41b8a49deea202eb17 P 0bd01d96196949bbb7303b7d4d722d69 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:47:08.762071 16807 raft_consensus.cc:2258] T 3da0114cb7c24c41b8a49deea202eb17 P 35c4340a499e4784a5f41ad4ae0340b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:47:08.762811 16683 tablet_service.cc:1514] Processing DeleteTablet for tablet 3da0114cb7c24c41b8a49deea202eb17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:47:08 UTC) from {username='oryx', principal='oryx/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:37954
I20260808 15:47:08.762959 16807 ts_tablet_manager.cc:1905] T 3da0114cb7c24c41b8a49deea202eb17 P 35c4340a499e4784a5f41ad4ae0340b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:47:08.763005 16805 tablet_replica.cc:330] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15: stopping tablet replica
I20260808 15:47:08.763113 16805 raft_consensus.cc:2229] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:47:08.763422 16805 raft_consensus.cc:2258] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:47:08.766156 16807 ts_tablet_manager.cc:1918] T 3da0114cb7c24c41b8a49deea202eb17 P 35c4340a499e4784a5f41ad4ae0340b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:47:08.766235 16807 log.cc:1196] T 3da0114cb7c24c41b8a49deea202eb17 P 35c4340a499e4784a5f41ad4ae0340b8: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-1/wal/wals/3da0114cb7c24c41b8a49deea202eb17
I20260808 15:47:08.766508 16807 ts_tablet_manager.cc:1939] T 3da0114cb7c24c41b8a49deea202eb17 P 35c4340a499e4784a5f41ad4ae0340b8: Deleting consensus metadata
I20260808 15:47:08.767695 16805 ts_tablet_manager.cc:1905] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:47:08.771234 16805 ts_tablet_manager.cc:1918] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:47:08.771425 16805 log.cc:1196] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/3da0114cb7c24c41b8a49deea202eb17
I20260808 15:47:08.771780 16805 ts_tablet_manager.cc:1939] T 3da0114cb7c24c41b8a49deea202eb17 P d13f0987f7054b72b940d1326216fa15: Deleting consensus metadata
I20260808 15:47:08.771736 16236 catalog_manager.cc:4841] TS 35c4340a499e4784a5f41ad4ae0340b8 (127.8.39.66:40921): tablet 3da0114cb7c24c41b8a49deea202eb17 (table test-table [id=c0a668eb1e834975b929dad4085427a8]) successfully deleted
I20260808 15:47:08.772709 16806 ts_tablet_manager.cc:1905] T 3da0114cb7c24c41b8a49deea202eb17 P 0bd01d96196949bbb7303b7d4d722d69: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:47:08.775507 16237 catalog_manager.cc:4841] TS d13f0987f7054b72b940d1326216fa15 (127.8.39.67:35061): tablet 3da0114cb7c24c41b8a49deea202eb17 (table test-table [id=c0a668eb1e834975b929dad4085427a8]) successfully deleted
I20260808 15:47:08.776443 16806 ts_tablet_manager.cc:1918] T 3da0114cb7c24c41b8a49deea202eb17 P 0bd01d96196949bbb7303b7d4d722d69: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:47:08.776537 16806 log.cc:1196] T 3da0114cb7c24c41b8a49deea202eb17 P 0bd01d96196949bbb7303b7d4d722d69: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-0/wal/wals/3da0114cb7c24c41b8a49deea202eb17
I20260808 15:47:08.776867 16806 ts_tablet_manager.cc:1939] T 3da0114cb7c24c41b8a49deea202eb17 P 0bd01d96196949bbb7303b7d4d722d69: Deleting consensus metadata
I20260808 15:47:08.777706 16234 catalog_manager.cc:4841] TS 0bd01d96196949bbb7303b7d4d722d69 (127.8.39.65:35353): tablet 3da0114cb7c24c41b8a49deea202eb17 (table test-table [id=c0a668eb1e834975b929dad4085427a8]) successfully deleted
Aug 08 15:47:08 dist-test-slave-8tdl krb5kdc[16205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 15:47:08 dist-test-slave-8tdl krb5kdc[16205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:08 dist-test-slave-8tdl krb5kdc[16205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 15:47:08.799139 16300 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:08.791494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33042 (local address 127.8.39.126:41439)
0808 15:47:08.791656 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:08.791661 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:08.791820 (+ 159us) server_negotiation.cc:407] Connection header received
0808 15:47:08.791921 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:08.791924 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:08.791984 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:08.792103 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:08.792907 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.793718 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.794658 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.795042 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.795159 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.798987 (+ 3828us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33042: BlockingRecv error: recv got EOF from 127.0.0.1:33042 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 08 15:47:08 dist-test-slave-8tdl krb5kdc[16205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM
I20260808 15:47:08.811348 16300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:08.800965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33058 (local address 127.8.39.126:41439)
0808 15:47:08.801102 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:08.801106 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:08.801205 (+ 99us) server_negotiation.cc:407] Connection header received
0808 15:47:08.801294 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:08.801297 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:08.801353 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:08.801449 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:08.802058 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.802967 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.803931 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:08.804253 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:08.804391 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:08.807004 (+ 2613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:08.807007 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:08.807010 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:08.807042 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:08.809282 (+ 2240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:08.809805 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:08.809809 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:08.809811 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:08.809924 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:08.810253 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:08.810256 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:08.810258 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:08.810512 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:08.810692 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:08.811004 (+ 312us) server_negotiation.cc:299] Negotiation successful
0808 15:47:08.811163 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 15:47:08.814302 16249 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33058:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:47:08.814851 16249 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:47:08.820789 16390 tablet_service.cc:1467] Processing CreateTablet for tablet 4b12a1f2ce564bfdadec4be73db24dff (DEFAULT_TABLE table=test-table [id=f078ea45400342ffbda19c654f4ba375]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:47:08.820878 16538 tablet_service.cc:1467] Processing CreateTablet for tablet 4b12a1f2ce564bfdadec4be73db24dff (DEFAULT_TABLE table=test-table [id=f078ea45400342ffbda19c654f4ba375]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:47:08.820947 16683 tablet_service.cc:1467] Processing CreateTablet for tablet 4b12a1f2ce564bfdadec4be73db24dff (DEFAULT_TABLE table=test-table [id=f078ea45400342ffbda19c654f4ba375]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:47:08.821137 16390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b12a1f2ce564bfdadec4be73db24dff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:08.821204 16683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b12a1f2ce564bfdadec4be73db24dff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:08.821205 16538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b12a1f2ce564bfdadec4be73db24dff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:08.823712 16782 tablet_bootstrap.cc:492] T 4b12a1f2ce564bfdadec4be73db24dff P 0bd01d96196949bbb7303b7d4d722d69: Bootstrap starting.
I20260808 15:47:08.823760 16783 tablet_bootstrap.cc:492] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15: Bootstrap starting.
I20260808 15:47:08.824750 16782 tablet_bootstrap.cc:654] T 4b12a1f2ce564bfdadec4be73db24dff P 0bd01d96196949bbb7303b7d4d722d69: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:08.824762 16783 tablet_bootstrap.cc:654] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:08.825433 16784 tablet_bootstrap.cc:492] T 4b12a1f2ce564bfdadec4be73db24dff P 35c4340a499e4784a5f41ad4ae0340b8: Bootstrap starting.
I20260808 15:47:08.826203 16784 tablet_bootstrap.cc:654] T 4b12a1f2ce564bfdadec4be73db24dff P 35c4340a499e4784a5f41ad4ae0340b8: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:08.827392 16784 tablet_bootstrap.cc:492] T 4b12a1f2ce564bfdadec4be73db24dff P 35c4340a499e4784a5f41ad4ae0340b8: No bootstrap required, opened a new log
I20260808 15:47:08.827487 16784 ts_tablet_manager.cc:1397] T 4b12a1f2ce564bfdadec4be73db24dff P 35c4340a499e4784a5f41ad4ae0340b8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 15:47:08.827891 16783 tablet_bootstrap.cc:492] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15: No bootstrap required, opened a new log
I20260808 15:47:08.827921 16784 raft_consensus.cc:348] T 4b12a1f2ce564bfdadec4be73db24dff P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:08.828009 16783 ts_tablet_manager.cc:1397] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 15:47:08.828058 16784 raft_consensus.cc:374] T 4b12a1f2ce564bfdadec4be73db24dff P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:08.828099 16784 raft_consensus.cc:729] T 4b12a1f2ce564bfdadec4be73db24dff P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35c4340a499e4784a5f41ad4ae0340b8, State: Initialized, Role: FOLLOWER
I20260808 15:47:08.828219 16784 consensus_queue.cc:260] T 4b12a1f2ce564bfdadec4be73db24dff P 35c4340a499e4784a5f41ad4ae0340b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:08.828539 16784 ts_tablet_manager.cc:1428] T 4b12a1f2ce564bfdadec4be73db24dff P 35c4340a499e4784a5f41ad4ae0340b8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:47:08.828488 16783 raft_consensus.cc:348] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:08.828616 16783 raft_consensus.cc:374] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:08.828658 16783 raft_consensus.cc:729] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d13f0987f7054b72b940d1326216fa15, State: Initialized, Role: FOLLOWER
I20260808 15:47:08.828804 16783 consensus_queue.cc:260] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:08.829082 16783 ts_tablet_manager.cc:1428] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:47:08.831583 16782 tablet_bootstrap.cc:492] T 4b12a1f2ce564bfdadec4be73db24dff P 0bd01d96196949bbb7303b7d4d722d69: No bootstrap required, opened a new log
I20260808 15:47:08.831694 16782 ts_tablet_manager.cc:1397] T 4b12a1f2ce564bfdadec4be73db24dff P 0bd01d96196949bbb7303b7d4d722d69: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260808 15:47:08.832226 16782 raft_consensus.cc:348] T 4b12a1f2ce564bfdadec4be73db24dff P 0bd01d96196949bbb7303b7d4d722d69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:08.832365 16782 raft_consensus.cc:374] T 4b12a1f2ce564bfdadec4be73db24dff P 0bd01d96196949bbb7303b7d4d722d69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:08.832403 16782 raft_consensus.cc:729] T 4b12a1f2ce564bfdadec4be73db24dff P 0bd01d96196949bbb7303b7d4d722d69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bd01d96196949bbb7303b7d4d722d69, State: Initialized, Role: FOLLOWER
I20260808 15:47:08.832545 16782 consensus_queue.cc:260] T 4b12a1f2ce564bfdadec4be73db24dff P 0bd01d96196949bbb7303b7d4d722d69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:08.832916 16782 ts_tablet_manager.cc:1428] T 4b12a1f2ce564bfdadec4be73db24dff P 0bd01d96196949bbb7303b7d4d722d69: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260808 15:47:09.000411 16829 raft_consensus.cc:482] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:47:09.000597 16829 raft_consensus.cc:504] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:09.001107 16829 leader_election.cc:288] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bd01d96196949bbb7303b7d4d722d69 (127.8.39.65:35353), 35c4340a499e4784a5f41ad4ae0340b8 (127.8.39.66:40921)
I20260808 15:47:09.001670 16410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b12a1f2ce564bfdadec4be73db24dff" candidate_uuid: "d13f0987f7054b72b940d1326216fa15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd01d96196949bbb7303b7d4d722d69" is_pre_election: true
I20260808 15:47:09.001699 16558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b12a1f2ce564bfdadec4be73db24dff" candidate_uuid: "d13f0987f7054b72b940d1326216fa15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c4340a499e4784a5f41ad4ae0340b8" is_pre_election: true
I20260808 15:47:09.001843 16410 raft_consensus.cc:2454] T 4b12a1f2ce564bfdadec4be73db24dff P 0bd01d96196949bbb7303b7d4d722d69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d13f0987f7054b72b940d1326216fa15 in term 0.
I20260808 15:47:09.001894 16558 raft_consensus.cc:2454] T 4b12a1f2ce564bfdadec4be73db24dff P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d13f0987f7054b72b940d1326216fa15 in term 0.
I20260808 15:47:09.002207 16630 leader_election.cc:302] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd01d96196949bbb7303b7d4d722d69, d13f0987f7054b72b940d1326216fa15; no voters:
I20260808 15:47:09.002386 16829 raft_consensus.cc:2781] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:47:09.002445 16829 raft_consensus.cc:482] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:47:09.002496 16829 raft_consensus.cc:3037] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:09.003667 16829 raft_consensus.cc:504] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:09.004056 16829 leader_election.cc:288] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15 [CANDIDATE]: Term 1 election: Requested vote from peers 0bd01d96196949bbb7303b7d4d722d69 (127.8.39.65:35353), 35c4340a499e4784a5f41ad4ae0340b8 (127.8.39.66:40921)
I20260808 15:47:09.004407 16410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b12a1f2ce564bfdadec4be73db24dff" candidate_uuid: "d13f0987f7054b72b940d1326216fa15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd01d96196949bbb7303b7d4d722d69"
I20260808 15:47:09.004462 16558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b12a1f2ce564bfdadec4be73db24dff" candidate_uuid: "d13f0987f7054b72b940d1326216fa15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c4340a499e4784a5f41ad4ae0340b8"
I20260808 15:47:09.004534 16410 raft_consensus.cc:3037] T 4b12a1f2ce564bfdadec4be73db24dff P 0bd01d96196949bbb7303b7d4d722d69 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:09.004618 16558 raft_consensus.cc:3037] T 4b12a1f2ce564bfdadec4be73db24dff P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:09.005510 16410 raft_consensus.cc:2454] T 4b12a1f2ce564bfdadec4be73db24dff P 0bd01d96196949bbb7303b7d4d722d69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d13f0987f7054b72b940d1326216fa15 in term 1.
I20260808 15:47:09.005721 16558 raft_consensus.cc:2454] T 4b12a1f2ce564bfdadec4be73db24dff P 35c4340a499e4784a5f41ad4ae0340b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d13f0987f7054b72b940d1326216fa15 in term 1.
I20260808 15:47:09.005844 16630 leader_election.cc:302] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd01d96196949bbb7303b7d4d722d69, d13f0987f7054b72b940d1326216fa15; no voters:
I20260808 15:47:09.006011 16829 raft_consensus.cc:2781] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:47:09.006114 16829 raft_consensus.cc:686] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15 [term 1 LEADER]: Becoming Leader. State: Replica: d13f0987f7054b72b940d1326216fa15, State: Running, Role: LEADER
I20260808 15:47:09.006260 16829 consensus_queue.cc:237] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:09.008162 16249 catalog_manager.cc:5495] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15 reported cstate change: term changed from 0 to 1, leader changed from <none> to d13f0987f7054b72b940d1326216fa15 (127.8.39.67). New cstate: current_term: 1 leader_uuid: "d13f0987f7054b72b940d1326216fa15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } health_report { overall_health: HEALTHY } } }
I20260808 15:47:09.032418 16778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:09.028967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37966 (local address 127.8.39.67:35061)
0808 15:47:09.029137 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:09.029142 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:09.029160 (+ 18us) server_negotiation.cc:407] Connection header received
0808 15:47:09.029247 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:09.029250 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:09.029302 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:09.029378 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:47:09.029743 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:09.030266 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:09.031277 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:09.031512 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:09.031625 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:09.031903 (+ 278us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:47:09.031990 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:47:09.032071 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:09.032198 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 15:47:09.032255 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 15:47:09.034564 16558 raft_consensus.cc:1261] T 4b12a1f2ce564bfdadec4be73db24dff P 35c4340a499e4784a5f41ad4ae0340b8 [term 1 FOLLOWER]: Refusing update from remote peer d13f0987f7054b72b940d1326216fa15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:47:09.034580 16410 raft_consensus.cc:1261] T 4b12a1f2ce564bfdadec4be73db24dff P 0bd01d96196949bbb7303b7d4d722d69 [term 1 FOLLOWER]: Refusing update from remote peer d13f0987f7054b72b940d1326216fa15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:47:09.035099 16829 consensus_queue.cc:1035] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:47:09.035313 16812 consensus_queue.cc:1035] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:47:09.043115 16248 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33058:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:47:09.043292 16248 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33058:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:47:09.045317 16248 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26: Sending DeleteTablet for 3 replicas of tablet 4b12a1f2ce564bfdadec4be73db24dff
I20260808 15:47:09.045849 16390 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b12a1f2ce564bfdadec4be73db24dff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:47:09 UTC) from {username='oryx', principal='oryx/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:60034
I20260808 15:47:09.045868 16538 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b12a1f2ce564bfdadec4be73db24dff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:47:09 UTC) from {username='oryx', principal='oryx/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:39324
I20260808 15:47:09.045970 16683 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b12a1f2ce564bfdadec4be73db24dff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:47:09 UTC) from {username='oryx', principal='oryx/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:37954
I20260808 15:47:09.046083 16806 tablet_replica.cc:330] T 4b12a1f2ce564bfdadec4be73db24dff P 0bd01d96196949bbb7303b7d4d722d69: stopping tablet replica
I20260808 15:47:09.046099 16807 tablet_replica.cc:330] T 4b12a1f2ce564bfdadec4be73db24dff P 35c4340a499e4784a5f41ad4ae0340b8: stopping tablet replica
I20260808 15:47:09.046196 16806 raft_consensus.cc:2229] T 4b12a1f2ce564bfdadec4be73db24dff P 0bd01d96196949bbb7303b7d4d722d69 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:47:09.046204 16805 tablet_replica.cc:330] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15: stopping tablet replica
I20260808 15:47:09.046216 16807 raft_consensus.cc:2229] T 4b12a1f2ce564bfdadec4be73db24dff P 35c4340a499e4784a5f41ad4ae0340b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:47:09.046300 16806 raft_consensus.cc:2258] T 4b12a1f2ce564bfdadec4be73db24dff P 0bd01d96196949bbb7303b7d4d722d69 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:47:09.046310 16805 raft_consensus.cc:2229] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:47:09.046345 16807 raft_consensus.cc:2258] T 4b12a1f2ce564bfdadec4be73db24dff P 35c4340a499e4784a5f41ad4ae0340b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:47:09.046504 16805 raft_consensus.cc:2258] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:47:09.047065 16806 ts_tablet_manager.cc:1905] T 4b12a1f2ce564bfdadec4be73db24dff P 0bd01d96196949bbb7303b7d4d722d69: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:47:09.047312 16805 ts_tablet_manager.cc:1905] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:47:09.047320 16807 ts_tablet_manager.cc:1905] T 4b12a1f2ce564bfdadec4be73db24dff P 35c4340a499e4784a5f41ad4ae0340b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:47:09.047601 16248 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33058:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:47:09.048003 16248 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:47:09.049762 16807 ts_tablet_manager.cc:1918] T 4b12a1f2ce564bfdadec4be73db24dff P 35c4340a499e4784a5f41ad4ae0340b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:47:09.049772 16806 ts_tablet_manager.cc:1918] T 4b12a1f2ce564bfdadec4be73db24dff P 0bd01d96196949bbb7303b7d4d722d69: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:47:09.049844 16807 log.cc:1196] T 4b12a1f2ce564bfdadec4be73db24dff P 35c4340a499e4784a5f41ad4ae0340b8: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-1/wal/wals/4b12a1f2ce564bfdadec4be73db24dff
I20260808 15:47:09.049851 16806 log.cc:1196] T 4b12a1f2ce564bfdadec4be73db24dff P 0bd01d96196949bbb7303b7d4d722d69: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-0/wal/wals/4b12a1f2ce564bfdadec4be73db24dff
I20260808 15:47:09.049952 16805 ts_tablet_manager.cc:1918] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:47:09.050020 16805 log.cc:1196] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/4b12a1f2ce564bfdadec4be73db24dff
I20260808 15:47:09.050184 16806 ts_tablet_manager.cc:1939] T 4b12a1f2ce564bfdadec4be73db24dff P 0bd01d96196949bbb7303b7d4d722d69: Deleting consensus metadata
I20260808 15:47:09.050279 16805 ts_tablet_manager.cc:1939] T 4b12a1f2ce564bfdadec4be73db24dff P d13f0987f7054b72b940d1326216fa15: Deleting consensus metadata
I20260808 15:47:09.050284 16807 ts_tablet_manager.cc:1939] T 4b12a1f2ce564bfdadec4be73db24dff P 35c4340a499e4784a5f41ad4ae0340b8: Deleting consensus metadata
I20260808 15:47:09.050956 16234 catalog_manager.cc:4841] TS 0bd01d96196949bbb7303b7d4d722d69 (127.8.39.65:35353): tablet 4b12a1f2ce564bfdadec4be73db24dff (table test-table [id=f078ea45400342ffbda19c654f4ba375]) successfully deleted
I20260808 15:47:09.050977 16236 catalog_manager.cc:4841] TS 35c4340a499e4784a5f41ad4ae0340b8 (127.8.39.66:40921): tablet 4b12a1f2ce564bfdadec4be73db24dff (table test-table [id=f078ea45400342ffbda19c654f4ba375]) successfully deleted
I20260808 15:47:09.051488 16237 catalog_manager.cc:4841] TS d13f0987f7054b72b940d1326216fa15 (127.8.39.67:35061): tablet 4b12a1f2ce564bfdadec4be73db24dff (table test-table [id=f078ea45400342ffbda19c654f4ba375]) successfully deleted
I20260808 15:47:09.053702 16390 tablet_service.cc:1467] Processing CreateTablet for tablet a8b65473b10d4afb84a8bd74efdcc62d (DEFAULT_TABLE table=test-table [id=e41b98809d3943ff99a97fe7857ddd4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:47:09.053848 16538 tablet_service.cc:1467] Processing CreateTablet for tablet a8b65473b10d4afb84a8bd74efdcc62d (DEFAULT_TABLE table=test-table [id=e41b98809d3943ff99a97fe7857ddd4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:47:09.054034 16390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8b65473b10d4afb84a8bd74efdcc62d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:09.054104 16538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8b65473b10d4afb84a8bd74efdcc62d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:09.055119 16683 tablet_service.cc:1467] Processing CreateTablet for tablet a8b65473b10d4afb84a8bd74efdcc62d (DEFAULT_TABLE table=test-table [id=e41b98809d3943ff99a97fe7857ddd4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:47:09.055434 16683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8b65473b10d4afb84a8bd74efdcc62d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:09.056579 16782 tablet_bootstrap.cc:492] T a8b65473b10d4afb84a8bd74efdcc62d P 0bd01d96196949bbb7303b7d4d722d69: Bootstrap starting.
I20260808 15:47:09.056629 16784 tablet_bootstrap.cc:492] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8: Bootstrap starting.
I20260808 15:47:09.057319 16784 tablet_bootstrap.cc:654] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:09.057752 16782 tablet_bootstrap.cc:654] T a8b65473b10d4afb84a8bd74efdcc62d P 0bd01d96196949bbb7303b7d4d722d69: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:09.058539 16783 tablet_bootstrap.cc:492] T a8b65473b10d4afb84a8bd74efdcc62d P d13f0987f7054b72b940d1326216fa15: Bootstrap starting.
I20260808 15:47:09.059306 16784 tablet_bootstrap.cc:492] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8: No bootstrap required, opened a new log
I20260808 15:47:09.059415 16784 ts_tablet_manager.cc:1397] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 15:47:09.059612 16783 tablet_bootstrap.cc:654] T a8b65473b10d4afb84a8bd74efdcc62d P d13f0987f7054b72b940d1326216fa15: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:09.059845 16784 raft_consensus.cc:348] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:09.059965 16784 raft_consensus.cc:374] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:09.060012 16784 raft_consensus.cc:729] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35c4340a499e4784a5f41ad4ae0340b8, State: Initialized, Role: FOLLOWER
I20260808 15:47:09.060151 16784 consensus_queue.cc:260] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:09.060439 16784 ts_tablet_manager.cc:1428] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:47:09.060572 16782 tablet_bootstrap.cc:492] T a8b65473b10d4afb84a8bd74efdcc62d P 0bd01d96196949bbb7303b7d4d722d69: No bootstrap required, opened a new log
I20260808 15:47:09.060672 16782 ts_tablet_manager.cc:1397] T a8b65473b10d4afb84a8bd74efdcc62d P 0bd01d96196949bbb7303b7d4d722d69: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260808 15:47:09.061219 16782 raft_consensus.cc:348] T a8b65473b10d4afb84a8bd74efdcc62d P 0bd01d96196949bbb7303b7d4d722d69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:09.061373 16782 raft_consensus.cc:374] T a8b65473b10d4afb84a8bd74efdcc62d P 0bd01d96196949bbb7303b7d4d722d69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:09.061432 16782 raft_consensus.cc:729] T a8b65473b10d4afb84a8bd74efdcc62d P 0bd01d96196949bbb7303b7d4d722d69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bd01d96196949bbb7303b7d4d722d69, State: Initialized, Role: FOLLOWER
I20260808 15:47:09.061589 16782 consensus_queue.cc:260] T a8b65473b10d4afb84a8bd74efdcc62d P 0bd01d96196949bbb7303b7d4d722d69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:09.061929 16782 ts_tablet_manager.cc:1428] T a8b65473b10d4afb84a8bd74efdcc62d P 0bd01d96196949bbb7303b7d4d722d69: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 15:47:09.062896 16783 tablet_bootstrap.cc:492] T a8b65473b10d4afb84a8bd74efdcc62d P d13f0987f7054b72b940d1326216fa15: No bootstrap required, opened a new log
I20260808 15:47:09.063072 16783 ts_tablet_manager.cc:1397] T a8b65473b10d4afb84a8bd74efdcc62d P d13f0987f7054b72b940d1326216fa15: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260808 15:47:09.063553 16783 raft_consensus.cc:348] T a8b65473b10d4afb84a8bd74efdcc62d P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:09.063671 16783 raft_consensus.cc:374] T a8b65473b10d4afb84a8bd74efdcc62d P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:09.063704 16783 raft_consensus.cc:729] T a8b65473b10d4afb84a8bd74efdcc62d P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d13f0987f7054b72b940d1326216fa15, State: Initialized, Role: FOLLOWER
I20260808 15:47:09.063838 16783 consensus_queue.cc:260] T a8b65473b10d4afb84a8bd74efdcc62d P d13f0987f7054b72b940d1326216fa15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:09.064126 16783 ts_tablet_manager.cc:1428] T a8b65473b10d4afb84a8bd74efdcc62d P d13f0987f7054b72b940d1326216fa15: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:47:09.217677 16802 raft_consensus.cc:482] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:47:09.217882 16802 raft_consensus.cc:504] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:09.218452 16802 leader_election.cc:288] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bd01d96196949bbb7303b7d4d722d69 (127.8.39.65:35353), d13f0987f7054b72b940d1326216fa15 (127.8.39.67:35061)
I20260808 15:47:09.218952 16410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8b65473b10d4afb84a8bd74efdcc62d" candidate_uuid: "35c4340a499e4784a5f41ad4ae0340b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd01d96196949bbb7303b7d4d722d69" is_pre_election: true
I20260808 15:47:09.219013 16704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8b65473b10d4afb84a8bd74efdcc62d" candidate_uuid: "35c4340a499e4784a5f41ad4ae0340b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d13f0987f7054b72b940d1326216fa15" is_pre_election: true
I20260808 15:47:09.219141 16704 raft_consensus.cc:2454] T a8b65473b10d4afb84a8bd74efdcc62d P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35c4340a499e4784a5f41ad4ae0340b8 in term 0.
I20260808 15:47:09.219137 16410 raft_consensus.cc:2454] T a8b65473b10d4afb84a8bd74efdcc62d P 0bd01d96196949bbb7303b7d4d722d69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35c4340a499e4784a5f41ad4ae0340b8 in term 0.
I20260808 15:47:09.219450 16490 leader_election.cc:302] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35c4340a499e4784a5f41ad4ae0340b8, d13f0987f7054b72b940d1326216fa15; no voters:
I20260808 15:47:09.219673 16802 raft_consensus.cc:2781] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:47:09.219740 16802 raft_consensus.cc:482] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:47:09.219769 16802 raft_consensus.cc:3037] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:09.221014 16802 raft_consensus.cc:504] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:09.221422 16802 leader_election.cc:288] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8 [CANDIDATE]: Term 1 election: Requested vote from peers 0bd01d96196949bbb7303b7d4d722d69 (127.8.39.65:35353), d13f0987f7054b72b940d1326216fa15 (127.8.39.67:35061)
I20260808 15:47:09.221776 16410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8b65473b10d4afb84a8bd74efdcc62d" candidate_uuid: "35c4340a499e4784a5f41ad4ae0340b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd01d96196949bbb7303b7d4d722d69"
I20260808 15:47:09.221776 16704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8b65473b10d4afb84a8bd74efdcc62d" candidate_uuid: "35c4340a499e4784a5f41ad4ae0340b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d13f0987f7054b72b940d1326216fa15"
I20260808 15:47:09.221902 16704 raft_consensus.cc:3037] T a8b65473b10d4afb84a8bd74efdcc62d P d13f0987f7054b72b940d1326216fa15 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:09.221903 16410 raft_consensus.cc:3037] T a8b65473b10d4afb84a8bd74efdcc62d P 0bd01d96196949bbb7303b7d4d722d69 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:09.223075 16410 raft_consensus.cc:2454] T a8b65473b10d4afb84a8bd74efdcc62d P 0bd01d96196949bbb7303b7d4d722d69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35c4340a499e4784a5f41ad4ae0340b8 in term 1.
I20260808 15:47:09.223075 16704 raft_consensus.cc:2454] T a8b65473b10d4afb84a8bd74efdcc62d P d13f0987f7054b72b940d1326216fa15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35c4340a499e4784a5f41ad4ae0340b8 in term 1.
I20260808 15:47:09.223403 16487 leader_election.cc:302] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0bd01d96196949bbb7303b7d4d722d69, 35c4340a499e4784a5f41ad4ae0340b8, d13f0987f7054b72b940d1326216fa15; no voters:
I20260808 15:47:09.223575 16802 raft_consensus.cc:2781] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:47:09.223794 16802 raft_consensus.cc:686] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8 [term 1 LEADER]: Becoming Leader. State: Replica: 35c4340a499e4784a5f41ad4ae0340b8, State: Running, Role: LEADER
I20260808 15:47:09.223951 16802 consensus_queue.cc:237] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } }
I20260808 15:47:09.225868 16248 catalog_manager.cc:5495] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35c4340a499e4784a5f41ad4ae0340b8 (127.8.39.66). New cstate: current_term: 1 leader_uuid: "35c4340a499e4784a5f41ad4ae0340b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c4340a499e4784a5f41ad4ae0340b8" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 } health_report { overall_health: UNKNOWN } } }
I20260808 15:47:09.262215 16861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:09.259010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39328 (local address 127.8.39.66:40921)
0808 15:47:09.259296 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:09.259300 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:09.259312 (+ 12us) server_negotiation.cc:407] Connection header received
0808 15:47:09.259360 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:09.259362 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:09.259401 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:09.259499 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:47:09.259756 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:09.260300 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:09.261136 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:09.261374 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:09.261480 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:09.261741 (+ 261us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:47:09.261822 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:47:09.261904 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:09.262001 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 15:47:09.262053 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":89,"threads_started":1}
I20260808 15:47:09.272509 16778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:09.269277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:49723 (local address 127.8.39.67:35061)
0808 15:47:09.269420 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:09.269424 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:09.269555 (+ 131us) server_negotiation.cc:407] Connection header received
0808 15:47:09.269667 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:09.269670 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:09.269718 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:09.269794 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:47:09.270077 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:09.270573 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:09.271523 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:09.271729 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:09.271808 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:09.272111 (+ 303us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:47:09.272178 (+ 67us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:47:09.272238 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:09.272338 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 15:47:09.272381 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 15:47:09.272509 16864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:09.269117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:35061 (local address 127.8.39.66:49723)
0808 15:47:09.269467 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:09.269481 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:09.269578 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:09.269814 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:09.269816 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:09.269823 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 15:47:09.269909 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:09.269912 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:09.270667 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:09.270669 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:09.271382 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:09.271392 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:09.271831 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:09.271833 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:09.271895 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:09.271983 (+ 88us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 15:47:09.272256 (+ 273us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 15:47:09.272261 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 15:47:09.272309 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 15:47:09.272377 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":159,"threads_started":1}
I20260808 15:47:09.279940 16704 raft_consensus.cc:1261] T a8b65473b10d4afb84a8bd74efdcc62d P d13f0987f7054b72b940d1326216fa15 [term 1 FOLLOWER]: Refusing update from remote peer 35c4340a499e4784a5f41ad4ae0340b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:47:09.280021 16410 raft_consensus.cc:1261] T a8b65473b10d4afb84a8bd74efdcc62d P 0bd01d96196949bbb7303b7d4d722d69 [term 1 FOLLOWER]: Refusing update from remote peer 35c4340a499e4784a5f41ad4ae0340b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:47:09.280434 16859 consensus_queue.cc:1035] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d13f0987f7054b72b940d1326216fa15" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:47:09.280608 16802 consensus_queue.cc:1035] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd01d96196949bbb7303b7d4d722d69" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 35353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:47:09.298247 16861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:09.294703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:46771 (local address 127.8.39.66:40921)
0808 15:47:09.294833 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:09.294837 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:09.295129 (+ 292us) server_negotiation.cc:407] Connection header received
0808 15:47:09.295253 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:09.295256 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:09.295301 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:09.295388 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:47:09.295628 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:09.296142 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:09.297106 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:09.297326 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:09.297407 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:09.297707 (+ 300us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:47:09.297796 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:47:09.297868 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:09.298050 (+ 182us) server_negotiation.cc:299] Negotiation successful
0808 15:47:09.298106 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 15:47:09.298259 16869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:09.294524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:40921 (local address 127.8.39.67:46771)
0808 15:47:09.295033 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:09.295049 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:09.295168 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:09.295398 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:09.295401 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:09.295409 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 15:47:09.295517 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:09.295523 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:09.296253 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:09.296258 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:09.296987 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:09.296996 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:09.297431 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:09.297434 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:09.297524 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:09.297556 (+ 32us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 15:47:09.297947 (+ 391us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 15:47:09.297953 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 15:47:09.298036 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 15:47:09.298121 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":86,"threads_started":1}
I20260808 15:47:09.317207 16250 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33058:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:47:09.317409 16250 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33058:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:47:09.319468 16250 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5e1777b3ca284b9eb791bd7090096e26: Sending DeleteTablet for 3 replicas of tablet a8b65473b10d4afb84a8bd74efdcc62d
I20260808 15:47:09.320005 16390 tablet_service.cc:1514] Processing DeleteTablet for tablet a8b65473b10d4afb84a8bd74efdcc62d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:47:09 UTC) from {username='oryx', principal='oryx/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:60034
I20260808 15:47:09.320082 16538 tablet_service.cc:1514] Processing DeleteTablet for tablet a8b65473b10d4afb84a8bd74efdcc62d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:47:09 UTC) from {username='oryx', principal='oryx/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:39324
I20260808 15:47:09.320196 16683 tablet_service.cc:1514] Processing DeleteTablet for tablet a8b65473b10d4afb84a8bd74efdcc62d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:47:09 UTC) from {username='oryx', principal='oryx/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:37954
I20260808 15:47:09.320259 16807 tablet_replica.cc:330] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8: stopping tablet replica
I20260808 15:47:09.320259 16806 tablet_replica.cc:330] T a8b65473b10d4afb84a8bd74efdcc62d P 0bd01d96196949bbb7303b7d4d722d69: stopping tablet replica
I20260808 15:47:09.320367 16807 raft_consensus.cc:2229] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:47:09.320377 16805 tablet_replica.cc:330] T a8b65473b10d4afb84a8bd74efdcc62d P d13f0987f7054b72b940d1326216fa15: stopping tablet replica
I20260808 15:47:09.320367 16806 raft_consensus.cc:2229] T a8b65473b10d4afb84a8bd74efdcc62d P 0bd01d96196949bbb7303b7d4d722d69 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:47:09.320472 16806 raft_consensus.cc:2258] T a8b65473b10d4afb84a8bd74efdcc62d P 0bd01d96196949bbb7303b7d4d722d69 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:47:09.320494 16805 raft_consensus.cc:2229] T a8b65473b10d4afb84a8bd74efdcc62d P d13f0987f7054b72b940d1326216fa15 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:47:09.320586 16807 raft_consensus.cc:2258] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:47:09.320602 16805 raft_consensus.cc:2258] T a8b65473b10d4afb84a8bd74efdcc62d P d13f0987f7054b72b940d1326216fa15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:47:09.320842 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 16323
I20260808 15:47:09.321345 16807 ts_tablet_manager.cc:1905] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:47:09.323525 16807 ts_tablet_manager.cc:1918] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:47:09.323622 16807 log.cc:1196] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-1/wal/wals/a8b65473b10d4afb84a8bd74efdcc62d
I20260808 15:47:09.323868 16807 ts_tablet_manager.cc:1939] T a8b65473b10d4afb84a8bd74efdcc62d P 35c4340a499e4784a5f41ad4ae0340b8: Deleting consensus metadata
I20260808 15:47:09.325408 16805 ts_tablet_manager.cc:1905] T a8b65473b10d4afb84a8bd74efdcc62d P d13f0987f7054b72b940d1326216fa15: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:47:09.326866 16236 catalog_manager.cc:4841] TS 35c4340a499e4784a5f41ad4ae0340b8 (127.8.39.66:40921): tablet a8b65473b10d4afb84a8bd74efdcc62d (table test-table [id=e41b98809d3943ff99a97fe7857ddd4b]) successfully deleted
I20260808 15:47:09.327508 16805 ts_tablet_manager.cc:1918] T a8b65473b10d4afb84a8bd74efdcc62d P d13f0987f7054b72b940d1326216fa15: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 15:47:09.327607 16805 log.cc:1196] T a8b65473b10d4afb84a8bd74efdcc62d P d13f0987f7054b72b940d1326216fa15: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/a8b65473b10d4afb84a8bd74efdcc62d
I20260808 15:47:09.327873 16805 ts_tablet_manager.cc:1939] T a8b65473b10d4afb84a8bd74efdcc62d P d13f0987f7054b72b940d1326216fa15: Deleting consensus metadata
I20260808 15:47:09.328567 16237 catalog_manager.cc:4841] TS d13f0987f7054b72b940d1326216fa15 (127.8.39.67:35061): tablet a8b65473b10d4afb84a8bd74efdcc62d (table test-table [id=e41b98809d3943ff99a97fe7857ddd4b]) successfully deleted
W20260808 15:47:09.330516 16234 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.39.65:35353 (error 108)
I20260808 15:47:09.331426 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 16470
I20260808 15:47:09.339150 16872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:09.331291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:35353 (local address 127.0.0.1:60048)
0808 15:47:09.338925 (+ 7634us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:09.339038 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.65:35353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":72,"threads_started":1}
W20260808 15:47:09.339305 16234 catalog_manager.cc:4584] TS 0bd01d96196949bbb7303b7d4d722d69 (127.8.39.65:35353): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a8b65473b10d4afb84a8bd74efdcc62d: Network error: Client connection negotiation failed: client connection to 127.8.39.65:35353: connect: Connection refused (error 111)
I20260808 15:47:09.341575 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 16614
I20260808 15:47:09.350435 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 16218
2026-08-08T15:47:09Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3436 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:47:09 dist-test-slave-8tdl krb5kdc[16875](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:47:09 dist-test-slave-8tdl krb5kdc[16875](info): set up 2 sockets
Aug 08 15:47:09 dist-test-slave-8tdl krb5kdc[16875](info): commencing operation
krb5kdc: starting...
W20260808 15:47:10.484762 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.109s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:47:10 dist-test-slave-8tdl krb5kdc[16875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:47:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:47:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:47:10.630131 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:36165
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:36597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:36165
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:47:10.744472 16888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:10.744799 16888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:10.744896 16888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:10.748979 16888 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:47:10.749082 16888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:10.749122 16888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:10.749161 16888 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:47:10.749195 16888 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:47:10.754483 16888 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:36597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:36165
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:36165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:10.755721 16888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:10.756778 16888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:10.765617 16896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:10.765774 16888 server_base.cc:1034] running on GCE node
W20260808 15:47:10.765617 16894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:10.765620 16893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:10.766822 16888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:10.767970 16888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:10.769160 16888 hybrid_clock.cc:648] HybridClock initialized: now 1786204030769141 us; error 35 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T15:47:10Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1435 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:47:10 dist-test-slave-8tdl krb5kdc[16902](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:47:10 dist-test-slave-8tdl krb5kdc[16902](info): set up 2 sockets
Aug 08 15:47:10 dist-test-slave-8tdl krb5kdc[16902](info): commencing operation
krb5kdc: starting...
W20260808 15:47:11.928222 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:47:12 dist-test-slave-8tdl krb5kdc[16902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:47:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:47:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:47:12.062420 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:43797
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:36211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:43797
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:47:12.173813 16917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:12.174146 16917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:12.174233 16917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:12.178285 16917 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:47:12.178380 16917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:12.178422 16917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:12.178490 16917 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:47:12.178530 16917 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:47:12.183807 16917 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:36211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:43797
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:43797
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16917
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:12.184933 16917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:12.185971 16917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:12.195657 16927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:12.195675 16923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:12.195683 16924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:12.196194 16917 server_base.cc:1034] running on GCE node
I20260808 15:47:12.196735 16917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:12.197829 16917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:12.199039 16917 hybrid_clock.cc:648] HybridClock initialized: now 1786204032199008 us; error 40 us; skew 500 ppm
Aug 08 15:47:12 dist-test-slave-8tdl krb5kdc[16902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204032, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:47:12.201885 16917 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:47:12.202854 16917 webserver.cc:460] Webserver started at http://127.8.39.126:34889/ using document root <none> and password file <none>
I20260808 15:47:12.203399 16917 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:12.203460 16917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:12.203629 16917 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:47:12.205627 16917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "556e0a9495dd4e08b89deced04918642"
format_stamp: "Formatted at 2026-08-08 15:47:12 on dist-test-slave-8tdl"
server_key: "d024cd685b61fddfa375c3ed0cdb12c2"
server_key_iv: "d0fa362674d0bd710f6426f3d9e8d28d"
server_key_version: "encryptionkey@0"
I20260808 15:47:12.206159 16917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "556e0a9495dd4e08b89deced04918642"
format_stamp: "Formatted at 2026-08-08 15:47:12 on dist-test-slave-8tdl"
server_key: "d024cd685b61fddfa375c3ed0cdb12c2"
server_key_iv: "d0fa362674d0bd710f6426f3d9e8d28d"
server_key_version: "encryptionkey@0"
I20260808 15:47:12.209975 16917 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 15:47:12.212599 16934 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:12.213861 16917 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:47:12.214052 16917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "556e0a9495dd4e08b89deced04918642"
format_stamp: "Formatted at 2026-08-08 15:47:12 on dist-test-slave-8tdl"
server_key: "d024cd685b61fddfa375c3ed0cdb12c2"
server_key_iv: "d0fa362674d0bd710f6426f3d9e8d28d"
server_key_version: "encryptionkey@0"
I20260808 15:47:12.214167 16917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:12.255892 16917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:12.259857 16917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:12.260085 16917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:12.267628 16917 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:43797
I20260808 15:47:12.267656 16986 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:43797 every 8 connection(s)
I20260808 15:47:12.268602 16917 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:47:12.270124 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 16917
I20260808 15:47:12.270264 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:47:12.270565 8349 external_mini_cluster.cc:1428] Setting key fa0ee742714bd7f5895fe9c726f138e8
I20260808 15:47:12.271788 16987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:12.278837 16987 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642: Bootstrap starting.
Aug 08 15:47:12 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:47:12.281329 16987 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:12.282361 16987 log.cc:824] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642: Log is configured to *not* fsync() on all Append() calls
I20260808 15:47:12.284488 16987 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642: No bootstrap required, opened a new log
I20260808 15:47:12.286012 16990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:12.272097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36858 (local address 127.8.39.126:43797)
0808 15:47:12.272550 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:12.272569 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:12.272612 (+ 43us) server_negotiation.cc:407] Connection header received
0808 15:47:12.273456 (+ 844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:12.273479 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:12.273892 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:12.274250 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:12.275089 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:12.276610 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:12.277509 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:12.278207 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:12.278368 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:12.280934 (+ 2566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:12.280940 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:12.280956 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:12.280988 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:12.283081 (+ 2093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:12.283597 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:12.283607 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:12.283611 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:12.283731 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:12.284042 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:12.284050 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:12.284051 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:12.284479 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:12.284699 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:12.284965 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 15:47:12.285282 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":132,"threads_started":1}
I20260808 15:47:12.289011 16987 raft_consensus.cc:348] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "556e0a9495dd4e08b89deced04918642" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43797 } }
I20260808 15:47:12.289301 16987 raft_consensus.cc:374] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:12.289392 16987 raft_consensus.cc:729] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 556e0a9495dd4e08b89deced04918642, State: Initialized, Role: FOLLOWER
I20260808 15:47:12.289918 16987 consensus_queue.cc:260] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "556e0a9495dd4e08b89deced04918642" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43797 } }
I20260808 15:47:12.290094 16987 raft_consensus.cc:388] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:47:12.290172 16987 raft_consensus.cc:482] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:47:12.290292 16987 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:12.291567 16987 raft_consensus.cc:504] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "556e0a9495dd4e08b89deced04918642" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43797 } }
I20260808 15:47:12.291929 16987 leader_election.cc:302] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 556e0a9495dd4e08b89deced04918642; no voters:
I20260808 15:47:12.292299 16987 leader_election.cc:288] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:47:12.292465 16992 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:47:12.292742 16992 raft_consensus.cc:686] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [term 1 LEADER]: Becoming Leader. State: Replica: 556e0a9495dd4e08b89deced04918642, State: Running, Role: LEADER
I20260808 15:47:12.293484 16992 consensus_queue.cc:237] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "556e0a9495dd4e08b89deced04918642" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43797 } }
I20260808 15:47:12.293685 16987 sys_catalog.cc:564] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:47:12.295331 16994 sys_catalog.cc:455] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 556e0a9495dd4e08b89deced04918642. Latest consensus state: current_term: 1 leader_uuid: "556e0a9495dd4e08b89deced04918642" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "556e0a9495dd4e08b89deced04918642" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43797 } } }
I20260808 15:47:12.295472 16994 sys_catalog.cc:458] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [sys.catalog]: This master's current role is: LEADER
I20260808 15:47:12.295894 17004 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:47:12.295847 16993 sys_catalog.cc:455] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "556e0a9495dd4e08b89deced04918642" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "556e0a9495dd4e08b89deced04918642" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43797 } } }
I20260808 15:47:12.296010 16993 sys_catalog.cc:458] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [sys.catalog]: This master's current role is: LEADER
I20260808 15:47:12.299228 17004 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:47:12.308288 17004 catalog_manager.cc:1347] Generated new cluster ID: dfaeda56382046399f4e09f999a14c31
I20260808 15:47:12.308387 17004 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:47:12.326174 17004 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:47:12.327571 17004 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:47:12.340837 17004 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642: Generated new TSK 0
I20260808 15:47:12.341734 17004 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.39.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
I20260808 15:47:12.375020 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:0
--local_ip_for_outbound_sockets=127.8.39.65
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:43797
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:36211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:47:12.492689 17014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:12.492951 17014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:12.492995 17014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:12.497448 17014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:12.497514 17014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:12.497617 17014 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:47:12.503084 17014 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:36211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:43797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17014
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:12.504172 17014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:12.505221 17014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:12.515136 17020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:12.515136 17022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:12.515136 17019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:12.515334 17014 server_base.cc:1034] running on GCE node
I20260808 15:47:12.515904 17014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:12.516566 17014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:12.517748 17014 hybrid_clock.cc:648] HybridClock initialized: now 1786204032517736 us; error 25 us; skew 500 ppm
Aug 08 15:47:12 dist-test-slave-8tdl krb5kdc[16902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204032, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:47:12.520675 17014 init.cc:377] Logged in from keytab as kudu/127.8.39.65@KRBTEST.COM (short username kudu)
I20260808 15:47:12.521631 17014 webserver.cc:460] Webserver started at http://127.8.39.65:43611/ using document root <none> and password file <none>
I20260808 15:47:12.522219 17014 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:12.522315 17014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:12.522563 17014 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:47:12.524684 17014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/data/instance:
uuid: "05b8d2a3fd384e4098ebdb762a35a92d"
format_stamp: "Formatted at 2026-08-08 15:47:12 on dist-test-slave-8tdl"
server_key: "3dc118b09be2426729368bc65f250a04"
server_key_iv: "ccbea9a8653ceb1b1a4eadb48bc2cc19"
server_key_version: "encryptionkey@0"
I20260808 15:47:12.525269 17014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance:
uuid: "05b8d2a3fd384e4098ebdb762a35a92d"
format_stamp: "Formatted at 2026-08-08 15:47:12 on dist-test-slave-8tdl"
server_key: "3dc118b09be2426729368bc65f250a04"
server_key_iv: "ccbea9a8653ceb1b1a4eadb48bc2cc19"
server_key_version: "encryptionkey@0"
I20260808 15:47:12.529055 17014 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 15:47:12.531587 17029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:12.532845 17014 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:47:12.533007 17014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "05b8d2a3fd384e4098ebdb762a35a92d"
format_stamp: "Formatted at 2026-08-08 15:47:12 on dist-test-slave-8tdl"
server_key: "3dc118b09be2426729368bc65f250a04"
server_key_iv: "ccbea9a8653ceb1b1a4eadb48bc2cc19"
server_key_version: "encryptionkey@0"
I20260808 15:47:12.533129 17014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:12.547341 17014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:12.550791 17014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:12.551017 17014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:12.551625 17014 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:47:12.552455 17014 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:47:12.552527 17014 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:12.552599 17014 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:47:12.552651 17014 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:12.561719 17014 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:46711
I20260808 15:47:12.561748 17146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:46711 every 8 connection(s)
I20260808 15:47:12.562731 17014 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
Aug 08 15:47:12 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204032, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:47:12.572820 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 17014
I20260808 15:47:12.572973 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance
I20260808 15:47:12.573385 8349 external_mini_cluster.cc:1428] Setting key 17eb329ab1c8684d031ca1ec750f202e
I20260808 15:47:12.577025 16990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:12.564683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:48905 (local address 127.8.39.126:43797)
0808 15:47:12.564831 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:12.564835 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:12.565874 (+ 1039us) server_negotiation.cc:407] Connection header received
0808 15:47:12.566718 (+ 844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:12.566721 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:12.566781 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:12.566856 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:12.568034 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:12.568642 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:12.569825 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:12.570091 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:12.570186 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:12.572799 (+ 2613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:12.572802 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:12.572804 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:12.572846 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:12.574599 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:12.575270 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:12.575273 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:12.575274 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:12.575351 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:12.575779 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:12.575781 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:12.575783 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:12.575970 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:12.576085 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:12.576753 (+ 668us) server_negotiation.cc:299] Negotiation successful
0808 15:47:12.576874 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 15:47:12.577988 17149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:12.565018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.65:48905)
0808 15:47:12.565710 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:12.565752 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:12.566502 (+ 750us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:12.567011 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:12.567017 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:12.567368 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:12.567865 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:12.567878 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:12.568776 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:12.568779 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:12.569688 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:12.569697 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:12.570240 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:12.570243 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:12.570387 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:12.571074 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:12.571090 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:12.572585 (+ 1495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:12.574759 (+ 2174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:12.574768 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:12.574786 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:12.575162 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:12.575453 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:12.575458 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:12.575461 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:12.575668 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:12.576115 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:12.576124 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:12.576468 (+ 344us) client_negotiation.cc:769] Sending connection context
0808 15:47:12.576718 (+ 250us) client_negotiation.cc:240] Negotiation successful
0808 15:47:12.577096 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":135,"threads_started":1}
I20260808 15:47:12.579452 17147 heartbeater.cc:347] Connected to a master server at 127.8.39.126:43797
I20260808 15:47:12.579759 17147 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:12.580313 17147 heartbeater.cc:511] Master 127.8.39.126:43797 requested a full tablet report, sending...
I20260808 15:47:12.582011 16951 ts_manager.cc:194] Registered new tserver with Master: 05b8d2a3fd384e4098ebdb762a35a92d (127.8.39.65:46711)
I20260808 15:47:12.583338 16951 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.65@KRBTEST.COM'} at 127.8.39.65:48905
WARNING: no policy specified for kudu/127.8.39.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
I20260808 15:47:12.606330 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:0
--local_ip_for_outbound_sockets=127.8.39.66
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:43797
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:36211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:47:12.726027 17152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:12.726293 17152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:12.726387 17152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:12.730435 17152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:12.730507 17152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:12.730567 17152 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:47:12.736024 17152 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:36211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:43797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17152
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:12.737293 17152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:12.738395 17152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:12.748490 17159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:12.748526 17158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:12.748710 17152 server_base.cc:1034] running on GCE node
W20260808 15:47:12.748575 17161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:12.749310 17152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:12.750031 17152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:12.751226 17152 hybrid_clock.cc:648] HybridClock initialized: now 1786204032751176 us; error 66 us; skew 500 ppm
Aug 08 15:47:12 dist-test-slave-8tdl krb5kdc[16902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204032, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:47:12.754179 17152 init.cc:377] Logged in from keytab as kudu/127.8.39.66@KRBTEST.COM (short username kudu)
I20260808 15:47:12.755208 17152 webserver.cc:460] Webserver started at http://127.8.39.66:37659/ using document root <none> and password file <none>
I20260808 15:47:12.755787 17152 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:12.755880 17152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:12.756119 17152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:47:12.758256 17152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/data/instance:
uuid: "c7f1946d7c0b4af492a91383772a8a70"
format_stamp: "Formatted at 2026-08-08 15:47:12 on dist-test-slave-8tdl"
server_key: "ffabc2ff0eb6ed4599cbbddaa4b19952"
server_key_iv: "cdb90203201f9a1339f854c34f6fa728"
server_key_version: "encryptionkey@0"
I20260808 15:47:12.758921 17152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance:
uuid: "c7f1946d7c0b4af492a91383772a8a70"
format_stamp: "Formatted at 2026-08-08 15:47:12 on dist-test-slave-8tdl"
server_key: "ffabc2ff0eb6ed4599cbbddaa4b19952"
server_key_iv: "cdb90203201f9a1339f854c34f6fa728"
server_key_version: "encryptionkey@0"
I20260808 15:47:12.762749 17152 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 15:47:12.765331 17168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:12.766601 17152 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:47:12.766789 17152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "c7f1946d7c0b4af492a91383772a8a70"
format_stamp: "Formatted at 2026-08-08 15:47:12 on dist-test-slave-8tdl"
server_key: "ffabc2ff0eb6ed4599cbbddaa4b19952"
server_key_iv: "cdb90203201f9a1339f854c34f6fa728"
server_key_version: "encryptionkey@0"
I20260808 15:47:12.766909 17152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:12.783406 17152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:12.786612 17152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:12.786856 17152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:12.787490 17152 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:47:12.788504 17152 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:47:12.788566 17152 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:12.788635 17152 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:47:12.788667 17152 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:12.798547 17152 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:41301
I20260808 15:47:12.798570 17287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:41301 every 8 connection(s)
I20260808 15:47:12.799510 17152 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:47:12.804247 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 17152
I20260808 15:47:12.804390 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance
I20260808 15:47:12.804721 8349 external_mini_cluster.cc:1428] Setting key d581e8d5249cc76fb3e197f08e9bb378
Aug 08 15:47:12 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204032, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:47:12.814597 16990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:12.801452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:44803 (local address 127.8.39.126:43797)
0808 15:47:12.801636 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:12.801641 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:12.802810 (+ 1169us) server_negotiation.cc:407] Connection header received
0808 15:47:12.803729 (+ 919us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:12.803731 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:12.803784 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:12.803869 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:12.805504 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:12.806068 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:12.807798 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:12.808019 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:12.808105 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:12.810913 (+ 2808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:12.810917 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:12.810920 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:12.810951 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:12.812473 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:12.813021 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:12.813030 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:12.813031 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:12.813107 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:12.813458 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:12.813461 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:12.813463 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:12.813656 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:12.813763 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:12.814287 (+ 524us) server_negotiation.cc:299] Negotiation successful
0808 15:47:12.814424 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
WARNING: no policy specified for kudu/127.8.39.67@KRBTEST.COM; defaulting to no policy
I20260808 15:47:12.815623 17290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:12.801914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.66:44803)
0808 15:47:12.802616 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:12.802658 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:12.803462 (+ 804us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:12.804084 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:12.804095 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:12.804641 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:12.805295 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:12.805340 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:12.806201 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:12.806204 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:12.807670 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:12.807685 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:12.808176 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:12.808182 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:12.808415 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:12.809207 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:12.809224 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:12.810749 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:12.812601 (+ 1852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:12.812607 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:12.812623 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:12.812894 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:12.813202 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:12.813206 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:12.813208 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:12.813354 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:12.813777 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:12.813786 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:12.814040 (+ 254us) client_negotiation.cc:769] Sending connection context
0808 15:47:12.814231 (+ 191us) client_negotiation.cc:240] Negotiation successful
0808 15:47:12.814579 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":129,"threads_started":1}
I20260808 15:47:12.816828 17288 heartbeater.cc:347] Connected to a master server at 127.8.39.126:43797
I20260808 15:47:12.817096 17288 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:12.817694 17288 heartbeater.cc:511] Master 127.8.39.126:43797 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.67@KRBTEST.COM" created.
I20260808 15:47:12.818909 16951 ts_manager.cc:194] Registered new tserver with Master: c7f1946d7c0b4af492a91383772a8a70 (127.8.39.66:41301)
I20260808 15:47:12.819511 16951 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.66@KRBTEST.COM'} at 127.8.39.66:44803
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
I20260808 15:47:12.834461 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:0
--local_ip_for_outbound_sockets=127.8.39.67
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:43797
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:36211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:47:12.950053 17294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:12.950366 17294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:12.950445 17294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:12.954485 17294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:12.954586 17294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:12.954696 17294 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:47:12.959944 17294 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:36211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:43797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17294
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:12.961052 17294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:12.962097 17294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:12.971796 17299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:12.971819 17300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:12.972167 17302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:12.972203 17294 server_base.cc:1034] running on GCE node
I20260808 15:47:12.972566 17294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:12.973181 17294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:12.974345 17294 hybrid_clock.cc:648] HybridClock initialized: now 1786204032974326 us; error 31 us; skew 500 ppm
Aug 08 15:47:12 dist-test-slave-8tdl krb5kdc[16902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204032, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:47:12.977138 17294 init.cc:377] Logged in from keytab as kudu/127.8.39.67@KRBTEST.COM (short username kudu)
I20260808 15:47:12.977922 17294 webserver.cc:460] Webserver started at http://127.8.39.67:39813/ using document root <none> and password file <none>
I20260808 15:47:12.978438 17294 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:12.978498 17294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:12.978662 17294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:47:12.980707 17294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/data/instance:
uuid: "e73fbcc86eed44459d497b89d77dd8fd"
format_stamp: "Formatted at 2026-08-08 15:47:12 on dist-test-slave-8tdl"
server_key: "eda2f371f0f0b76a687a71fb63dccca6"
server_key_iv: "c39ce79a008c8678c9f4589e9978eae0"
server_key_version: "encryptionkey@0"
I20260808 15:47:12.981257 17294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance:
uuid: "e73fbcc86eed44459d497b89d77dd8fd"
format_stamp: "Formatted at 2026-08-08 15:47:12 on dist-test-slave-8tdl"
server_key: "eda2f371f0f0b76a687a71fb63dccca6"
server_key_iv: "c39ce79a008c8678c9f4589e9978eae0"
server_key_version: "encryptionkey@0"
I20260808 15:47:12.984907 17294 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 15:47:12.987357 17309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:12.988613 17294 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:47:12.988709 17294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "e73fbcc86eed44459d497b89d77dd8fd"
format_stamp: "Formatted at 2026-08-08 15:47:12 on dist-test-slave-8tdl"
server_key: "eda2f371f0f0b76a687a71fb63dccca6"
server_key_iv: "c39ce79a008c8678c9f4589e9978eae0"
server_key_version: "encryptionkey@0"
I20260808 15:47:12.988842 17294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:13.008437 17294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:13.011776 17294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:13.011999 17294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:13.012669 17294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:47:13.013520 17294 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:47:13.013566 17294 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:13.013607 17294 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:47:13.013622 17294 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:13.023102 17294 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:41531
I20260808 15:47:13.023130 17429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:41531 every 8 connection(s)
I20260808 15:47:13.024041 17294 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:47:13.032704 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 17294
I20260808 15:47:13.032819 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance
I20260808 15:47:13.033171 8349 external_mini_cluster.cc:1428] Setting key c788d95bdada9d4042505bd149f6e68c
Aug 08 15:47:13 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204032, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:47:13.038026 16990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:13.025819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:56387 (local address 127.8.39.126:43797)
0808 15:47:13.025962 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:13.025966 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:13.027176 (+ 1210us) server_negotiation.cc:407] Connection header received
0808 15:47:13.028067 (+ 891us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:13.028070 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:13.028128 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:13.028211 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:13.029370 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.029911 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.031112 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.031346 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.031461 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:13.034126 (+ 2665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:13.034134 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:13.034136 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:13.034161 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:13.035908 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:13.036450 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:13.036459 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:13.036460 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:13.036557 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:13.036902 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:13.036906 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:13.036908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:13.037094 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:13.037214 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:13.037800 (+ 586us) server_negotiation.cc:299] Negotiation successful
0808 15:47:13.037901 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 15:47:13.039088 17433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:13.026247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.67:56387)
0808 15:47:13.026972 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:13.027059 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:13.027853 (+ 794us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:13.028372 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:13.028379 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:13.028740 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:13.029215 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:13.029228 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.030052 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.030060 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:13.030956 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:13.030965 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.031506 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.031510 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:13.031684 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:13.032277 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:13.032293 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:13.033863 (+ 1570us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:13.036028 (+ 2165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:13.036037 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:13.036054 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:13.036340 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:13.036655 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:13.036659 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:13.036660 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:13.036805 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:13.037252 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:13.037258 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:13.037570 (+ 312us) client_negotiation.cc:769] Sending connection context
0808 15:47:13.037755 (+ 185us) client_negotiation.cc:240] Negotiation successful
0808 15:47:13.038085 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":120,"threads_started":1}
I20260808 15:47:13.040212 17430 heartbeater.cc:347] Connected to a master server at 127.8.39.126:43797
I20260808 15:47:13.040483 17430 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:13.041003 17430 heartbeater.cc:511] Master 127.8.39.126:43797 requested a full tablet report, sending...
I20260808 15:47:13.042027 16951 ts_manager.cc:194] Registered new tserver with Master: e73fbcc86eed44459d497b89d77dd8fd (127.8.39.67:41531)
I20260808 15:47:13.042665 16951 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.67@KRBTEST.COM'} at 127.8.39.67:56387
I20260808 15:47:13.047509 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.8.39.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.39.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.39.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.65.keytab.
Entry for principal oryx/127.8.39.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.65.keytab.
WARNING: no policy specified for oryx/127.8.39.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.39.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.39.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.66.keytab.
Entry for principal oryx/127.8.39.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.66.keytab.
WARNING: no policy specified for oryx/127.8.39.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.39.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.39.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.67.keytab.
Entry for principal oryx/127.8.39.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.67.keytab.
I20260808 15:47:13.133407 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 17014
I20260808 15:47:13.140364 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 17152
I20260808 15:47:13.147511 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 17294
I20260808 15:47:13.154659 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 16917
I20260808 15:47:13.163443 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:43797
--webserver_interface=127.8.39.126
--webserver_port=34889
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:36211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:43797
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:47:13.275580 17440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:13.275879 17440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:13.275960 17440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:13.279932 17440 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:47:13.280030 17440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:13.280071 17440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:13.280129 17440 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:47:13.280170 17440 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:47:13.285342 17440 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:36211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:43797
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:43797
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=34889
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17440
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:13.286409 17440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:13.287441 17440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:13.296717 17446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:13.296777 17445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:13.296717 17448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:13.296916 17440 server_base.cc:1034] running on GCE node
I20260808 15:47:13.297559 17440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:13.298791 17440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:13.299976 17440 hybrid_clock.cc:648] HybridClock initialized: now 1786204033299961 us; error 30 us; skew 500 ppm
Aug 08 15:47:13 dist-test-slave-8tdl krb5kdc[16902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204033, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:47:13.302752 17440 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:47:13.303691 17440 webserver.cc:460] Webserver started at http://127.8.39.126:34889/ using document root <none> and password file <none>
I20260808 15:47:13.304260 17440 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:13.304378 17440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:13.308290 17440 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260808 15:47:13.310539 17455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:13.311887 17440 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 15:47:13.312032 17440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "556e0a9495dd4e08b89deced04918642"
format_stamp: "Formatted at 2026-08-08 15:47:12 on dist-test-slave-8tdl"
server_key: "d024cd685b61fddfa375c3ed0cdb12c2"
server_key_iv: "d0fa362674d0bd710f6426f3d9e8d28d"
server_key_version: "encryptionkey@0"
I20260808 15:47:13.312603 17440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:13.330780 17440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:13.333976 17440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:13.334193 17440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:13.341594 17440 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:43797
I20260808 15:47:13.341656 17509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:43797 every 8 connection(s)
I20260808 15:47:13.342752 17440 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:47:13.347044 17510 sys_catalog.cc:263] Verifying existing consensus state
I20260808 15:47:13.348654 17510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642: Bootstrap starting.
I20260808 15:47:13.350651 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 17440
I20260808 15:47:13.351188 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:46711
--local_ip_for_outbound_sockets=127.8.39.65
--tserver_master_addrs=127.8.39.126:43797
--webserver_port=43611
--webserver_interface=127.8.39.65
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:36211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.8.39.65
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:47:13.367025 17510 log.cc:824] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642: Log is configured to *not* fsync() on all Append() calls
I20260808 15:47:13.373644 17510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 15:47:13.374096 17510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642: Bootstrap complete.
I20260808 15:47:13.378597 17510 raft_consensus.cc:348] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "556e0a9495dd4e08b89deced04918642" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43797 } }
I20260808 15:47:13.379078 17510 raft_consensus.cc:729] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 556e0a9495dd4e08b89deced04918642, State: Initialized, Role: FOLLOWER
I20260808 15:47:13.379560 17510 consensus_queue.cc:260] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "556e0a9495dd4e08b89deced04918642" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43797 } }
I20260808 15:47:13.379671 17510 raft_consensus.cc:388] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:47:13.379760 17510 raft_consensus.cc:482] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:47:13.379851 17510 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [term 1 FOLLOWER]: Advancing to term 2
I20260808 15:47:13.381773 17510 raft_consensus.cc:504] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "556e0a9495dd4e08b89deced04918642" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43797 } }
I20260808 15:47:13.382102 17510 leader_election.cc:302] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 556e0a9495dd4e08b89deced04918642; no voters:
I20260808 15:47:13.382413 17510 leader_election.cc:288] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 15:47:13.382560 17514 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 15:47:13.382819 17514 raft_consensus.cc:686] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [term 2 LEADER]: Becoming Leader. State: Replica: 556e0a9495dd4e08b89deced04918642, State: Running, Role: LEADER
I20260808 15:47:13.383245 17514 consensus_queue.cc:237] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "556e0a9495dd4e08b89deced04918642" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43797 } }
I20260808 15:47:13.383718 17510 sys_catalog.cc:564] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:47:13.384743 17516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 556e0a9495dd4e08b89deced04918642. Latest consensus state: current_term: 2 leader_uuid: "556e0a9495dd4e08b89deced04918642" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "556e0a9495dd4e08b89deced04918642" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43797 } } }
I20260808 15:47:13.384881 17516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [sys.catalog]: This master's current role is: LEADER
I20260808 15:47:13.385251 17523 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:47:13.385219 17515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "556e0a9495dd4e08b89deced04918642" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "556e0a9495dd4e08b89deced04918642" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 43797 } } }
I20260808 15:47:13.385389 17515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642 [sys.catalog]: This master's current role is: LEADER
I20260808 15:47:13.388669 17523 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:47:13.389393 17523 catalog_manager.cc:1259] Loaded cluster ID: dfaeda56382046399f4e09f999a14c31
I20260808 15:47:13.389457 17523 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:47:13.391772 17523 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:47:13.392436 17523 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 556e0a9495dd4e08b89deced04918642: Loaded TSK: 0
I20260808 15:47:13.393626 17523 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 15:47:13.470501 17512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:13.470844 17512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:13.470930 17512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:13.475085 17512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:13.475157 17512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:13.475250 17512 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:47:13.480693 17512 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:36211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.65.keytab
--principal=oryx/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:46711
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=43611
--tserver_master_addrs=127.8.39.126:43797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17512
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:13.481808 17512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:13.482919 17512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:13.493044 17537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:13.493098 17538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:13.493348 17512 server_base.cc:1034] running on GCE node
W20260808 15:47:13.493505 17540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:13.493965 17512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:13.494644 17512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:13.495841 17512 hybrid_clock.cc:648] HybridClock initialized: now 1786204033495819 us; error 50 us; skew 500 ppm
Aug 08 15:47:13 dist-test-slave-8tdl krb5kdc[16902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204033, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:47:13.498617 17512 init.cc:377] Logged in from keytab as oryx/127.8.39.65@KRBTEST.COM (short username oryx)
I20260808 15:47:13.499606 17512 webserver.cc:460] Webserver started at http://127.8.39.65:43611/ using document root <none> and password file <none>
I20260808 15:47:13.500171 17512 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:13.500247 17512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:13.504284 17512 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260808 15:47:13.506542 17547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:13.507884 17512 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 15:47:13.508025 17512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "05b8d2a3fd384e4098ebdb762a35a92d"
format_stamp: "Formatted at 2026-08-08 15:47:12 on dist-test-slave-8tdl"
server_key: "3dc118b09be2426729368bc65f250a04"
server_key_iv: "ccbea9a8653ceb1b1a4eadb48bc2cc19"
server_key_version: "encryptionkey@0"
I20260808 15:47:13.508615 17512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:13.540530 17512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:13.543607 17512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:13.543818 17512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:13.544457 17512 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:47:13.545303 17512 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:47:13.545375 17512 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:13.545447 17512 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:47:13.545496 17512 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:13.554476 17512 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:46711
I20260808 15:47:13.554498 17664 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:46711 every 8 connection(s)
I20260808 15:47:13.555584 17512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:47:13.559494 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 17512
I20260808 15:47:13.560132 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:41301
--local_ip_for_outbound_sockets=127.8.39.66
--tserver_master_addrs=127.8.39.126:43797
--webserver_port=37659
--webserver_interface=127.8.39.66
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:36211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.8.39.66
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 15:47:13 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:13 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:13.569955 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:13.557711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.65:59925)
0808 15:47:13.558400 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:13.558440 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:13.559229 (+ 789us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:13.560687 (+ 1458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:13.560693 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:13.561035 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:13.561495 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:13.561508 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.563224 (+ 1716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.563230 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:13.564204 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:13.564214 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.565491 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.565494 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:13.565637 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:13.566368 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:13.566390 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:13.569194 (+ 2804us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":159,"threads_started":1}
W20260808 15:47:13.570580 17665 heartbeater.cc:644] Failed to heartbeat to 127.8.39.126:43797 (0 consecutive failures): Not authorized: Failed to ping master at 127.8.39.126:43797: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
W20260808 15:47:13.571334 17667 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:13.557627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:59925 (local address 127.8.39.126:43797)
0808 15:47:13.558113 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:13.558134 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:13.558566 (+ 432us) server_negotiation.cc:407] Connection header received
0808 15:47:13.559737 (+ 1171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:13.559755 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:13.560193 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:13.560667 (+ 474us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:13.561692 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.563059 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.564358 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.565296 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.565526 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:13.569562 (+ 4036us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.65:59925: BlockingRecv error: recv got EOF from 127.8.39.65:59925 (error 108)
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":98,"threads_started":1}
Aug 08 15:47:13 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:13 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:13.577301 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:13.571159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.65:52559)
0808 15:47:13.571349 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:13.571365 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:13.571451 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:13.572018 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:13.572020 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:13.572171 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:13.572263 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:13.572268 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.573607 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.573610 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:13.574155 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:13.574163 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.574783 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.574785 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:13.574863 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:13.575382 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:13.575396 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:13.577207 (+ 1811us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108}
W20260808 15:47:13.577497 17667 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:13.571215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:52559 (local address 127.8.39.126:43797)
0808 15:47:13.571729 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:13.571736 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:13.571755 (+ 19us) server_negotiation.cc:407] Connection header received
0808 15:47:13.571806 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:13.571811 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:13.571877 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:13.571975 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:13.572400 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.573476 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.574284 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.574631 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.574775 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:13.577374 (+ 2599us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.65:52559: BlockingRecv error: recv got EOF from 127.8.39.65:52559 (error 108)
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":100,"threads_started":1}
Aug 08 15:47:13 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:13 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:13.583212 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:13.577918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.65:59731)
0808 15:47:13.578084 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:13.578098 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:13.578163 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:13.578380 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:13.578383 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:13.578547 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:13.578633 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:13.578638 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.579338 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.579341 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:13.580212 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:13.580221 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.580632 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.580637 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:13.580744 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:13.581199 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:13.581213 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:13.583087 (+ 1874us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":105}
W20260808 15:47:13.583439 17665 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 15:47:13.583662 17667 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:13.578022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:59731 (local address 127.8.39.126:43797)
0808 15:47:13.578135 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:13.578138 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:13.578158 (+ 20us) server_negotiation.cc:407] Connection header received
0808 15:47:13.578240 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:13.578242 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:13.578276 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:13.578341 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:13.578767 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.579239 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.580325 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.580520 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.580600 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:13.583242 (+ 2642us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.65:59731: BlockingRecv error: recv got EOF from 127.8.39.65:59731 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260808 15:47:13.680748 17669 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:13.681087 17669 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:13.681164 17669 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:13.685784 17669 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:13.685891 17669 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:13.685987 17669 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:47:13.691569 17669 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:36211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.66.keytab
--principal=oryx/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:41301
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=37659
--tserver_master_addrs=127.8.39.126:43797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17669
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:13.692828 17669 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:13.693871 17669 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:13.704193 17675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:13.704306 17676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:13.704325 17678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:13.704654 17669 server_base.cc:1034] running on GCE node
I20260808 15:47:13.705073 17669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:13.705736 17669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:13.706918 17669 hybrid_clock.cc:648] HybridClock initialized: now 1786204033706886 us; error 49 us; skew 500 ppm
Aug 08 15:47:13 dist-test-slave-8tdl krb5kdc[16902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204033, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:47:13.709718 17669 init.cc:377] Logged in from keytab as oryx/127.8.39.66@KRBTEST.COM (short username oryx)
I20260808 15:47:13.710635 17669 webserver.cc:460] Webserver started at http://127.8.39.66:37659/ using document root <none> and password file <none>
I20260808 15:47:13.711242 17669 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:13.711354 17669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:13.715413 17669 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260808 15:47:13.717608 17685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:13.719172 17669 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:47:13.719319 17669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "c7f1946d7c0b4af492a91383772a8a70"
format_stamp: "Formatted at 2026-08-08 15:47:12 on dist-test-slave-8tdl"
server_key: "ffabc2ff0eb6ed4599cbbddaa4b19952"
server_key_iv: "cdb90203201f9a1339f854c34f6fa728"
server_key_version: "encryptionkey@0"
I20260808 15:47:13.719908 17669 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:13.736071 17669 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:13.739436 17669 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:13.739655 17669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:13.740284 17669 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:47:13.741140 17669 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:47:13.741210 17669 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:13.741285 17669 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:47:13.741336 17669 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:13.751324 17669 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:41301
I20260808 15:47:13.751353 17801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:41301 every 8 connection(s)
I20260808 15:47:13.752362 17669 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:47:13.758879 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 17669
I20260808 15:47:13.759459 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:41531
--local_ip_for_outbound_sockets=127.8.39.67
--tserver_master_addrs=127.8.39.126:43797
--webserver_port=39813
--webserver_interface=127.8.39.67
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:36211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.8.39.67
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 15:47:13 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:13 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 15:47:13.765249 17667 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:13.754269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:57365 (local address 127.8.39.126:43797)
0808 15:47:13.754438 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:13.754443 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:13.755533 (+ 1090us) server_negotiation.cc:407] Connection header received
0808 15:47:13.756492 (+ 959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:13.756495 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:13.756552 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:13.756640 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:13.757912 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.758453 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.760551 (+ 2098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.760776 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.760876 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:13.765065 (+ 4189us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.66:57365: BlockingRecv error: recv got EOF from 127.8.39.66:57365 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 15:47:13.766021 17804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:13.754567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.66:57365)
0808 15:47:13.755360 (+ 793us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:13.755410 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:13.756239 (+ 829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:13.756821 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:13.756830 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:13.757204 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:13.757733 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:13.757747 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.758640 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.758644 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:13.760364 (+ 1720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:13.760381 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.760960 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.760968 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:13.761241 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:13.762002 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:13.762021 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:13.764831 (+ 2810us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":199,"threads_started":1}
W20260808 15:47:13.766748 17802 heartbeater.cc:644] Failed to heartbeat to 127.8.39.126:43797 (0 consecutive failures): Not authorized: Failed to ping master at 127.8.39.126:43797: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Aug 08 15:47:13 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:13 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:13.773577 17804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:13.767308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.66:50155)
0808 15:47:13.767607 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:13.767621 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:13.767691 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:13.767979 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:13.767981 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:13.768132 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:13.768228 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:13.768232 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.769361 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.769365 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:13.770036 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:13.770045 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.770779 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.770782 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:13.770900 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:13.771448 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:13.771461 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:13.773477 (+ 2016us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":233}
W20260808 15:47:13.773990 17667 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:13.767477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:50155 (local address 127.8.39.126:43797)
0808 15:47:13.767641 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:13.767648 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:13.767668 (+ 20us) server_negotiation.cc:407] Connection header received
0808 15:47:13.767775 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:13.767779 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:13.767839 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:13.767956 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:13.768354 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.769231 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.770176 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.770589 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.770737 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:13.773651 (+ 2914us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.66:50155: BlockingRecv error: recv got EOF from 127.8.39.66:50155 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 08 15:47:13 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:13 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:13.779824 17804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:13.774194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.66:46105)
0808 15:47:13.774323 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:13.774338 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:13.774413 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:13.774797 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:13.774800 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:13.774968 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:13.775047 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:13.775052 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.776085 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.776088 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:13.776614 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:13.776622 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.777168 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.777171 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:13.777229 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:13.777771 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:13.777784 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:13.779728 (+ 1944us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 15:47:13.780043 17802 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 15:47:13.780206 17667 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:13.774466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:46105 (local address 127.8.39.126:43797)
0808 15:47:13.774573 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:13.774577 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:13.774589 (+ 12us) server_negotiation.cc:407] Connection header received
0808 15:47:13.774622 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:13.774625 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:13.774664 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:13.774762 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:13.775160 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.775953 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.776724 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.777064 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.777157 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:13.779881 (+ 2724us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.66:46105: BlockingRecv error: recv got EOF from 127.8.39.66:46105 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260808 15:47:13.876968 17805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:13.877230 17805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:13.877274 17805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:13.881253 17805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:13.881316 17805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:13.881410 17805 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:47:13.886960 17805 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:36211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/krb5kdc/oryx_127.8.39.67.keytab
--principal=oryx/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:41531
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=39813
--tserver_master_addrs=127.8.39.126:43797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17805
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:13.888059 17805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:13.889114 17805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:13.899020 17811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:13.899099 17812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:13.899030 17814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:13.899228 17805 server_base.cc:1034] running on GCE node
I20260808 15:47:13.899847 17805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:13.900653 17805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:13.901845 17805 hybrid_clock.cc:648] HybridClock initialized: now 1786204033901815 us; error 52 us; skew 500 ppm
Aug 08 15:47:13 dist-test-slave-8tdl krb5kdc[16902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204033, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:47:13.904928 17805 init.cc:377] Logged in from keytab as oryx/127.8.39.67@KRBTEST.COM (short username oryx)
I20260808 15:47:13.905833 17805 webserver.cc:460] Webserver started at http://127.8.39.67:39813/ using document root <none> and password file <none>
I20260808 15:47:13.906392 17805 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:13.906503 17805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:13.910466 17805 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:47:13.912791 17821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:13.914139 17805 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:47:13.914275 17805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "e73fbcc86eed44459d497b89d77dd8fd"
format_stamp: "Formatted at 2026-08-08 15:47:12 on dist-test-slave-8tdl"
server_key: "eda2f371f0f0b76a687a71fb63dccca6"
server_key_iv: "c39ce79a008c8678c9f4589e9978eae0"
server_key_version: "encryptionkey@0"
I20260808 15:47:13.914906 17805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:13.930382 17805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:13.933645 17805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:13.933868 17805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:13.934502 17805 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:47:13.935434 17805 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:47:13.935508 17805 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:13.935580 17805 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:47:13.935632 17805 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:13.944841 17805 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:41531
I20260808 15:47:13.944867 17941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:41531 every 8 connection(s)
I20260808 15:47:13.945892 17805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:47:13.948040 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 17805
Aug 08 15:47:13 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:13 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 15:47:13.958367 17667 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:13.947870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:33907 (local address 127.8.39.126:43797)
0808 15:47:13.948049 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:13.948055 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:13.949432 (+ 1377us) server_negotiation.cc:407] Connection header received
0808 15:47:13.950436 (+ 1004us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:13.950440 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:13.950497 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:13.950611 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:13.951923 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.952539 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.953811 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.954113 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.954237 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:13.958214 (+ 3977us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.67:33907: BlockingRecv error: recv got EOF from 127.8.39.67:33907 (error 108)
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":70}
I20260808 15:47:13.958580 17670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:13.949195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36864 (local address 127.8.39.126:43797)
0808 15:47:13.949355 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:13.949376 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:13.949397 (+ 21us) server_negotiation.cc:407] Connection header received
0808 15:47:13.949436 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:13.949438 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:13.949478 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:13.949583 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:13.950373 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.950997 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.951885 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.952163 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.952287 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:13.953757 (+ 1470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:13.953762 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:13.953776 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:13.953805 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:13.956088 (+ 2283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:13.956607 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:13.956613 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:13.956617 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:13.956745 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:13.957073 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:13.957079 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:13.957081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:13.957620 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:13.957828 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:13.958082 (+ 254us) server_negotiation.cc:299] Negotiation successful
0808 15:47:13.958320 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":65}
I20260808 15:47:13.959123 17944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:13.948253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.67:33907)
0808 15:47:13.949244 (+ 991us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:13.949305 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:13.950214 (+ 909us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:13.950842 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:13.950850 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:13.951255 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:13.951758 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:13.951772 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.952686 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.952690 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:13.953666 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:13.953676 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.954312 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.954316 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:13.954577 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:13.955184 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:13.955219 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:13.958067 (+ 2848us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":733,"thread_start_us":159,"threads_started":1}
W20260808 15:47:13.959584 17942 heartbeater.cc:644] Failed to heartbeat to 127.8.39.126:43797 (0 consecutive failures): Not authorized: Failed to ping master at 127.8.39.126:43797: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Aug 08 15:47:13 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:13 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:13.965049 17944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:13.960072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.67:56103)
0808 15:47:13.960163 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:13.960177 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:13.960253 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:13.960501 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:13.960505 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:13.960656 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:13.960784 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:13.960791 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.961698 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.961701 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:13.962259 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:13.962268 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.962727 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.962731 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:13.962814 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:13.963230 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:13.963241 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:13.964948 (+ 1707us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 15:47:13.965260 17670 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:13.960137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:56103 (local address 127.8.39.126:43797)
0808 15:47:13.960245 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:13.960249 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:13.960263 (+ 14us) server_negotiation.cc:407] Connection header received
0808 15:47:13.960346 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:13.960348 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:13.960382 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:13.960473 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:13.960911 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.961598 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.962366 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.962587 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.962666 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:13.965140 (+ 2474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.67:56103: BlockingRecv error: recv got EOF from 127.8.39.67:56103 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 08 15:47:13 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:13 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:13.970135 17944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:13.965672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.67:48083)
0808 15:47:13.965800 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:13.965816 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:13.965895 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:13.966089 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:13.966091 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:13.966211 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:13.966278 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:13.966282 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.967023 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.967030 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:13.967604 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:13.967613 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.967991 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.967993 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:13.968059 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:13.968443 (+ 384us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:13.968453 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:13.970044 (+ 1591us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 15:47:13.970304 17670 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:13.965734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:48083 (local address 127.8.39.126:43797)
0808 15:47:13.965886 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:13.965889 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:13.965901 (+ 12us) server_negotiation.cc:407] Connection header received
0808 15:47:13.965956 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:13.965958 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:13.965996 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:13.966056 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:13.966368 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.966895 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.967705 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:13.967899 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:13.967974 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:13.970154 (+ 2180us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.67:48083: BlockingRecv error: recv got EOF from 127.8.39.67:48083 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
W20260808 15:47:13.970405 17942 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 15:47:14 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:14 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:14.590379 17946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:14.584127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.65:59251)
0808 15:47:14.584411 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:14.584434 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:14.584531 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:14.584882 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:14.584886 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:14.585158 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:14.585321 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:14.585329 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:14.586430 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:14.586433 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:14.587056 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:14.587064 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:14.587530 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:14.587533 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:14.587624 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:14.588121 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:14.588133 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:14.590190 (+ 2057us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":74,"threads_started":1}
W20260808 15:47:14.590467 17947 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:14.584254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:59251 (local address 127.8.39.126:43797)
0808 15:47:14.584516 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:14.584520 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:14.584535 (+ 15us) server_negotiation.cc:407] Connection header received
0808 15:47:14.584652 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:14.584655 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:14.584735 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:14.584829 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:14.585448 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:14.586322 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:14.587176 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:14.587414 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:14.587495 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:14.590320 (+ 2825us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.65:59251: BlockingRecv error: recv got EOF from 127.8.39.65:59251 (error 108)
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":82,"threads_started":1}
Aug 08 15:47:14 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:14 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:14.787046 17948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:14.780697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.66:48377)
0808 15:47:14.781091 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:14.781112 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:14.781252 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:14.781535 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:14.781538 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:14.781756 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:14.781913 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:14.781920 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:14.782755 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:14.782758 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:14.783410 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:14.783420 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:14.783889 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:14.783892 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:14.783976 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:14.784627 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:14.784647 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:14.786902 (+ 2255us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":93,"threads_started":1}
W20260808 15:47:14.787168 17947 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:14.780853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:48377 (local address 127.8.39.126:43797)
0808 15:47:14.781049 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:14.781054 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:14.781191 (+ 137us) server_negotiation.cc:407] Connection header received
0808 15:47:14.781361 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:14.781364 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:14.781417 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:14.781511 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:14.782040 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:14.782599 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:14.783527 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:14.783767 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:14.783880 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:14.787020 (+ 3140us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.66:48377: BlockingRecv error: recv got EOF from 127.8.39.66:48377 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 08 15:47:14 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:14 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:14.977113 17949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:14.971278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.67:39573)
0808 15:47:14.971595 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:14.971610 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:14.971726 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:14.971998 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:14.972001 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:14.972201 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:14.972334 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:14.972340 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:14.973153 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:14.973156 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:14.973764 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:14.973773 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:14.974289 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:14.974292 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:14.974371 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:14.974911 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:14.974923 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:14.976981 (+ 2058us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":90,"threads_started":1}
W20260808 15:47:14.977290 17947 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:14.971358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:39573 (local address 127.8.39.126:43797)
0808 15:47:14.971538 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:14.971541 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:14.971686 (+ 145us) server_negotiation.cc:407] Connection header received
0808 15:47:14.971810 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:14.971812 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:14.971861 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:14.971929 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:14.972473 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:14.973029 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:14.973904 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:14.974169 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:14.974293 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:14.977127 (+ 2834us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.67:39573: BlockingRecv error: recv got EOF from 127.8.39.67:39573 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 08 15:47:15 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:15 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:15.596722 17950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:15.591173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.65:33525)
0808 15:47:15.591449 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:15.591464 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:15.591555 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:15.591807 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:15.591809 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:15.591987 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:15.592108 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:15.592114 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:15.592850 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:15.592852 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:15.593418 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:15.593426 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:15.593844 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:15.593846 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:15.593906 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:15.594405 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:15.594417 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:15.596554 (+ 2137us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":97,"threads_started":1}
W20260808 15:47:15.596788 17951 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:15.591251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:33525 (local address 127.8.39.126:43797)
0808 15:47:15.591507 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:15.591511 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:15.591524 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:47:15.591642 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:15.591644 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:15.591689 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:15.591768 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:15.592209 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:15.592756 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:15.593528 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:15.593745 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:15.593821 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:15.596685 (+ 2864us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.65:33525: BlockingRecv error: recv got EOF from 127.8.39.65:33525 (error 108)
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":89,"threads_started":1}
Aug 08 15:47:15 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:15 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:15.799472 17952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:15.787841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.66:53923)
0808 15:47:15.788220 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:15.788239 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:15.788395 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:15.788691 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:15.788694 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:15.788927 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:15.789061 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:15.789068 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:15.789940 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:15.789947 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:15.790564 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:15.790572 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:15.791116 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:15.791120 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:15.791213 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:15.796843 (+ 5630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:15.796857 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:15.799316 (+ 2459us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":101,"threads_started":1}
W20260808 15:47:15.799598 17951 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:15.788024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:53923 (local address 127.8.39.126:43797)
0808 15:47:15.788196 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:15.788202 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:15.788328 (+ 126us) server_negotiation.cc:407] Connection header received
0808 15:47:15.788509 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:15.788513 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:15.788565 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:15.788667 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:15.789197 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:15.789818 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:15.790726 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:15.790991 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:15.791111 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:15.799468 (+ 8357us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.66:53923: BlockingRecv error: recv got EOF from 127.8.39.66:53923 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 08 15:47:15 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:15 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:15.983718 17953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:15.977900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.67:37817)
0808 15:47:15.978257 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:15.978272 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:15.978411 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:15.978769 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:15.978772 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:15.978996 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:15.979092 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:15.979099 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:15.979858 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:15.979863 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:15.980431 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:15.980439 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:15.980909 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:15.980912 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:15.980996 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:15.981544 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:15.981555 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:15.983530 (+ 1975us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":147,"threads_started":1}
W20260808 15:47:15.983736 17951 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:15.978075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:37817 (local address 127.8.39.126:43797)
0808 15:47:15.978215 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:15.978220 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:15.978351 (+ 131us) server_negotiation.cc:407] Connection header received
0808 15:47:15.978556 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:15.978560 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:15.978619 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:15.978742 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:15.979214 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:15.979744 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:15.980561 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:15.980788 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:15.980904 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:15.983637 (+ 2733us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.67:37817: BlockingRecv error: recv got EOF from 127.8.39.67:37817 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 08 15:47:16 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:16 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:16.602968 17954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:16.597481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.65:59799)
0808 15:47:16.597832 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:16.597846 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:16.597940 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:16.598214 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:16.598216 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:16.598396 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:16.598495 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:16.598501 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:16.599239 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:16.599242 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:16.599813 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:16.599821 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:16.600297 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:16.600299 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:16.600360 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:16.600867 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:16.600878 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:16.602852 (+ 1974us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":120,"threads_started":1}
W20260808 15:47:16.603163 17955 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:16.597620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:59799 (local address 127.8.39.126:43797)
0808 15:47:16.597889 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:16.597892 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:16.597907 (+ 15us) server_negotiation.cc:407] Connection header received
0808 15:47:16.598047 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:16.598050 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:16.598094 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:16.598169 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:16.598595 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:16.599142 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:16.599952 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:16.600194 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:16.600284 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:16.603011 (+ 2727us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.65:59799: BlockingRecv error: recv got EOF from 127.8.39.65:59799 (error 108)
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":95,"threads_started":1}
Aug 08 15:47:16 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:16 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:16.806445 17956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:16.800347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.66:49659)
0808 15:47:16.800646 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:16.800662 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:16.800761 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:16.801046 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:16.801048 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:16.801234 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:16.801336 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:16.801342 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:16.802234 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:16.802237 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:16.802967 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:16.802980 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:16.803492 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:16.803496 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:16.803567 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:16.804210 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:16.804223 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:16.806296 (+ 2073us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":97,"threads_started":1}
W20260808 15:47:16.806615 17955 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:16.800488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:49659 (local address 127.8.39.126:43797)
0808 15:47:16.800676 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:16.800680 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:16.800713 (+ 33us) server_negotiation.cc:407] Connection header received
0808 15:47:16.800851 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:16.800853 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:16.800901 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:16.800985 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:16.801491 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:16.802093 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:16.803109 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:16.803352 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:16.803448 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:16.806483 (+ 3035us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.66:49659: BlockingRecv error: recv got EOF from 127.8.39.66:49659 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 08 15:47:16 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:16 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:16.990937 17957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:16.984584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.67:41265)
0808 15:47:16.984860 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:16.984874 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:16.985079 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:16.985362 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:16.985365 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:16.985659 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:16.985771 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:16.985777 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:16.986550 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:16.986556 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:16.987255 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:16.987264 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:16.987743 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:16.987746 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:16.987832 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:16.988416 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:16.988427 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:16.990753 (+ 2326us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":96,"threads_started":1}
W20260808 15:47:16.991058 17955 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:16.984628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:41265 (local address 127.8.39.126:43797)
0808 15:47:16.984764 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:16.984769 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:16.984971 (+ 202us) server_negotiation.cc:407] Connection header received
0808 15:47:16.985197 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:16.985200 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:16.985256 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:16.985340 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:16.985893 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:16.986429 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:16.987377 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:16.987617 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:16.987726 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:16.990893 (+ 3167us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.67:41265: BlockingRecv error: recv got EOF from 127.8.39.67:41265 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 08 15:47:17 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:17 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:17.612004 17958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:17.604010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.65:47761)
0808 15:47:17.604507 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:17.604528 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:17.604683 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:17.605583 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:17.605588 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:17.605907 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:17.606065 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:17.606077 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:17.607023 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:17.607028 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:17.608161 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:17.608176 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:17.608673 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:17.608679 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:17.608807 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:17.609413 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:17.609434 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:17.611832 (+ 2398us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":108,"threads_started":1}
W20260808 15:47:17.612150 17959 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:17.604176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:47761 (local address 127.8.39.126:43797)
0808 15:47:17.604498 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:17.604503 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:17.604630 (+ 127us) server_negotiation.cc:407] Connection header received
0808 15:47:17.604848 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:17.604855 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:17.604927 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:17.605317 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:17.606210 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:17.606861 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:17.608312 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:17.608543 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:17.608630 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:17.612003 (+ 3373us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.65:47761: BlockingRecv error: recv got EOF from 127.8.39.65:47761 (error 108)
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":95,"threads_started":1}
Aug 08 15:47:17 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:17 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:17.813675 17960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:17.807525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.66:33649)
0808 15:47:17.807852 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:17.807885 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:17.808016 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:17.808311 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:17.808316 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:17.808598 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:17.808751 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:17.808758 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:17.809579 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:17.809582 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:17.810180 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:17.810188 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:17.810636 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:17.810638 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:17.810737 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:17.811294 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:17.811306 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:17.813548 (+ 2242us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":86,"threads_started":1}
W20260808 15:47:17.813838 17959 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:17.807643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:33649 (local address 127.8.39.126:43797)
0808 15:47:17.807787 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:17.807792 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:17.808031 (+ 239us) server_negotiation.cc:407] Connection header received
0808 15:47:17.808111 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:17.808114 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:17.808174 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:17.808284 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:17.808881 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:17.809478 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:17.810286 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:17.810526 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:17.810613 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:17.813712 (+ 3099us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.66:33649: BlockingRecv error: recv got EOF from 127.8.39.66:33649 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 08 15:47:17 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:17 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:17.997905 17961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:17.991745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.67:55039)
0808 15:47:17.992101 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:17.992119 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:17.992289 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:17.992590 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:17.992594 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:17.992821 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:17.992923 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:17.992930 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:17.993775 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:17.993781 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:17.994391 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:17.994400 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:17.995005 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:17.995009 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:17.995111 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:17.995661 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:17.995675 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:17.997720 (+ 2045us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":127,"threads_started":1}
W20260808 15:47:17.998019 17959 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:17.991881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:55039 (local address 127.8.39.126:43797)
0808 15:47:17.992111 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:17.992118 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:17.992219 (+ 101us) server_negotiation.cc:407] Connection header received
0808 15:47:17.992401 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:17.992404 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:17.992464 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:17.992568 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:17.993063 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:17.993656 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:17.994531 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:17.994874 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:17.995007 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:17.997876 (+ 2869us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.67:55039: BlockingRecv error: recv got EOF from 127.8.39.67:55039 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 08 15:47:18 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:18 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:18.619093 17962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:18.613122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.65:54175)
0808 15:47:18.613443 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:18.613458 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:18.613560 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:18.613785 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:18.613787 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:18.613976 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:18.614074 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:18.614079 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:18.614908 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:18.614912 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:18.615681 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:18.615693 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:18.616142 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:18.616145 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:18.616220 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:18.616881 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:18.616894 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:18.618949 (+ 2055us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":97,"threads_started":1}
W20260808 15:47:18.619493 17963 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:18.613166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:54175 (local address 127.8.39.126:43797)
0808 15:47:18.613422 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:18.613425 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:18.613539 (+ 114us) server_negotiation.cc:407] Connection header received
0808 15:47:18.613626 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:18.613628 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:18.613672 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:18.613747 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:18.614202 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:18.614785 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:18.615807 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:18.616039 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:18.616117 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:18.619380 (+ 3263us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.65:54175: BlockingRecv error: recv got EOF from 127.8.39.65:54175 (error 108)
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":102,"threads_started":1}
Aug 08 15:47:18 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:18 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:18.820803 17964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:18.814483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.66:40355)
0808 15:47:18.814871 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:18.814888 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:18.815026 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:18.815307 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:18.815310 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:18.815552 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:18.815642 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:18.815648 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:18.816504 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:18.816508 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:18.817100 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:18.817108 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:18.817609 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:18.817612 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:18.817706 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:18.818321 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:18.818333 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:18.820610 (+ 2277us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":189,"threads_started":1}
W20260808 15:47:18.820874 17963 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:18.814701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:40355 (local address 127.8.39.126:43797)
0808 15:47:18.814864 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:18.814869 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:18.814969 (+ 100us) server_negotiation.cc:407] Connection header received
0808 15:47:18.815146 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:18.815149 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:18.815203 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:18.815287 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:18.815767 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:18.816387 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:18.817237 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:18.817461 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:18.817570 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:18.820757 (+ 3187us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.66:40355: BlockingRecv error: recv got EOF from 127.8.39.66:40355 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 08 15:47:19 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:19 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:19.004573 17965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:18.998763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.67:56435)
0808 15:47:18.999048 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:18.999062 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:18.999163 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:18.999399 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:18.999401 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:18.999586 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:18.999679 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:18.999684 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:19.000428 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:19.000431 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:19.001071 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:19.001080 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:19.001583 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:19.001586 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:19.001662 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:19.002197 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:19.002209 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:19.004380 (+ 2171us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":74,"threads_started":1}
W20260808 15:47:19.004670 17963 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:18.998900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:56435 (local address 127.8.39.126:43797)
0808 15:47:18.999070 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:18.999074 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:18.999145 (+ 71us) server_negotiation.cc:407] Connection header received
0808 15:47:18.999243 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:18.999245 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:18.999291 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:18.999359 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:18.999773 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:19.000315 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:19.001215 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:19.001444 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:19.001563 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:19.004539 (+ 2976us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.67:56435: BlockingRecv error: recv got EOF from 127.8.39.67:56435 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 08 15:47:19 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:19 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:19.626080 17966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:19.619970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.65:58665)
0808 15:47:19.620287 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:19.620303 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:19.620449 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:19.620720 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:19.620723 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:19.620948 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:19.621054 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:19.621060 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:19.621803 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:19.621806 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:19.622454 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:19.622465 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:19.622962 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:19.622965 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:19.623045 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:19.623592 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:19.623605 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:19.625897 (+ 2292us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":114,"threads_started":1}
W20260808 15:47:19.626212 17967 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:19.619992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:58665 (local address 127.8.39.126:43797)
0808 15:47:19.620251 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:19.620254 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:19.620379 (+ 125us) server_negotiation.cc:407] Connection header received
0808 15:47:19.620539 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:19.620541 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:19.620588 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:19.620668 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:19.621166 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:19.621697 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:19.622576 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:19.622819 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:19.622898 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:19.626025 (+ 3127us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.65:58665: BlockingRecv error: recv got EOF from 127.8.39.65:58665 (error 108)
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":82,"threads_started":1}
Aug 08 15:47:19 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:19 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:19.827564 17968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:19.821840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.66:60327)
0808 15:47:19.822199 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:19.822214 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:19.822330 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:19.822586 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:19.822588 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:19.822802 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:19.822914 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:19.822930 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:19.823703 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:19.823706 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:19.824267 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:19.824275 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:19.824725 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:19.824728 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:19.824792 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:19.825366 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:19.825389 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:19.827366 (+ 1977us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":110,"threads_started":1}
W20260808 15:47:19.827881 17967 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:19.822025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:60327 (local address 127.8.39.126:43797)
0808 15:47:19.822204 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:19.822207 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:19.822290 (+ 83us) server_negotiation.cc:407] Connection header received
0808 15:47:19.822418 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:19.822421 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:19.822465 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:19.822534 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:19.823034 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:19.823560 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:19.824403 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:19.824621 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:19.824705 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:19.827550 (+ 2845us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.66:60327: BlockingRecv error: recv got EOF from 127.8.39.66:60327 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 08 15:47:20 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:20 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:20.012136 17969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:20.005591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.67:48703)
0808 15:47:20.005986 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:20.006007 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:20.006180 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:20.006523 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:20.006527 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:20.006847 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:20.006983 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:20.006991 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:20.007867 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:20.007870 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:20.008522 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:20.008533 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:20.009019 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:20.009022 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:20.009085 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:20.009662 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:20.009684 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:20.011883 (+ 2199us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":92,"threads_started":1}
W20260808 15:47:20.012383 17967 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:20.005724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:48703 (local address 127.8.39.126:43797)
0808 15:47:20.005989 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:20.005995 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:20.006119 (+ 124us) server_negotiation.cc:407] Connection header received
0808 15:47:20.006313 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:20.006316 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:20.006391 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:20.006496 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:20.007124 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:20.007759 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:20.008658 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:20.008892 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:20.008986 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:20.012134 (+ 3148us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.67:48703: BlockingRecv error: recv got EOF from 127.8.39.67:48703 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
Aug 08 15:47:20 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:20 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:20.635058 17971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:20.627028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.65:55369)
0808 15:47:20.627431 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:20.627450 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:20.627573 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:20.627930 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:20.627934 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:20.628267 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:20.628442 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:20.628453 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:20.629769 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:20.629773 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:20.630569 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:20.630579 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:20.631304 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:20.631308 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:20.631410 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:20.632142 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:20.632160 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:20.634857 (+ 2697us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":91,"threads_started":1}
W20260808 15:47:20.635193 17970 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:20.627092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:55369 (local address 127.8.39.126:43797)
0808 15:47:20.627496 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:20.627503 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:20.627522 (+ 19us) server_negotiation.cc:407] Connection header received
0808 15:47:20.627713 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:20.627718 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:20.627780 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:20.627883 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:20.628598 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:20.629491 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:20.630748 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:20.631181 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:20.631310 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:20.635027 (+ 3717us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.65:55369: BlockingRecv error: recv got EOF from 127.8.39.65:55369 (error 108)
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":68,"threads_started":1}
Aug 08 15:47:20 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:20 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:20.839025 17972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:20.828395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.66:33031)
0808 15:47:20.828745 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:20.828759 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:20.828860 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:20.829098 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:20.829100 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:20.829286 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:20.829378 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:20.829383 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:20.830238 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:20.830242 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:20.830847 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:20.830856 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:20.831308 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:20.831311 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:20.831378 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:20.836562 (+ 5184us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:20.836575 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:20.838848 (+ 2273us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":129,"threads_started":1}
W20260808 15:47:20.839223 17970 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:20.828466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:33031 (local address 127.8.39.126:43797)
0808 15:47:20.828673 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:20.828679 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:20.828877 (+ 198us) server_negotiation.cc:407] Connection header received
0808 15:47:20.828936 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:20.828939 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:20.828986 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:20.829064 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:20.829509 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:20.830125 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:20.830964 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:20.831200 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:20.831280 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:20.839093 (+ 7813us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.66:33031: BlockingRecv error: recv got EOF from 127.8.39.66:33031 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
Aug 08 15:47:21 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:21 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:21.019904 17973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:21.013139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.67:46155)
0808 15:47:21.013503 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:21.013518 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:21.013635 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:21.013881 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:21.013883 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:21.014089 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:21.014193 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:21.014199 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:21.014976 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:21.014980 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:21.015732 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:21.015744 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:21.016433 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:21.016437 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:21.016601 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:21.017378 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:21.017392 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:21.019763 (+ 2371us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":90,"threads_started":1}
W20260808 15:47:21.020080 17970 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:21.013238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:46155 (local address 127.8.39.126:43797)
0808 15:47:21.013391 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:21.013395 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:21.013607 (+ 212us) server_negotiation.cc:407] Connection header received
0808 15:47:21.013709 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:21.013712 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:21.013760 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:21.013830 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:21.014297 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:21.014876 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:21.015941 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:21.016296 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:21.016437 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:21.019922 (+ 3485us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.67:46155: BlockingRecv error: recv got EOF from 127.8.39.67:46155 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 08 15:47:21 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:21 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:21.642606 17974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:21.635953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.65:37141)
0808 15:47:21.636254 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:21.636269 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:21.636379 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:21.636760 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:21.636766 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:21.636984 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:21.637083 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:21.637113 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:21.638339 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:21.638341 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:21.639160 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:21.639171 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:21.639722 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:21.639725 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:21.639803 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:21.640518 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:21.640531 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:21.642481 (+ 1950us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":113,"threads_started":1}
W20260808 15:47:21.642911 17976 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:21.636180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:37141 (local address 127.8.39.126:43797)
0808 15:47:21.636464 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:21.636468 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:21.636484 (+ 16us) server_negotiation.cc:407] Connection header received
0808 15:47:21.636532 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:21.636535 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:21.636599 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:21.636680 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:21.637296 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:21.638222 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:21.639299 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:21.639566 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:21.639658 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:21.642731 (+ 3073us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.65:37141: BlockingRecv error: recv got EOF from 127.8.39.65:37141 (error 108)
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":91,"threads_started":1}
Aug 08 15:47:21 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:21 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:21.846160 17978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:21.840106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.66:39331)
0808 15:47:21.840465 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:21.840483 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:21.840639 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:21.840924 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:21.840927 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:21.841144 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:21.841250 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:21.841256 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:21.842282 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:21.842287 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:21.843014 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:21.843023 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:21.843512 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:21.843516 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:21.843609 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:21.844097 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:21.844108 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:21.846031 (+ 1923us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":90,"threads_started":1}
W20260808 15:47:21.846372 17976 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:21.840237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:39331 (local address 127.8.39.126:43797)
0808 15:47:21.840448 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:21.840452 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:21.840574 (+ 122us) server_negotiation.cc:407] Connection header received
0808 15:47:21.840746 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:21.840749 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:21.840804 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:21.840904 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:21.841384 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:21.842163 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:21.843133 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:21.843365 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:21.843491 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:21.846194 (+ 2703us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.66:39331: BlockingRecv error: recv got EOF from 127.8.39.66:39331 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
Aug 08 15:47:22 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:22 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:22.027091 17979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:22.020740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.67:48675)
0808 15:47:22.021059 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:22.021073 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:22.021207 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:22.021544 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:22.021547 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:22.021781 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:22.021881 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:22.021887 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:22.022818 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:22.022824 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:22.023460 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:22.023470 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:22.023988 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:22.023992 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:22.024089 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:22.024713 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:22.024727 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:22.026960 (+ 2233us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":108,"threads_started":1}
W20260808 15:47:22.027266 17976 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:22.020800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:48675 (local address 127.8.39.126:43797)
0808 15:47:22.020962 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:22.020968 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:22.021156 (+ 188us) server_negotiation.cc:407] Connection header received
0808 15:47:22.021325 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:22.021330 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:22.021392 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:22.021519 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:22.022071 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:22.022664 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:22.023595 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:22.023853 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:22.023982 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:22.027094 (+ 3112us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.67:48675: BlockingRecv error: recv got EOF from 127.8.39.67:48675 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 08 15:47:22 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:22 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:22.649089 17980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:22.643468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.65:44009)
0808 15:47:22.643770 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:22.643784 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:22.643880 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:22.644214 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:22.644216 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:22.644403 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:22.644506 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:22.644511 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:22.645289 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:22.645292 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:22.645843 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:22.645850 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:22.646296 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:22.646299 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:22.646361 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:22.646874 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:22.646886 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:22.648921 (+ 2035us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":109,"threads_started":1}
W20260808 15:47:22.649245 17981 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:22.643595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:44009 (local address 127.8.39.126:43797)
0808 15:47:22.643869 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:22.643872 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:22.643886 (+ 14us) server_negotiation.cc:407] Connection header received
0808 15:47:22.644039 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:22.644041 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:22.644087 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:22.644169 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:22.644625 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:22.645188 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:22.645942 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:22.646193 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:22.646270 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:22.649107 (+ 2837us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.65:44009: BlockingRecv error: recv got EOF from 127.8.39.65:44009 (error 108)
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":121,"threads_started":1}
Aug 08 15:47:22 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:22 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:22.852766 17982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:22.846971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.66:60783)
0808 15:47:22.847323 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:22.847340 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:22.847457 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:22.847735 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:22.847738 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:22.848019 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:22.848133 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:22.848139 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:22.848938 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:22.848941 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:22.849578 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:22.849588 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:22.850017 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:22.850020 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:22.850092 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:22.850612 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:22.850625 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:22.852643 (+ 2018us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":153,"threads_started":1}
W20260808 15:47:22.852897 17981 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:22.847073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:60783 (local address 127.8.39.126:43797)
0808 15:47:22.847221 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:22.847225 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:22.847416 (+ 191us) server_negotiation.cc:407] Connection header received
0808 15:47:22.847553 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:22.847555 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:22.847601 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:22.847663 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:22.848225 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:22.848761 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:22.849692 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:22.849906 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:22.849984 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:22.852777 (+ 2793us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.66:60783: BlockingRecv error: recv got EOF from 127.8.39.66:60783 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 08 15:47:23 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:23 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:23.033648 17983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:23.027877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.67:40481)
0808 15:47:23.028221 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:23.028234 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:23.028334 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:23.028585 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:23.028587 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:23.028770 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:23.028869 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:23.028874 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:23.029617 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:23.029619 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:23.030164 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:23.030172 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:23.030637 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:23.030640 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:23.030779 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:23.031285 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:23.031297 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:23.033531 (+ 2234us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":172,"threads_started":1}
W20260808 15:47:23.033872 17981 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:23.028014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:40481 (local address 127.8.39.126:43797)
0808 15:47:23.028158 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:23.028162 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:23.028308 (+ 146us) server_negotiation.cc:407] Connection header received
0808 15:47:23.028429 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:23.028431 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:23.028481 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:23.028544 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:23.028979 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:23.029521 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:23.030294 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:23.030526 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:23.030610 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:23.033702 (+ 3092us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.67:40481: BlockingRecv error: recv got EOF from 127.8.39.67:40481 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 08 15:47:23 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:23 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:23.656365 17984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:23.650203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.65:34513)
0808 15:47:23.650633 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:23.650647 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:23.650751 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:23.651062 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:23.651066 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:23.651301 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:23.651404 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:23.651410 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:23.652281 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:23.652286 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:23.652928 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:23.652937 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:23.653483 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:23.653487 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:23.653594 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:23.654124 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:23.654137 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:23.656168 (+ 2031us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":109,"threads_started":1}
W20260808 15:47:23.656492 17985 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:23.650292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:34513 (local address 127.8.39.126:43797)
0808 15:47:23.650610 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:23.650616 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:23.650718 (+ 102us) server_negotiation.cc:407] Connection header received
0808 15:47:23.650834 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:23.650840 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:23.650901 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:23.651025 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:23.651546 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:23.652156 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:23.653067 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:23.653352 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:23.653474 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:23.656304 (+ 2830us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.65:34513: BlockingRecv error: recv got EOF from 127.8.39.65:34513 (error 108)
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":69,"threads_started":1}
Aug 08 15:47:23 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:23 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:23.859897 17986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:23.853761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.66:60303)
0808 15:47:23.854161 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:23.854177 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:23.854322 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:23.854622 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:23.854625 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:23.854897 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:23.854997 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:23.855003 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:23.855794 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:23.855799 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:23.856410 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:23.856419 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:23.856909 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:23.856914 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:23.857002 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:23.857539 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:23.857550 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:23.859636 (+ 2086us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":95,"threads_started":1}
W20260808 15:47:23.859937 17985 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:23.853901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:60303 (local address 127.8.39.126:43797)
0808 15:47:23.854130 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:23.854135 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:23.854270 (+ 135us) server_negotiation.cc:407] Connection header received
0808 15:47:23.854440 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:23.854445 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:23.854502 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:23.854591 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:23.855129 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:23.855682 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:23.856536 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:23.856775 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:23.856881 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:23.859814 (+ 2933us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.66:60303: BlockingRecv error: recv got EOF from 127.8.39.66:60303 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 08 15:47:24 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:24 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:24.040583 17987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:24.034529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.67:57543)
0808 15:47:24.034859 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:24.034877 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:24.034974 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:24.035289 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:24.035292 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:24.035510 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:24.035616 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:24.035622 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:24.036425 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:24.036428 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:24.037071 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:24.037081 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:24.037606 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:24.037609 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:24.037680 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:24.038205 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:24.038217 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:24.040445 (+ 2228us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":133,"threads_started":1}
W20260808 15:47:24.040794 17985 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:24.034770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:57543 (local address 127.8.39.126:43797)
0808 15:47:24.034933 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:24.034937 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:24.034952 (+ 15us) server_negotiation.cc:407] Connection header received
0808 15:47:24.035077 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:24.035079 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:24.035128 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:24.035205 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:24.035736 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:24.036306 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:24.037198 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:24.037438 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:24.037552 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:24.040629 (+ 3077us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.67:57543: BlockingRecv error: recv got EOF from 127.8.39.67:57543 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 08 15:47:24 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:24 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:24.663261 17988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:24.657220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.65:40529)
0808 15:47:24.657557 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:24.657576 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:24.657683 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:24.657958 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:24.657961 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:24.658170 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:24.658279 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:24.658285 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:24.659174 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:24.659176 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:24.659804 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:24.659812 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:24.660315 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:24.660318 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:24.660386 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:24.660944 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:24.660957 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:24.663121 (+ 2164us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":103,"threads_started":1}
W20260808 15:47:24.663444 17989 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:24.657405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:40529 (local address 127.8.39.126:43797)
0808 15:47:24.657686 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:24.657690 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:24.657705 (+ 15us) server_negotiation.cc:407] Connection header received
0808 15:47:24.657747 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:24.657749 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:24.657791 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:24.657882 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:24.658426 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:24.659071 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:24.659957 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:24.660201 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:24.660287 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:24.663270 (+ 2983us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.65:40529: BlockingRecv error: recv got EOF from 127.8.39.65:40529 (error 108)
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":90,"threads_started":1}
Aug 08 15:47:24 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:24 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:24.867120 17990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:24.860800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.66:34005)
0808 15:47:24.861100 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:24.861114 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:24.861245 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:24.861521 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:24.861523 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:24.861720 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:24.861821 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:24.861826 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:24.862636 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:24.862639 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:24.863282 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:24.863291 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:24.863771 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:24.863773 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:24.863842 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:24.864398 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:24.864411 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:24.866925 (+ 2514us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":107,"threads_started":1}
W20260808 15:47:24.867182 17989 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:24.860967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:34005 (local address 127.8.39.126:43797)
0808 15:47:24.861114 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:24.861118 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:24.861186 (+ 68us) server_negotiation.cc:407] Connection header received
0808 15:47:24.861340 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:24.861344 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:24.861396 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:24.861475 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:24.861976 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:24.862512 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:24.863416 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:24.863652 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:24.863752 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:24.867064 (+ 3312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.66:34005: BlockingRecv error: recv got EOF from 127.8.39.66:34005 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 08 15:47:25 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:25 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:25.048303 17991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:25.041679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.67:49979)
0808 15:47:25.042110 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:25.042125 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:25.042242 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:25.042528 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:25.042531 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:25.042754 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:25.042906 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:25.042914 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:25.044179 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:25.044182 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:25.045007 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:25.045019 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:25.045545 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:25.045547 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:25.045614 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:25.046213 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:25.046225 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:25.048178 (+ 1953us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":111,"threads_started":1}
W20260808 15:47:25.048579 17989 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:25.041760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:49979 (local address 127.8.39.126:43797)
0808 15:47:25.041996 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:25.042000 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:25.042242 (+ 242us) server_negotiation.cc:407] Connection header received
0808 15:47:25.042322 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:25.042324 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:25.042382 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:25.042467 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:25.043056 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:25.044016 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:25.045159 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:25.045422 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:25.045522 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:25.048436 (+ 2914us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.67:49979: BlockingRecv error: recv got EOF from 127.8.39.67:49979 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 08 15:47:25 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:25 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:25.670328 17992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:25.664250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.65:57515)
0808 15:47:25.664579 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:25.664594 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:25.664697 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:25.664962 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:25.664965 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:25.665287 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:25.665398 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:25.665405 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:25.666326 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:25.666330 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:25.667011 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:25.667021 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:25.667502 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:25.667505 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:25.667592 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:25.668167 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:25.668180 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:25.670199 (+ 2019us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":80,"threads_started":1}
W20260808 15:47:25.670627 17993 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:25.664322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:57515 (local address 127.8.39.126:43797)
0808 15:47:25.664628 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:25.664631 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:25.664647 (+ 16us) server_negotiation.cc:407] Connection header received
0808 15:47:25.664786 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:25.664788 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:25.664832 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:25.664916 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:25.665512 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:25.666203 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:25.667139 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:25.667381 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:25.667495 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:25.670471 (+ 2976us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.65:57515: BlockingRecv error: recv got EOF from 127.8.39.65:57515 (error 108)
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":118,"threads_started":1}
Aug 08 15:47:25 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:25 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:25.877838 17994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:25.868009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.66:33199)
0808 15:47:25.868368 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:25.868383 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:25.868671 (+ 288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:25.868995 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:25.868999 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:25.869267 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:25.869368 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:25.869374 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:25.870229 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:25.870236 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:25.870905 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:25.870914 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:25.871437 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:25.871441 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:25.871533 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:25.875586 (+ 4053us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:25.875600 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:25.877648 (+ 2048us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":94,"threads_started":1}
W20260808 15:47:25.877908 17993 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:25.868115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:33199 (local address 127.8.39.126:43797)
0808 15:47:25.868301 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:25.868307 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:25.868601 (+ 294us) server_negotiation.cc:407] Connection header received
0808 15:47:25.868801 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:25.868805 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:25.868868 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:25.868967 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:25.869503 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:25.870111 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:25.871055 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:25.871309 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:25.871427 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:25.877789 (+ 6362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.66:33199: BlockingRecv error: recv got EOF from 127.8.39.66:33199 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 08 15:47:26 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:26 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:26.055052 17995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:26.049148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.67:43509)
0808 15:47:26.049435 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:26.049451 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:26.049572 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:26.049817 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:26.049819 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:26.050018 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:26.050121 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:26.050127 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:26.050973 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:26.050976 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:26.051589 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:26.051597 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:26.052159 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:26.052162 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:26.052239 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:26.052762 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:26.052776 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:26.054919 (+ 2143us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":112,"threads_started":1}
W20260808 15:47:26.055229 17993 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:26.049267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:43509 (local address 127.8.39.126:43797)
0808 15:47:26.049405 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:26.049409 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:26.049539 (+ 130us) server_negotiation.cc:407] Connection header received
0808 15:47:26.049655 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:26.049657 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:26.049704 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:26.049774 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:26.050239 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:26.050858 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:26.051725 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:26.052001 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:26.052095 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:26.055094 (+ 2999us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.67:43509: BlockingRecv error: recv got EOF from 127.8.39.67:43509 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 08 15:47:26 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:26 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 15:47:26.678083 17997 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:26.671494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:53087 (local address 127.8.39.126:43797)
0808 15:47:26.671767 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:26.671771 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:26.671786 (+ 15us) server_negotiation.cc:407] Connection header received
0808 15:47:26.671830 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:26.671832 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:26.671879 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:26.672029 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:26.672706 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:26.673496 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:26.674492 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:26.674835 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:26.674929 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:26.677917 (+ 2988us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.65:53087: BlockingRecv error: recv got EOF from 127.8.39.65:53087 (error 108)
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":99,"threads_started":1}
I20260808 15:47:26.678119 17996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:26.671295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.65:53087)
0808 15:47:26.671592 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:26.671607 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:26.671708 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:26.672115 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:26.672118 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:26.672361 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:26.672479 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:26.672486 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:26.673627 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:26.673630 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:26.674361 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:26.674373 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:26.674951 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:26.674953 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:26.675050 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:26.675581 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:26.675594 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:26.677749 (+ 2155us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":103,"threads_started":1}
Aug 08 15:47:26 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:26 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:26.885356 17998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:26.878835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.66:49327)
0808 15:47:26.879161 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:26.879176 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:26.879274 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:26.879574 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:26.879576 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:26.879780 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:26.879928 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:26.879934 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:26.880768 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:26.880771 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:26.881377 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:26.881386 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:26.881946 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:26.881950 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:26.882013 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:26.882616 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:26.882628 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:26.885144 (+ 2516us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":83,"threads_started":1}
W20260808 15:47:26.885437 17997 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:26.879040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:49327 (local address 127.8.39.126:43797)
0808 15:47:26.879210 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:26.879214 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:26.879231 (+ 17us) server_negotiation.cc:407] Connection header received
0808 15:47:26.879373 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:26.879375 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:26.879423 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:26.879501 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:26.880059 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:26.880649 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:26.881515 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:26.881757 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:26.881857 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:26.885289 (+ 3432us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.66:49327: BlockingRecv error: recv got EOF from 127.8.39.66:49327 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 08 15:47:27 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:27 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:27.061924 17999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:27.056153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.67:47953)
0808 15:47:27.056459 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:27.056481 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:27.056582 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:27.056845 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:27.056847 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:27.057053 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:27.057152 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:27.057157 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:27.057907 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:27.057910 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:27.058470 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:27.058478 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:27.059032 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:27.059035 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:27.059111 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:27.059653 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:27.059666 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:27.061775 (+ 2109us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":113,"threads_started":1}
W20260808 15:47:27.062137 17997 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:27.056211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:47953 (local address 127.8.39.126:43797)
0808 15:47:27.056395 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:27.056398 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:27.056553 (+ 155us) server_negotiation.cc:407] Connection header received
0808 15:47:27.056666 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:27.056668 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:27.056718 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:27.056793 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:27.057256 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:27.057790 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:27.058583 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:27.058907 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:27.058995 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:27.061944 (+ 2949us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.67:47953: BlockingRecv error: recv got EOF from 127.8.39.67:47953 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 08 15:47:27 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:27 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:27.685407 18000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:27.679018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.65:58191)
0808 15:47:27.679302 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:27.679317 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:27.679409 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:27.679788 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:27.679791 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:27.680023 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:27.680172 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:27.680178 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:27.681087 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:27.681090 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:27.681682 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:27.681691 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:27.682252 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:27.682256 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:27.682346 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:27.682944 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:27.682957 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:27.685213 (+ 2256us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":103,"threads_started":1}
W20260808 15:47:27.685520 18002 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:27.679180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:58191 (local address 127.8.39.126:43797)
0808 15:47:27.679505 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:27.679509 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:27.679523 (+ 14us) server_negotiation.cc:407] Connection header received
0808 15:47:27.679565 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:27.679567 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:27.679612 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:27.679712 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:27.680331 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:27.680950 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:27.681824 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:27.682110 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:27.682201 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:27.685368 (+ 3167us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.65:58191: BlockingRecv error: recv got EOF from 127.8.39.65:58191 (error 108)
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":102,"threads_started":1}
Aug 08 15:47:27 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:27 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:27.892062 18003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:27.886280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.66:33781)
0808 15:47:27.886580 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:27.886593 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:27.886744 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:27.887093 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:27.887095 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:27.887290 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:27.887396 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:27.887402 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:27.888238 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:27.888241 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:27.888804 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:27.888812 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:27.889345 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:27.889348 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:27.889430 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:27.889947 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:27.889959 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:27.891848 (+ 1889us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":85,"threads_started":1}
W20260808 15:47:27.892153 18002 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:27.886445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:33781 (local address 127.8.39.126:43797)
0808 15:47:27.886712 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:27.886716 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:27.886732 (+ 16us) server_negotiation.cc:407] Connection header received
0808 15:47:27.886894 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:27.886896 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:27.886957 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:27.887035 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:27.887526 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:27.888111 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:27.888924 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:27.889194 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:27.889281 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:27.892057 (+ 2776us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.66:33781: BlockingRecv error: recv got EOF from 127.8.39.66:33781 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
Aug 08 15:47:28 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:28 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.67@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:28.068122 18004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:28.062805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.67:58397)
0808 15:47:28.063109 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:28.063122 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:28.063218 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:28.063429 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:28.063431 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:28.063613 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:28.063709 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:28.063714 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:28.064443 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:28.064446 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:28.065034 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:28.065043 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:28.065454 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:28.065457 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:28.065517 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:28.066023 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:28.066034 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:28.067920 (+ 1886us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":107,"threads_started":1}
W20260808 15:47:28.068192 18002 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:28.062837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:58397 (local address 127.8.39.126:43797)
0808 15:47:28.063004 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:28.063008 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:28.063195 (+ 187us) server_negotiation.cc:407] Connection header received
0808 15:47:28.063298 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:28.063301 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:28.063348 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:28.063418 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:28.063803 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:28.064336 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:28.065143 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:28.065360 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:28.065436 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:28.068093 (+ 2657us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.67:58397: BlockingRecv error: recv got EOF from 127.8.39.67:58397 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 08 15:47:28 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:28 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.65@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:28.692612 18005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:28.686488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.65:59177)
0808 15:47:28.686939 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:28.686955 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:28.687067 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:28.687327 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:28.687329 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:28.687546 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:28.687653 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:28.687659 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:28.688410 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:28.688412 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:28.689080 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:28.689089 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:28.689519 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:28.689522 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:28.689591 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:28.690227 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:28.690240 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:28.692461 (+ 2221us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":102,"threads_started":1}
W20260808 15:47:28.692703 18006 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:28.686631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:59177 (local address 127.8.39.126:43797)
0808 15:47:28.686915 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:28.686919 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:28.687038 (+ 119us) server_negotiation.cc:407] Connection header received
0808 15:47:28.687155 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:28.687157 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:28.687202 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:28.687282 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:28.687765 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:28.688306 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:28.689192 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:28.689414 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:28.689489 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:28.692600 (+ 3111us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.65:59177: BlockingRecv error: recv got EOF from 127.8.39.65:59177 (error 108)
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":110,"threads_started":1}
Aug 08 15:47:28 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 15:47:28 dist-test-slave-8tdl krb5kdc[16902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.39.66@KRBTEST.COM for oryx/127.8.39.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 15:47:28.899748 18007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:28.893310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:43797 (local address 127.8.39.66:40177)
0808 15:47:28.893872 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:28.893888 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:28.894013 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:28.894370 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:28.894373 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:28.894575 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:28.894707 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:28.894713 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:28.895593 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:28.895595 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:28.896192 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:28.896200 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:28.896770 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:28.896773 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:28.896849 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:28.897400 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:28.897413 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:28.899496 (+ 2083us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.39.126:43797: Server oryx/127.8.39.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":137,"threads_started":1}
W20260808 15:47:28.899767 18006 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:28.893361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:40177 (local address 127.8.39.126:43797)
0808 15:47:28.893534 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:28.893540 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:28.893981 (+ 441us) server_negotiation.cc:407] Connection header received
0808 15:47:28.894117 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:28.894120 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:28.894194 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:28.894289 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:28.894818 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:28.895484 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:28.896337 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:28.896585 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:28.896692 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:28.899639 (+ 2947us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.39.66:40177: BlockingRecv error: recv got EOF from 127.8.39.66:40177 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 15:47:28.952811 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 17512
I20260808 15:47:28.960834 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 17669
I20260808 15:47:28.968645 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 17805
I20260808 15:47:28.975041 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 17440
2026-08-08T15:47:28Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18189 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T15:47:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:47:29Z Disabled control of system clock
I20260808 15:47:29.011507 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:41679
--webserver_interface=127.8.39.126
--webserver_port=0
--builtin_ntp_servers=127.8.39.84:34765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:41679
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 15:47:29.130062 18011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:29.130357 18011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:29.130393 18011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:29.134639 18011 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:47:29.134742 18011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:29.134759 18011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:29.134778 18011 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:47:29.134936 18011 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:47:29.139999 18011 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:34765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:41679
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:41679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18011
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:29.141187 18011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:29.142616 18011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:29.151870 18019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:29.151862 18017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:29.152208 18011 server_base.cc:1034] running on GCE node
W20260808 15:47:29.151870 18016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:29.152961 18011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:29.154237 18011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:29.155431 18011 hybrid_clock.cc:648] HybridClock initialized: now 1786204049155401 us; error 43 us; skew 500 ppm
I20260808 15:47:29.157539 18011 webserver.cc:460] Webserver started at http://127.8.39.126:46801/ using document root <none> and password file <none>
I20260808 15:47:29.158149 18011 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:29.158217 18011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:29.158470 18011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:47:29.160634 18011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "53d11eab77564a84ba2f46b7a22adcf5"
format_stamp: "Formatted at 2026-08-08 15:47:29 on dist-test-slave-8tdl"
server_key: "3d19ad20b937e7df8010349ab1070383"
server_key_iv: "2a560a74ea332cdf22756eadb0854913"
server_key_version: "encryptionkey@0"
I20260808 15:47:29.161231 18011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "53d11eab77564a84ba2f46b7a22adcf5"
format_stamp: "Formatted at 2026-08-08 15:47:29 on dist-test-slave-8tdl"
server_key: "3d19ad20b937e7df8010349ab1070383"
server_key_iv: "2a560a74ea332cdf22756eadb0854913"
server_key_version: "encryptionkey@0"
I20260808 15:47:29.165457 18011 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 15:47:29.168046 18026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:29.169299 18011 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:47:29.169472 18011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "53d11eab77564a84ba2f46b7a22adcf5"
format_stamp: "Formatted at 2026-08-08 15:47:29 on dist-test-slave-8tdl"
server_key: "3d19ad20b937e7df8010349ab1070383"
server_key_iv: "2a560a74ea332cdf22756eadb0854913"
server_key_version: "encryptionkey@0"
I20260808 15:47:29.169593 18011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:29.194281 18011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:29.195130 18011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:29.195338 18011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:29.202618 18011 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:41679
I20260808 15:47:29.202641 18078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:41679 every 8 connection(s)
I20260808 15:47:29.203619 18011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:47:29.207137 18079 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:29.208870 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 18011
I20260808 15:47:29.209000 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:47:29.209363 8349 external_mini_cluster.cc:1428] Setting key 1733870a931dcdf5aa3a1eb09b2d29a9
I20260808 15:47:29.213989 18079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53d11eab77564a84ba2f46b7a22adcf5: Bootstrap starting.
I20260808 15:47:29.216285 18079 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 53d11eab77564a84ba2f46b7a22adcf5: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:29.217036 18079 log.cc:824] T 00000000000000000000000000000000 P 53d11eab77564a84ba2f46b7a22adcf5: Log is configured to *not* fsync() on all Append() calls
I20260808 15:47:29.219030 18082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:29.210959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51042 (local address 127.8.39.126:41679)
0808 15:47:29.211610 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:29.211626 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:29.211661 (+ 35us) server_negotiation.cc:407] Connection header received
0808 15:47:29.212383 (+ 722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:29.212401 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:29.212781 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:29.213122 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:29.213552 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:29.214560 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:29.215499 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:29.215975 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:29.216170 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:29.217066 (+ 896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:29.217072 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:29.217084 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:47:29.217589 (+ 505us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:29.217660 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:47:29.217690 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:29.217796 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:29.217981 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 15:47:29.218252 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":148,"threads_started":1}
I20260808 15:47:29.219237 18079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53d11eab77564a84ba2f46b7a22adcf5: No bootstrap required, opened a new log
I20260808 15:47:29.223021 18079 raft_consensus.cc:348] T 00000000000000000000000000000000 P 53d11eab77564a84ba2f46b7a22adcf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53d11eab77564a84ba2f46b7a22adcf5" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41679 } }
I20260808 15:47:29.223263 18079 raft_consensus.cc:374] T 00000000000000000000000000000000 P 53d11eab77564a84ba2f46b7a22adcf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:29.223340 18079 raft_consensus.cc:729] T 00000000000000000000000000000000 P 53d11eab77564a84ba2f46b7a22adcf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53d11eab77564a84ba2f46b7a22adcf5, State: Initialized, Role: FOLLOWER
I20260808 15:47:29.223819 18079 consensus_queue.cc:260] T 00000000000000000000000000000000 P 53d11eab77564a84ba2f46b7a22adcf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53d11eab77564a84ba2f46b7a22adcf5" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41679 } }
I20260808 15:47:29.223979 18079 raft_consensus.cc:388] T 00000000000000000000000000000000 P 53d11eab77564a84ba2f46b7a22adcf5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:47:29.224067 18079 raft_consensus.cc:482] T 00000000000000000000000000000000 P 53d11eab77564a84ba2f46b7a22adcf5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:47:29.224167 18079 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 53d11eab77564a84ba2f46b7a22adcf5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:29.225086 18079 raft_consensus.cc:504] T 00000000000000000000000000000000 P 53d11eab77564a84ba2f46b7a22adcf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53d11eab77564a84ba2f46b7a22adcf5" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41679 } }
I20260808 15:47:29.225414 18079 leader_election.cc:302] T 00000000000000000000000000000000 P 53d11eab77564a84ba2f46b7a22adcf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 53d11eab77564a84ba2f46b7a22adcf5; no voters:
I20260808 15:47:29.225718 18079 leader_election.cc:288] T 00000000000000000000000000000000 P 53d11eab77564a84ba2f46b7a22adcf5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:47:29.225905 18084 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 53d11eab77564a84ba2f46b7a22adcf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:47:29.226161 18084 raft_consensus.cc:686] T 00000000000000000000000000000000 P 53d11eab77564a84ba2f46b7a22adcf5 [term 1 LEADER]: Becoming Leader. State: Replica: 53d11eab77564a84ba2f46b7a22adcf5, State: Running, Role: LEADER
I20260808 15:47:29.226596 18084 consensus_queue.cc:237] T 00000000000000000000000000000000 P 53d11eab77564a84ba2f46b7a22adcf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53d11eab77564a84ba2f46b7a22adcf5" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41679 } }
I20260808 15:47:29.227047 18079 sys_catalog.cc:564] T 00000000000000000000000000000000 P 53d11eab77564a84ba2f46b7a22adcf5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:47:29.228505 18086 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53d11eab77564a84ba2f46b7a22adcf5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 53d11eab77564a84ba2f46b7a22adcf5. Latest consensus state: current_term: 1 leader_uuid: "53d11eab77564a84ba2f46b7a22adcf5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53d11eab77564a84ba2f46b7a22adcf5" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41679 } } }
I20260808 15:47:29.228545 18085 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53d11eab77564a84ba2f46b7a22adcf5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "53d11eab77564a84ba2f46b7a22adcf5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53d11eab77564a84ba2f46b7a22adcf5" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41679 } } }
I20260808 15:47:29.228629 18086 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53d11eab77564a84ba2f46b7a22adcf5 [sys.catalog]: This master's current role is: LEADER
I20260808 15:47:29.228654 18085 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53d11eab77564a84ba2f46b7a22adcf5 [sys.catalog]: This master's current role is: LEADER
I20260808 15:47:29.229069 18095 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:47:29.232306 18095 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:47:29.237847 18095 catalog_manager.cc:1347] Generated new cluster ID: 13350780e74e42889ff53ab318f8b4b1
I20260808 15:47:29.237934 18095 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:47:29.262455 18095 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:47:29.263562 18095 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:47:29.273339 18095 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 53d11eab77564a84ba2f46b7a22adcf5: Generated new TSK 0
I20260808 15:47:29.274390 18095 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:47:29.288589 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:0
--local_ip_for_outbound_sockets=127.8.39.65
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41679
--builtin_ntp_servers=127.8.39.84:34765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 15:47:29.406478 18104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:29.406800 18104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:29.406840 18104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:29.410888 18104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:29.410939 18104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:29.410992 18104 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:47:29.415822 18104 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:34765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:29.416944 18104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:29.418326 18104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:29.428304 18112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:29.428304 18109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:29.428601 18104 server_base.cc:1034] running on GCE node
W20260808 15:47:29.428349 18110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:29.429207 18104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:29.429898 18104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:29.431085 18104 hybrid_clock.cc:648] HybridClock initialized: now 1786204049431071 us; error 26 us; skew 500 ppm
I20260808 15:47:29.433104 18104 webserver.cc:460] Webserver started at http://127.8.39.65:44655/ using document root <none> and password file <none>
I20260808 15:47:29.433717 18104 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:29.433784 18104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:29.434020 18104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:47:29.436226 18104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/data/instance:
uuid: "62bb7d2c495149dd82d9528a8f0aee56"
format_stamp: "Formatted at 2026-08-08 15:47:29 on dist-test-slave-8tdl"
server_key: "b5be0ef3f1fe032c6a0e2bfb2ec40e3d"
server_key_iv: "6b321595f440b7b0886a81e678cf30d5"
server_key_version: "encryptionkey@0"
I20260808 15:47:29.436829 18104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance:
uuid: "62bb7d2c495149dd82d9528a8f0aee56"
format_stamp: "Formatted at 2026-08-08 15:47:29 on dist-test-slave-8tdl"
server_key: "b5be0ef3f1fe032c6a0e2bfb2ec40e3d"
server_key_iv: "6b321595f440b7b0886a81e678cf30d5"
server_key_version: "encryptionkey@0"
I20260808 15:47:29.440639 18104 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 15:47:29.443291 18119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:29.444798 18104 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:47:29.444962 18104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "62bb7d2c495149dd82d9528a8f0aee56"
format_stamp: "Formatted at 2026-08-08 15:47:29 on dist-test-slave-8tdl"
server_key: "b5be0ef3f1fe032c6a0e2bfb2ec40e3d"
server_key_iv: "6b321595f440b7b0886a81e678cf30d5"
server_key_version: "encryptionkey@0"
I20260808 15:47:29.445099 18104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:29.471547 18104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:29.472369 18104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:29.472604 18104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:29.473389 18104 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:47:29.474565 18104 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:47:29.474622 18104 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:29.474715 18104 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:47:29.474753 18104 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260808 15:47:29.484824 18104 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:45343
I20260808 15:47:29.484856 18237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:45343 every 8 connection(s)
I20260808 15:47:29.485885 18104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:47:29.486269 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 18104
I20260808 15:47:29.486406 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance
I20260808 15:47:29.486817 8349 external_mini_cluster.cc:1428] Setting key 9f9424d9dbd42906402401d104ee2417
I20260808 15:47:29.489445 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:0
--local_ip_for_outbound_sockets=127.8.39.66
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41679
--builtin_ntp_servers=127.8.39.84:34765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 15:47:29.496212 18082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:29.488113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:33201 (local address 127.8.39.126:41679)
0808 15:47:29.488266 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:29.488271 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:29.489698 (+ 1427us) server_negotiation.cc:407] Connection header received
0808 15:47:29.491249 (+ 1551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:29.491253 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:29.491308 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:29.491424 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:29.492314 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:29.492887 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:29.494082 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:29.494302 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:29.494413 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:29.495689 (+ 1276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:29.495698 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:29.495700 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:47:29.495711 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:29.495730 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:47:29.495738 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:29.495815 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:29.495998 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 15:47:29.496066 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 15:47:29.497094 18240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:29.488703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41679 (local address 127.8.39.65:33201)
0808 15:47:29.489499 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:29.489582 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:29.491041 (+ 1459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:29.491595 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:29.491601 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:29.491684 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:29.492174 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:29.492185 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:29.493020 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:29.493024 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:29.493946 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:29.493955 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:29.494458 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:29.494461 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:29.494626 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:29.495421 (+ 795us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:47:29.495422 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:29.495464 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:47:29.495526 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:29.495829 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:29.495841 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:29.495848 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 15:47:29.495998 (+ 150us) client_negotiation.cc:240] Negotiation successful
0808 15:47:29.496278 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":191,"threads_started":1}
I20260808 15:47:29.498487 18238 heartbeater.cc:347] Connected to a master server at 127.8.39.126:41679
I20260808 15:47:29.498819 18238 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:29.499621 18238 heartbeater.cc:511] Master 127.8.39.126:41679 requested a full tablet report, sending...
I20260808 15:47:29.501431 18043 ts_manager.cc:194] Registered new tserver with Master: 62bb7d2c495149dd82d9528a8f0aee56 (127.8.39.65:45343)
I20260808 15:47:29.502643 18043 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.39.65:33201
W20260808 15:47:29.613281 18241 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:29.613554 18241 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:29.613591 18241 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:29.617817 18241 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:29.617878 18241 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:29.617954 18241 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:47:29.622736 18241 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:34765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18241
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:29.623811 18241 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:29.625348 18241 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:29.635308 18246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:29.635319 18247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:29.635414 18249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:29.635486 18241 server_base.cc:1034] running on GCE node
I20260808 15:47:29.636067 18241 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:29.636803 18241 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:29.638032 18241 hybrid_clock.cc:648] HybridClock initialized: now 1786204049638012 us; error 31 us; skew 500 ppm
I20260808 15:47:29.640021 18241 webserver.cc:460] Webserver started at http://127.8.39.66:35927/ using document root <none> and password file <none>
I20260808 15:47:29.640616 18241 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:29.640713 18241 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:29.640949 18241 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:47:29.643189 18241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/data/instance:
uuid: "0b2345d081364849a35768a04affc24a"
format_stamp: "Formatted at 2026-08-08 15:47:29 on dist-test-slave-8tdl"
server_key: "b5ec4cb1dcc8baaa58710bd1c0e7b7a3"
server_key_iv: "fdc136792e4b5b8084761ae97274018c"
server_key_version: "encryptionkey@0"
I20260808 15:47:29.643774 18241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance:
uuid: "0b2345d081364849a35768a04affc24a"
format_stamp: "Formatted at 2026-08-08 15:47:29 on dist-test-slave-8tdl"
server_key: "b5ec4cb1dcc8baaa58710bd1c0e7b7a3"
server_key_iv: "fdc136792e4b5b8084761ae97274018c"
server_key_version: "encryptionkey@0"
I20260808 15:47:29.647639 18241 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 15:47:29.650484 18255 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:29.651865 18241 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:47:29.652040 18241 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "0b2345d081364849a35768a04affc24a"
format_stamp: "Formatted at 2026-08-08 15:47:29 on dist-test-slave-8tdl"
server_key: "b5ec4cb1dcc8baaa58710bd1c0e7b7a3"
server_key_iv: "fdc136792e4b5b8084761ae97274018c"
server_key_version: "encryptionkey@0"
I20260808 15:47:29.652173 18241 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:29.665789 18241 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:29.666591 18241 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:29.666844 18241 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:29.667555 18241 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:47:29.668576 18241 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:47:29.668655 18241 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:29.668735 18241 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:47:29.668783 18241 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:29.679433 18241 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:42073
I20260808 15:47:29.679456 18373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:42073 every 8 connection(s)
I20260808 15:47:29.680469 18241 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:47:29.687634 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 18241
I20260808 15:47:29.687736 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance
I20260808 15:47:29.688040 8349 external_mini_cluster.cc:1428] Setting key 9fc6669bf6e29080725b21fbeacd9d89
I20260808 15:47:29.690269 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:0
--local_ip_for_outbound_sockets=127.8.39.67
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41679
--builtin_ntp_servers=127.8.39.84:34765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 15:47:29.690613 18082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:29.682529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:43017 (local address 127.8.39.126:41679)
0808 15:47:29.682734 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:29.682740 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:29.683847 (+ 1107us) server_negotiation.cc:407] Connection header received
0808 15:47:29.685257 (+ 1410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:29.685260 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:29.685310 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:29.685397 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:29.686333 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:29.686966 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:29.688203 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:29.688434 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:29.688557 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:29.690033 (+ 1476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:29.690037 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:29.690045 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:47:29.690058 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:29.690079 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:47:29.690088 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:29.690173 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:29.690388 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 15:47:29.690459 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 15:47:29.691586 18377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:29.683028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41679 (local address 127.8.39.66:43017)
0808 15:47:29.683685 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:29.683727 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:29.685038 (+ 1311us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:29.685564 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:29.685570 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:29.685650 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:29.686180 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:29.686195 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:29.687082 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:29.687085 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:29.688059 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:29.688068 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:29.688604 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:29.688608 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:29.688813 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:29.689617 (+ 804us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:47:29.689619 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:29.689689 (+ 70us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:47:29.689786 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:29.690188 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:29.690199 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:29.690206 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 15:47:29.690353 (+ 147us) client_negotiation.cc:240] Negotiation successful
0808 15:47:29.690702 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":117,"threads_started":1}
I20260808 15:47:29.692900 18375 heartbeater.cc:347] Connected to a master server at 127.8.39.126:41679
I20260808 15:47:29.693185 18375 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:29.693753 18375 heartbeater.cc:511] Master 127.8.39.126:41679 requested a full tablet report, sending...
I20260808 15:47:29.694860 18043 ts_manager.cc:194] Registered new tserver with Master: 0b2345d081364849a35768a04affc24a (127.8.39.66:42073)
I20260808 15:47:29.695427 18043 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.39.66:43017
W20260808 15:47:29.808231 18378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:29.808495 18378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:29.808532 18378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:29.812625 18378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:29.812686 18378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:29.812740 18378 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:47:29.817582 18378 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:34765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18378
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:29.818729 18378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:29.820127 18378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:29.830040 18386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:29.830001 18384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:29.830029 18383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:29.830323 18378 server_base.cc:1034] running on GCE node
I20260808 15:47:29.830770 18378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:29.831523 18378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:29.832736 18378 hybrid_clock.cc:648] HybridClock initialized: now 1786204049832724 us; error 44 us; skew 500 ppm
I20260808 15:47:29.834946 18378 webserver.cc:460] Webserver started at http://127.8.39.67:40675/ using document root <none> and password file <none>
I20260808 15:47:29.835539 18378 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:29.835601 18378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:29.835809 18378 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:47:29.837984 18378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/data/instance:
uuid: "9c49598cdb2e4b02b2fd2903e1676269"
format_stamp: "Formatted at 2026-08-08 15:47:29 on dist-test-slave-8tdl"
server_key: "2a54fdc6eed7c06d592cd8dd727d14fd"
server_key_iv: "fa1f0311a643a832fcffff6fc08bb4aa"
server_key_version: "encryptionkey@0"
I20260808 15:47:29.838552 18378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance:
uuid: "9c49598cdb2e4b02b2fd2903e1676269"
format_stamp: "Formatted at 2026-08-08 15:47:29 on dist-test-slave-8tdl"
server_key: "2a54fdc6eed7c06d592cd8dd727d14fd"
server_key_iv: "fa1f0311a643a832fcffff6fc08bb4aa"
server_key_version: "encryptionkey@0"
I20260808 15:47:29.842398 18378 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 15:47:29.845062 18392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:29.846478 18378 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:47:29.846628 18378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "9c49598cdb2e4b02b2fd2903e1676269"
format_stamp: "Formatted at 2026-08-08 15:47:29 on dist-test-slave-8tdl"
server_key: "2a54fdc6eed7c06d592cd8dd727d14fd"
server_key_iv: "fa1f0311a643a832fcffff6fc08bb4aa"
server_key_version: "encryptionkey@0"
I20260808 15:47:29.846830 18378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:29.869943 18378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:29.870814 18378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:29.871052 18378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:29.871763 18378 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:47:29.872826 18378 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:47:29.872961 18378 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:29.873011 18378 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:47:29.873064 18378 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:29.883342 18378 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:36137
I20260808 15:47:29.883368 18512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:36137 every 8 connection(s)
I20260808 15:47:29.884407 18378 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:47:29.888733 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 18378
I20260808 15:47:29.888870 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance
I20260808 15:47:29.889168 8349 external_mini_cluster.cc:1428] Setting key 007ed7ecc4fdea477306f2f758573ed7
I20260808 15:47:29.894980 18082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:29.886487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:36067 (local address 127.8.39.126:41679)
0808 15:47:29.886656 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:29.886661 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:29.887877 (+ 1216us) server_negotiation.cc:407] Connection header received
0808 15:47:29.889419 (+ 1542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:29.889423 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:29.889483 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:29.889621 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:29.890998 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:29.891595 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:29.892890 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:29.893136 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:29.893221 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:29.894451 (+ 1230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:29.894454 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:29.894456 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:47:29.894468 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:29.894489 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:47:29.894497 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:29.894564 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:29.894772 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 15:47:29.894853 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 15:47:29.895882 18515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:29.886990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41679 (local address 127.8.39.67:36067)
0808 15:47:29.887711 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:29.887755 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:29.889137 (+ 1382us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:29.889866 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:29.889873 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:29.890032 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:29.890859 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:29.890882 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:29.891741 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:29.891745 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:29.892757 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:29.892767 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:29.893269 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:29.893272 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:29.893427 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:29.894163 (+ 736us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:47:29.894165 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:29.894209 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:47:29.894281 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:29.894564 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:29.894569 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:29.894573 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 15:47:29.894716 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 15:47:29.894993 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":129,"threads_started":1}
I20260808 15:47:29.897089 18513 heartbeater.cc:347] Connected to a master server at 127.8.39.126:41679
I20260808 15:47:29.897354 18513 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:29.897927 18513 heartbeater.cc:511] Master 127.8.39.126:41679 requested a full tablet report, sending...
I20260808 15:47:29.899083 18043 ts_manager.cc:194] Registered new tserver with Master: 9c49598cdb2e4b02b2fd2903e1676269 (127.8.39.67:36137)
I20260808 15:47:29.899623 18043 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.39.67:36067
I20260808 15:47:29.903681 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 15:47:29.906610 18082 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:29.905716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51050 (local address 127.8.39.126:41679)
0808 15:47:29.905879 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:29.905883 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:29.906049 (+ 166us) server_negotiation.cc:407] Connection header received
0808 15:47:29.906140 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:29.906142 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:29.906184 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:29.906248 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:29.906472 (+ 224us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51050: BlockingRecv error: recv got EOF from 127.0.0.1:51050 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 15:47:29.906764 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 18104
I20260808 15:47:29.915351 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 18241
I20260808 15:47:29.923800 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 18378
I20260808 15:47:29.932039 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 18011
2026-08-08T15:47:29Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (953 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T15:47:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:47:29Z Disabled control of system clock
I20260808 15:47:29.966105 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:41305
--webserver_interface=127.8.39.126
--webserver_port=0
--builtin_ntp_servers=127.8.39.84:38955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:41305
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 15:47:30.083109 18525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:30.083415 18525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:30.083455 18525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:30.087687 18525 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:47:30.087761 18525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:30.087777 18525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:30.087795 18525 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:47:30.087811 18525 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:47:30.092953 18525 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:38955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:41305
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:41305
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:30.094165 18525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:30.095721 18525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:30.104743 18530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:30.104743 18533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:30.104744 18531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:30.104800 18525 server_base.cc:1034] running on GCE node
I20260808 15:47:30.105561 18525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:30.106863 18525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:30.108062 18525 hybrid_clock.cc:648] HybridClock initialized: now 1786204050108029 us; error 48 us; skew 500 ppm
I20260808 15:47:30.110037 18525 webserver.cc:460] Webserver started at http://127.8.39.126:40319/ using document root <none> and password file <none>
I20260808 15:47:30.110885 18525 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:30.111001 18525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:30.111297 18525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:47:30.113583 18525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "e5170cf7202a48f78a37ddc8571042e3"
format_stamp: "Formatted at 2026-08-08 15:47:30 on dist-test-slave-8tdl"
server_key: "347cf3dee13c21d34361c34ffa3b9d96"
server_key_iv: "ca75da6067ce77712fa2c7e48da1a2d9"
server_key_version: "encryptionkey@0"
I20260808 15:47:30.114214 18525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "e5170cf7202a48f78a37ddc8571042e3"
format_stamp: "Formatted at 2026-08-08 15:47:30 on dist-test-slave-8tdl"
server_key: "347cf3dee13c21d34361c34ffa3b9d96"
server_key_iv: "ca75da6067ce77712fa2c7e48da1a2d9"
server_key_version: "encryptionkey@0"
I20260808 15:47:30.118209 18525 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 15:47:30.120955 18539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:30.122277 18525 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:47:30.122422 18525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "e5170cf7202a48f78a37ddc8571042e3"
format_stamp: "Formatted at 2026-08-08 15:47:30 on dist-test-slave-8tdl"
server_key: "347cf3dee13c21d34361c34ffa3b9d96"
server_key_iv: "ca75da6067ce77712fa2c7e48da1a2d9"
server_key_version: "encryptionkey@0"
I20260808 15:47:30.122545 18525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:30.127419 18525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:30.128062 18525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:30.128212 18525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:30.135924 18525 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:41305
I20260808 15:47:30.135936 18592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:41305 every 8 connection(s)
I20260808 15:47:30.136942 18525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:47:30.140520 18593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:30.143280 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 18525
I20260808 15:47:30.143384 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:47:30.143680 8349 external_mini_cluster.cc:1428] Setting key 1e56d9f4cb160bf9694be965d011b7bc
I20260808 15:47:30.146982 18593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5170cf7202a48f78a37ddc8571042e3: Bootstrap starting.
I20260808 15:47:30.149619 18593 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e5170cf7202a48f78a37ddc8571042e3: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:30.149721 18597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:30.145240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39046 (local address 127.8.39.126:41305)
0808 15:47:30.145921 (+ 681us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:30.145937 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:30.145973 (+ 36us) server_negotiation.cc:407] Connection header received
0808 15:47:30.146724 (+ 751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:30.146757 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:30.147165 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:30.147522 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:30.148389 (+ 867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:30.148394 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:30.148406 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:47:30.148418 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:30.148478 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:47:30.148496 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:30.148654 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:30.148729 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 15:47:30.148982 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":135,"threads_started":1}
I20260808 15:47:30.150624 18593 log.cc:824] T 00000000000000000000000000000000 P e5170cf7202a48f78a37ddc8571042e3: Log is configured to *not* fsync() on all Append() calls
I20260808 15:47:30.153121 18593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5170cf7202a48f78a37ddc8571042e3: No bootstrap required, opened a new log
I20260808 15:47:30.157295 18593 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5170cf7202a48f78a37ddc8571042e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5170cf7202a48f78a37ddc8571042e3" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41305 } }
I20260808 15:47:30.157584 18593 raft_consensus.cc:374] T 00000000000000000000000000000000 P e5170cf7202a48f78a37ddc8571042e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:30.157624 18593 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5170cf7202a48f78a37ddc8571042e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5170cf7202a48f78a37ddc8571042e3, State: Initialized, Role: FOLLOWER
I20260808 15:47:30.158089 18593 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5170cf7202a48f78a37ddc8571042e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5170cf7202a48f78a37ddc8571042e3" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41305 } }
I20260808 15:47:30.158231 18593 raft_consensus.cc:388] T 00000000000000000000000000000000 P e5170cf7202a48f78a37ddc8571042e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:47:30.158277 18593 raft_consensus.cc:482] T 00000000000000000000000000000000 P e5170cf7202a48f78a37ddc8571042e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:47:30.158365 18593 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5170cf7202a48f78a37ddc8571042e3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:30.159576 18593 raft_consensus.cc:504] T 00000000000000000000000000000000 P e5170cf7202a48f78a37ddc8571042e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5170cf7202a48f78a37ddc8571042e3" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41305 } }
I20260808 15:47:30.160017 18593 leader_election.cc:302] T 00000000000000000000000000000000 P e5170cf7202a48f78a37ddc8571042e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e5170cf7202a48f78a37ddc8571042e3; no voters:
I20260808 15:47:30.160411 18593 leader_election.cc:288] T 00000000000000000000000000000000 P e5170cf7202a48f78a37ddc8571042e3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:47:30.160641 18599 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e5170cf7202a48f78a37ddc8571042e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:47:30.161043 18599 raft_consensus.cc:686] T 00000000000000000000000000000000 P e5170cf7202a48f78a37ddc8571042e3 [term 1 LEADER]: Becoming Leader. State: Replica: e5170cf7202a48f78a37ddc8571042e3, State: Running, Role: LEADER
I20260808 15:47:30.161670 18599 consensus_queue.cc:237] T 00000000000000000000000000000000 P e5170cf7202a48f78a37ddc8571042e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5170cf7202a48f78a37ddc8571042e3" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41305 } }
I20260808 15:47:30.162217 18593 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5170cf7202a48f78a37ddc8571042e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:47:30.163751 18601 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5170cf7202a48f78a37ddc8571042e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e5170cf7202a48f78a37ddc8571042e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5170cf7202a48f78a37ddc8571042e3" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41305 } } }
I20260808 15:47:30.163932 18601 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5170cf7202a48f78a37ddc8571042e3 [sys.catalog]: This master's current role is: LEADER
I20260808 15:47:30.163748 18602 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5170cf7202a48f78a37ddc8571042e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5170cf7202a48f78a37ddc8571042e3. Latest consensus state: current_term: 1 leader_uuid: "e5170cf7202a48f78a37ddc8571042e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5170cf7202a48f78a37ddc8571042e3" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41305 } } }
I20260808 15:47:30.164454 18602 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5170cf7202a48f78a37ddc8571042e3 [sys.catalog]: This master's current role is: LEADER
I20260808 15:47:30.165050 18609 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:47:30.167946 18609 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:47:30.173462 18609 catalog_manager.cc:1347] Generated new cluster ID: edffd1ade5d54d579744fd5c0c07a444
I20260808 15:47:30.173554 18609 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:47:30.184085 18609 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:47:30.184435 18609 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:47:30.191709 18609 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e5170cf7202a48f78a37ddc8571042e3: Generated new TSK 0
I20260808 15:47:30.192508 18609 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:47:30.202085 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:0
--local_ip_for_outbound_sockets=127.8.39.65
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41305
--builtin_ntp_servers=127.8.39.84:38955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 15:47:30.321830 18620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:30.322125 18620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:30.322168 18620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:30.326416 18620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:30.326481 18620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:30.326562 18620 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:47:30.331786 18620 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:38955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41305
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:30.332979 18620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:30.334544 18620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:30.344573 18628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:30.344623 18626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:30.344600 18625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:30.344887 18620 server_base.cc:1034] running on GCE node
I20260808 15:47:30.345443 18620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:30.346207 18620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:30.347376 18620 hybrid_clock.cc:648] HybridClock initialized: now 1786204050347355 us; error 33 us; skew 500 ppm
I20260808 15:47:30.349575 18620 webserver.cc:460] Webserver started at http://127.8.39.65:39549/ using document root <none> and password file <none>
I20260808 15:47:30.350189 18620 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:30.350260 18620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:30.350507 18620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:47:30.352721 18620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/data/instance:
uuid: "50c9b1ac8ac84871933873cc50eb6df4"
format_stamp: "Formatted at 2026-08-08 15:47:30 on dist-test-slave-8tdl"
server_key: "1939b4c14ce79540f00a8fbb4e7e3484"
server_key_iv: "c4473b7a000838ed23325cca0d67dd9f"
server_key_version: "encryptionkey@0"
I20260808 15:47:30.353320 18620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance:
uuid: "50c9b1ac8ac84871933873cc50eb6df4"
format_stamp: "Formatted at 2026-08-08 15:47:30 on dist-test-slave-8tdl"
server_key: "1939b4c14ce79540f00a8fbb4e7e3484"
server_key_iv: "c4473b7a000838ed23325cca0d67dd9f"
server_key_version: "encryptionkey@0"
I20260808 15:47:30.358017 18620 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 15:47:30.360818 18634 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:30.362257 18620 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:47:30.362452 18620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "50c9b1ac8ac84871933873cc50eb6df4"
format_stamp: "Formatted at 2026-08-08 15:47:30 on dist-test-slave-8tdl"
server_key: "1939b4c14ce79540f00a8fbb4e7e3484"
server_key_iv: "c4473b7a000838ed23325cca0d67dd9f"
server_key_version: "encryptionkey@0"
I20260808 15:47:30.362591 18620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:30.367583 18620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:30.368208 18620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:30.368400 18620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:30.368968 18620 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:47:30.369905 18620 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:47:30.369985 18620 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:30.370059 18620 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:47:30.370090 18620 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:30.378841 18620 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:42949
I20260808 15:47:30.378989 18751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:42949 every 8 connection(s)
I20260808 15:47:30.379822 18620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:47:30.386159 18597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:30.381728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:47631 (local address 127.8.39.126:41305)
0808 15:47:30.381933 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:30.381937 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:30.382971 (+ 1034us) server_negotiation.cc:407] Connection header received
0808 15:47:30.384326 (+ 1355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:30.384330 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:30.384389 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:30.384496 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:30.385587 (+ 1091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:30.385590 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:30.385593 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:47:30.385608 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:30.385633 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:47:30.385650 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:30.385755 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:30.385970 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 15:47:30.386020 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 15:47:30.387193 18754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:30.382027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41305 (local address 127.8.39.65:47631)
0808 15:47:30.382779 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:30.382823 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:30.384107 (+ 1284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:30.384666 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:30.384673 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:30.384756 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:30.385295 (+ 539us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:47:30.385296 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:30.385339 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:47:30.385409 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:30.385748 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:30.385757 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:30.385763 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 15:47:30.385998 (+ 235us) client_negotiation.cc:240] Negotiation successful
0808 15:47:30.386251 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":113,"threads_started":1}
I20260808 15:47:30.388490 18752 heartbeater.cc:347] Connected to a master server at 127.8.39.126:41305
I20260808 15:47:30.388747 18752 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:30.389240 18752 heartbeater.cc:511] Master 127.8.39.126:41305 requested a full tablet report, sending...
I20260808 15:47:30.390010 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 18620
I20260808 15:47:30.390146 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance
I20260808 15:47:30.390472 8349 external_mini_cluster.cc:1428] Setting key 33139eeb66cdbf6ada20a59164541eae
I20260808 15:47:30.391036 18556 ts_manager.cc:194] Registered new tserver with Master: 50c9b1ac8ac84871933873cc50eb6df4 (127.8.39.65:42949)
I20260808 15:47:30.392855 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:0
--local_ip_for_outbound_sockets=127.8.39.66
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41305
--builtin_ntp_servers=127.8.39.84:38955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 15:47:30.512351 18755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:30.512646 18755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:30.512719 18755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:30.517424 18755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:30.517490 18755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:30.517554 18755 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:47:30.523039 18755 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:38955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41305
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18755
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:30.524286 18755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:30.525957 18755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:30.536684 18760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:30.536907 18755 server_base.cc:1034] running on GCE node
W20260808 15:47:30.536669 18763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:30.536669 18761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:30.537482 18755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:30.538190 18755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:30.539419 18755 hybrid_clock.cc:648] HybridClock initialized: now 1786204050539403 us; error 25 us; skew 500 ppm
I20260808 15:47:30.541541 18755 webserver.cc:460] Webserver started at http://127.8.39.66:44345/ using document root <none> and password file <none>
I20260808 15:47:30.542171 18755 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:30.542243 18755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:30.542480 18755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:47:30.544762 18755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/data/instance:
uuid: "1797a8172afc40c895c873580314ef41"
format_stamp: "Formatted at 2026-08-08 15:47:30 on dist-test-slave-8tdl"
server_key: "502d4cc164af468826e4191dcc16e8ef"
server_key_iv: "d870ac793698966c1c97d1f75ca332f5"
server_key_version: "encryptionkey@0"
I20260808 15:47:30.545389 18755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance:
uuid: "1797a8172afc40c895c873580314ef41"
format_stamp: "Formatted at 2026-08-08 15:47:30 on dist-test-slave-8tdl"
server_key: "502d4cc164af468826e4191dcc16e8ef"
server_key_iv: "d870ac793698966c1c97d1f75ca332f5"
server_key_version: "encryptionkey@0"
I20260808 15:47:30.549470 18755 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 15:47:30.552362 18769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:30.553714 18755 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:47:30.553819 18755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "1797a8172afc40c895c873580314ef41"
format_stamp: "Formatted at 2026-08-08 15:47:30 on dist-test-slave-8tdl"
server_key: "502d4cc164af468826e4191dcc16e8ef"
server_key_iv: "d870ac793698966c1c97d1f75ca332f5"
server_key_version: "encryptionkey@0"
I20260808 15:47:30.553970 18755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:30.559252 18755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:30.559926 18755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:30.560122 18755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:30.560765 18755 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:47:30.561740 18755 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:47:30.561792 18755 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:30.561862 18755 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:47:30.561910 18755 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:30.572003 18755 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:36527
I20260808 15:47:30.572083 18889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:36527 every 8 connection(s)
I20260808 15:47:30.573048 18755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:47:30.579819 18597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:30.575150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:48463 (local address 127.8.39.126:41305)
0808 15:47:30.575326 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:30.575332 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:30.576551 (+ 1219us) server_negotiation.cc:407] Connection header received
0808 15:47:30.577966 (+ 1415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:30.577970 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:30.578011 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:30.578100 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:30.579313 (+ 1213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:30.579316 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:30.579318 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:47:30.579333 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:30.579362 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:47:30.579371 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:30.579463 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:30.579648 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 15:47:30.579696 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 15:47:30.580639 18892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:30.575565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41305 (local address 127.8.39.66:48463)
0808 15:47:30.576346 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:30.576406 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:30.577696 (+ 1290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:30.578273 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:30.578280 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:30.578376 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:30.579022 (+ 646us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:47:30.579024 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:30.579065 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:47:30.579132 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:30.579457 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:30.579464 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:30.579468 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 15:47:30.579605 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 15:47:30.579796 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":115,"threads_started":1}
I20260808 15:47:30.581139 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 18755
I20260808 15:47:30.581326 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance
I20260808 15:47:30.581674 8349 external_mini_cluster.cc:1428] Setting key 7a0766eb4e856ca20cce3337e63cc2c5
I20260808 15:47:30.581821 18890 heartbeater.cc:347] Connected to a master server at 127.8.39.126:41305
I20260808 15:47:30.582101 18890 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:30.582585 18890 heartbeater.cc:511] Master 127.8.39.126:41305 requested a full tablet report, sending...
I20260808 15:47:30.583670 18556 ts_manager.cc:194] Registered new tserver with Master: 1797a8172afc40c895c873580314ef41 (127.8.39.66:36527)
I20260808 15:47:30.583904 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:0
--local_ip_for_outbound_sockets=127.8.39.67
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41305
--builtin_ntp_servers=127.8.39.84:38955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 15:47:30.717187 18893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:30.717475 18893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:30.717518 18893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:30.721781 18893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:30.721846 18893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:30.721906 18893 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:47:30.727041 18893 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:38955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41305
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18893
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:30.728139 18893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:30.729512 18893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:30.740484 18899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:30.740520 18898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:30.740604 18893 server_base.cc:1034] running on GCE node
W20260808 15:47:30.740484 18901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:30.741300 18893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:30.741935 18893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:30.743109 18893 hybrid_clock.cc:648] HybridClock initialized: now 1786204050743079 us; error 48 us; skew 500 ppm
I20260808 15:47:30.745059 18893 webserver.cc:460] Webserver started at http://127.8.39.67:39221/ using document root <none> and password file <none>
I20260808 15:47:30.745723 18893 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:30.745795 18893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:30.746025 18893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:47:30.748358 18893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/data/instance:
uuid: "2d1d2f06305049229c6924daceafba1a"
format_stamp: "Formatted at 2026-08-08 15:47:30 on dist-test-slave-8tdl"
server_key: "20e669e48aecad4ae3e71a4859a05d6f"
server_key_iv: "3dfb2fc96985cb811bd97360112376ab"
server_key_version: "encryptionkey@0"
I20260808 15:47:30.748998 18893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance:
uuid: "2d1d2f06305049229c6924daceafba1a"
format_stamp: "Formatted at 2026-08-08 15:47:30 on dist-test-slave-8tdl"
server_key: "20e669e48aecad4ae3e71a4859a05d6f"
server_key_iv: "3dfb2fc96985cb811bd97360112376ab"
server_key_version: "encryptionkey@0"
I20260808 15:47:30.753082 18893 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 15:47:30.755967 18907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:30.757310 18893 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:47:30.757473 18893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "2d1d2f06305049229c6924daceafba1a"
format_stamp: "Formatted at 2026-08-08 15:47:30 on dist-test-slave-8tdl"
server_key: "20e669e48aecad4ae3e71a4859a05d6f"
server_key_iv: "3dfb2fc96985cb811bd97360112376ab"
server_key_version: "encryptionkey@0"
I20260808 15:47:30.757608 18893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:30.762439 18893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:30.763197 18893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:30.763401 18893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:30.764009 18893 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:47:30.765111 18893 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:47:30.765158 18893 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:30.765224 18893 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:47:30.765260 18893 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:30.775058 18893 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:44999
I20260808 15:47:30.775149 19024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:44999 every 8 connection(s)
I20260808 15:47:30.776013 18893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:47:30.781716 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 18893
I20260808 15:47:30.781874 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance
I20260808 15:47:30.782220 8349 external_mini_cluster.cc:1428] Setting key 0acc43cea0c68760c9cd3062738a7745
I20260808 15:47:30.782761 18597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:30.778085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:44135 (local address 127.8.39.126:41305)
0808 15:47:30.778242 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:30.778245 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:30.779386 (+ 1141us) server_negotiation.cc:407] Connection header received
0808 15:47:30.780732 (+ 1346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:30.780735 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:30.780781 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:30.780870 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:30.782209 (+ 1339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:30.782213 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:30.782215 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:47:30.782228 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:30.782277 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:47:30.782291 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:30.782387 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:30.782526 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 15:47:30.782586 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 15:47:30.783715 19027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:30.778525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41305 (local address 127.8.39.67:44135)
0808 15:47:30.779240 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:30.779281 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:30.780516 (+ 1235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:30.781056 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:30.781063 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:30.781150 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:30.781896 (+ 746us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:47:30.781898 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:30.781961 (+ 63us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:47:30.782060 (+ 99us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:30.782367 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:30.782376 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:30.782382 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 15:47:30.782577 (+ 195us) client_negotiation.cc:240] Negotiation successful
0808 15:47:30.782854 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":181,"threads_started":1}
I20260808 15:47:30.784900 19025 heartbeater.cc:347] Connected to a master server at 127.8.39.126:41305
I20260808 15:47:30.785161 19025 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:30.785609 19025 heartbeater.cc:511] Master 127.8.39.126:41305 requested a full tablet report, sending...
I20260808 15:47:30.786747 18555 ts_manager.cc:194] Registered new tserver with Master: 2d1d2f06305049229c6924daceafba1a (127.8.39.67:44999)
I20260808 15:47:30.796594 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 15:47:30.799784 18597 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:47:30.798761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39054 (local address 127.8.39.126:41305)
0808 15:47:30.798915 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:30.798921 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:30.799125 (+ 204us) server_negotiation.cc:407] Connection header received
0808 15:47:30.799277 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:30.799280 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:30.799319 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:30.799412 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:30.799646 (+ 234us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39054: BlockingRecv error: recv got EOF from 127.0.0.1:39054 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 15:47:30.800180 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 18620
I20260808 15:47:30.807773 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 18755
I20260808 15:47:30.813984 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 18893
I20260808 15:47:30.821414 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 18525
2026-08-08T15:47:30Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (888 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:47:30 dist-test-slave-8tdl krb5kdc[19036](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:47:30 dist-test-slave-8tdl krb5kdc[19036](info): set up 2 sockets
Aug 08 15:47:30 dist-test-slave-8tdl krb5kdc[19036](info): commencing operation
krb5kdc: starting...
W20260808 15:47:31.971993 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:47:32 dist-test-slave-8tdl krb5kdc[19036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204052, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:47:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:47:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:47:32.110595 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:39795
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:39329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:39795
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:47:32.225453 19050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:32.225788 19050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:32.225874 19050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:32.229954 19050 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:47:32.230054 19050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:32.230093 19050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:32.230154 19050 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:47:32.230190 19050 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:47:32.235612 19050 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:39329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:39795
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:39795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19050
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:32.236768 19050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:32.237838 19050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:32.247030 19060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:32.246999 19057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:32.247087 19050 server_base.cc:1034] running on GCE node
W20260808 15:47:32.247027 19058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:32.248011 19050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:32.249169 19050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:32.250376 19050 hybrid_clock.cc:648] HybridClock initialized: now 1786204052250346 us; error 43 us; skew 500 ppm
Aug 08 15:47:32 dist-test-slave-8tdl krb5kdc[19036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204052, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:47:32.258671 19050 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:47:32.259788 19050 webserver.cc:460] Webserver started at http://127.8.39.126:34275/ using document root <none> and password file <none>
I20260808 15:47:32.260453 19050 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:32.260552 19050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:32.260805 19050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:47:32.263082 19050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "af59b9943daa44aa8871cf842979d2b5"
format_stamp: "Formatted at 2026-08-08 15:47:32 on dist-test-slave-8tdl"
server_key: "357c2a9833dca8b3e9600f9a73afb69a"
server_key_iv: "2e4d4ed75812bc57b0c8302b0b66963b"
server_key_version: "encryptionkey@0"
I20260808 15:47:32.263669 19050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "af59b9943daa44aa8871cf842979d2b5"
format_stamp: "Formatted at 2026-08-08 15:47:32 on dist-test-slave-8tdl"
server_key: "357c2a9833dca8b3e9600f9a73afb69a"
server_key_iv: "2e4d4ed75812bc57b0c8302b0b66963b"
server_key_version: "encryptionkey@0"
I20260808 15:47:32.267745 19050 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 15:47:32.270457 19067 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:32.271859 19050 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:47:32.272022 19050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "af59b9943daa44aa8871cf842979d2b5"
format_stamp: "Formatted at 2026-08-08 15:47:32 on dist-test-slave-8tdl"
server_key: "357c2a9833dca8b3e9600f9a73afb69a"
server_key_iv: "2e4d4ed75812bc57b0c8302b0b66963b"
server_key_version: "encryptionkey@0"
I20260808 15:47:32.272140 19050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:32.308961 19050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:32.312320 19050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:32.312541 19050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:32.320067 19050 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:39795
I20260808 15:47:32.320358 19123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:39795 every 8 connection(s)
I20260808 15:47:32.321064 19050 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:47:32.323963 19124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:32.328644 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 19050
I20260808 15:47:32.328780 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:47:32.329080 8349 external_mini_cluster.cc:1428] Setting key 1f5600b219f68299c34a25b059859cb0
I20260808 15:47:32.329659 19124 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af59b9943daa44aa8871cf842979d2b5: Bootstrap starting.
I20260808 15:47:32.332373 19124 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af59b9943daa44aa8871cf842979d2b5: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:32.333325 19124 log.cc:824] T 00000000000000000000000000000000 P af59b9943daa44aa8871cf842979d2b5: Log is configured to *not* fsync() on all Append() calls
I20260808 15:47:32.335616 19124 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af59b9943daa44aa8871cf842979d2b5: No bootstrap required, opened a new log
Aug 08 15:47:32 dist-test-slave-8tdl krb5kdc[19036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204052, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:47:32.339972 19124 raft_consensus.cc:348] T 00000000000000000000000000000000 P af59b9943daa44aa8871cf842979d2b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af59b9943daa44aa8871cf842979d2b5" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 39795 } }
I20260808 15:47:32.340250 19124 raft_consensus.cc:374] T 00000000000000000000000000000000 P af59b9943daa44aa8871cf842979d2b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:32.340340 19124 raft_consensus.cc:729] T 00000000000000000000000000000000 P af59b9943daa44aa8871cf842979d2b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af59b9943daa44aa8871cf842979d2b5, State: Initialized, Role: FOLLOWER
I20260808 15:47:32.340909 19124 consensus_queue.cc:260] T 00000000000000000000000000000000 P af59b9943daa44aa8871cf842979d2b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af59b9943daa44aa8871cf842979d2b5" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 39795 } }
I20260808 15:47:32.341109 19124 raft_consensus.cc:388] T 00000000000000000000000000000000 P af59b9943daa44aa8871cf842979d2b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:47:32.341169 19124 raft_consensus.cc:482] T 00000000000000000000000000000000 P af59b9943daa44aa8871cf842979d2b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:47:32.341282 19124 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af59b9943daa44aa8871cf842979d2b5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:32.342496 19124 raft_consensus.cc:504] T 00000000000000000000000000000000 P af59b9943daa44aa8871cf842979d2b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af59b9943daa44aa8871cf842979d2b5" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 39795 } }
I20260808 15:47:32.342904 19124 leader_election.cc:302] T 00000000000000000000000000000000 P af59b9943daa44aa8871cf842979d2b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af59b9943daa44aa8871cf842979d2b5; no voters:
I20260808 15:47:32.343276 19124 leader_election.cc:288] T 00000000000000000000000000000000 P af59b9943daa44aa8871cf842979d2b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:47:32.343364 19129 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af59b9943daa44aa8871cf842979d2b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:47:32.343554 19129 raft_consensus.cc:686] T 00000000000000000000000000000000 P af59b9943daa44aa8871cf842979d2b5 [term 1 LEADER]: Becoming Leader. State: Replica: af59b9943daa44aa8871cf842979d2b5, State: Running, Role: LEADER
I20260808 15:47:32.343852 19129 consensus_queue.cc:237] T 00000000000000000000000000000000 P af59b9943daa44aa8871cf842979d2b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af59b9943daa44aa8871cf842979d2b5" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 39795 } }
I20260808 15:47:32.344609 19124 sys_catalog.cc:564] T 00000000000000000000000000000000 P af59b9943daa44aa8871cf842979d2b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:47:32.345451 19131 sys_catalog.cc:455] T 00000000000000000000000000000000 P af59b9943daa44aa8871cf842979d2b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af59b9943daa44aa8871cf842979d2b5. Latest consensus state: current_term: 1 leader_uuid: "af59b9943daa44aa8871cf842979d2b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af59b9943daa44aa8871cf842979d2b5" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 39795 } } }
I20260808 15:47:32.345570 19131 sys_catalog.cc:458] T 00000000000000000000000000000000 P af59b9943daa44aa8871cf842979d2b5 [sys.catalog]: This master's current role is: LEADER
I20260808 15:47:32.345897 19130 sys_catalog.cc:455] T 00000000000000000000000000000000 P af59b9943daa44aa8871cf842979d2b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af59b9943daa44aa8871cf842979d2b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af59b9943daa44aa8871cf842979d2b5" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 39795 } } }
I20260808 15:47:32.345997 19130 sys_catalog.cc:458] T 00000000000000000000000000000000 P af59b9943daa44aa8871cf842979d2b5 [sys.catalog]: This master's current role is: LEADER
I20260808 15:47:32.346014 19127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:32.330661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50322 (local address 127.8.39.126:39795)
0808 15:47:32.331200 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:32.331218 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:32.331262 (+ 44us) server_negotiation.cc:407] Connection header received
0808 15:47:32.332093 (+ 831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:32.332117 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:32.332555 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:32.332921 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:32.333733 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:32.335189 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:32.336087 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:32.336760 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:32.336916 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:32.339741 (+ 2825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:32.339747 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:32.339765 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:32.339796 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:32.341913 (+ 2117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:32.342414 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:32.342423 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:32.342432 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:32.342585 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:32.342937 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:32.342940 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:32.342941 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:32.343613 (+ 672us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:32.344488 (+ 875us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:32.344617 (+ 129us) server_negotiation.cc:299] Negotiation successful
0808 15:47:32.344937 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":151,"threads_started":1}
W20260808 15:47:32.349460 19144 catalog_manager.cc:1558] T 00000000000000000000000000000000 P af59b9943daa44aa8871cf842979d2b5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:47:32.349555 19144 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:47:32.349625 19138 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:47:32.350373 19138 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:47:32.356529 19138 catalog_manager.cc:1347] Generated new cluster ID: cf2ab8c582e94abb9e7824f1cb5708f0
I20260808 15:47:32.356627 19138 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:47:32.362080 19138 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:47:32.363214 19138 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:47:32.370852 19138 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af59b9943daa44aa8871cf842979d2b5: Generated new TSK 0
I20260808 15:47:32.371706 19138 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.39.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
I20260808 15:47:32.410445 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:0
--local_ip_for_outbound_sockets=127.8.39.65
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:39795
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:39329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:47:32.546368 19151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:32.546633 19151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:32.546731 19151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:32.550900 19151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:32.550972 19151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:32.551065 19151 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:47:32.556394 19151 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:39329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:39795
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19151
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:32.557526 19151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:32.558579 19151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:32.568779 19156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:32.568763 19157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:32.568768 19159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:32.569072 19151 server_base.cc:1034] running on GCE node
I20260808 15:47:32.569602 19151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:32.570271 19151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:32.571486 19151 hybrid_clock.cc:648] HybridClock initialized: now 1786204052571444 us; error 53 us; skew 500 ppm
Aug 08 15:47:32 dist-test-slave-8tdl krb5kdc[19036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204052, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:47:32.574779 19151 init.cc:377] Logged in from keytab as kudu/127.8.39.65@KRBTEST.COM (short username kudu)
I20260808 15:47:32.575860 19151 webserver.cc:460] Webserver started at http://127.8.39.65:40671/ using document root <none> and password file <none>
I20260808 15:47:32.576474 19151 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:32.576586 19151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:32.576802 19151 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:47:32.579114 19151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/data/instance:
uuid: "ce63e1e8dac6443a86792ee94d91ac65"
format_stamp: "Formatted at 2026-08-08 15:47:32 on dist-test-slave-8tdl"
server_key: "779b3c57c04c1bf2b6d84d43e41f4eee"
server_key_iv: "ab1390fb9a9e57310a745d3184d2be02"
server_key_version: "encryptionkey@0"
I20260808 15:47:32.579686 19151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance:
uuid: "ce63e1e8dac6443a86792ee94d91ac65"
format_stamp: "Formatted at 2026-08-08 15:47:32 on dist-test-slave-8tdl"
server_key: "779b3c57c04c1bf2b6d84d43e41f4eee"
server_key_iv: "ab1390fb9a9e57310a745d3184d2be02"
server_key_version: "encryptionkey@0"
I20260808 15:47:32.583709 19151 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:47:32.585963 19166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:32.587256 19151 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:47:32.587380 19151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "ce63e1e8dac6443a86792ee94d91ac65"
format_stamp: "Formatted at 2026-08-08 15:47:32 on dist-test-slave-8tdl"
server_key: "779b3c57c04c1bf2b6d84d43e41f4eee"
server_key_iv: "ab1390fb9a9e57310a745d3184d2be02"
server_key_version: "encryptionkey@0"
I20260808 15:47:32.587491 19151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:32.602550 19151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:32.605921 19151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:32.606148 19151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:32.606822 19151 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:47:32.607676 19151 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:47:32.607725 19151 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:32.607795 19151 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:47:32.607826 19151 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:32.616528 19151 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:39403
I20260808 15:47:32.616554 19284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:39403 every 8 connection(s)
I20260808 15:47:32.617460 19151 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:47:32.619316 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 19151
I20260808 15:47:32.619444 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance
I20260808 15:47:32.619741 8349 external_mini_cluster.cc:1428] Setting key 5db1167dea6631d89cf26769ce3564c4
Aug 08 15:47:32 dist-test-slave-8tdl krb5kdc[19036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204052, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.39.66@KRBTEST.COM; defaulting to no policy
I20260808 15:47:32.632943 19127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:32.619320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:42205 (local address 127.8.39.126:39795)
0808 15:47:32.619504 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:32.619511 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:32.620443 (+ 932us) server_negotiation.cc:407] Connection header received
0808 15:47:32.622102 (+ 1659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:32.622108 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:32.622172 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:32.622266 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:32.623634 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:32.624168 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:32.625935 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:32.626169 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:32.626252 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:32.629238 (+ 2986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:32.629241 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:32.629243 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:32.629266 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:32.630863 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:32.631374 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:32.631378 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:32.631380 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:32.631470 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:32.631837 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:32.631841 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:32.631843 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:32.632030 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:32.632141 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:32.632641 (+ 500us) server_negotiation.cc:299] Negotiation successful
0808 15:47:32.632770 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.66@KRBTEST.COM" created.
I20260808 15:47:32.634052 19287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:32.619725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:39795 (local address 127.8.39.65:42205)
0808 15:47:32.620262 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:32.620305 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:32.621840 (+ 1535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:32.622426 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:32.622433 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:32.622873 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:32.623465 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:32.623488 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:32.624311 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:32.624318 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:32.625803 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:32.625818 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:32.626341 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:32.626349 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:32.626578 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:32.627274 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:32.627300 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:32.629057 (+ 1757us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:32.630980 (+ 1923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:32.630986 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:32.631000 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:32.631264 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:32.631584 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:32.631587 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:32.631589 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:32.631737 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:32.632141 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:32.632149 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:32.632408 (+ 259us) client_negotiation.cc:769] Sending connection context
0808 15:47:32.632602 (+ 194us) client_negotiation.cc:240] Negotiation successful
0808 15:47:32.633025 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":130,"threads_started":1}
I20260808 15:47:32.635437 19285 heartbeater.cc:347] Connected to a master server at 127.8.39.126:39795
I20260808 15:47:32.635721 19285 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:32.636370 19285 heartbeater.cc:511] Master 127.8.39.126:39795 requested a full tablet report, sending...
I20260808 15:47:32.638053 19085 ts_manager.cc:194] Registered new tserver with Master: ce63e1e8dac6443a86792ee94d91ac65 (127.8.39.65:39403)
I20260808 15:47:32.639283 19085 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.65@KRBTEST.COM'} at 127.8.39.65:42205
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
I20260808 15:47:32.651917 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:0
--local_ip_for_outbound_sockets=127.8.39.66
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:39795
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:39329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:47:32.776516 19291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:32.776788 19291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:32.776834 19291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:32.780892 19291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:32.780963 19291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:32.781023 19291 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:47:32.786319 19291 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:39329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:39795
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19291
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:32.787434 19291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:32.788414 19291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:32.798163 19299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:32.798178 19296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:32.798213 19297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:32.798543 19291 server_base.cc:1034] running on GCE node
I20260808 15:47:32.798977 19291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:32.799733 19291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:32.800926 19291 hybrid_clock.cc:648] HybridClock initialized: now 1786204052800896 us; error 40 us; skew 500 ppm
Aug 08 15:47:32 dist-test-slave-8tdl krb5kdc[19036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204052, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:47:32.803843 19291 init.cc:377] Logged in from keytab as kudu/127.8.39.66@KRBTEST.COM (short username kudu)
I20260808 15:47:32.804844 19291 webserver.cc:460] Webserver started at http://127.8.39.66:44959/ using document root <none> and password file <none>
I20260808 15:47:32.805423 19291 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:32.805521 19291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:32.805757 19291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:47:32.807868 19291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/data/instance:
uuid: "26d43a950b8044d48920bb5674ebea07"
format_stamp: "Formatted at 2026-08-08 15:47:32 on dist-test-slave-8tdl"
server_key: "dfb982db71f68266a7b62eee27002007"
server_key_iv: "f8231cdc73c574c8402b2d9f8de17ec8"
server_key_version: "encryptionkey@0"
I20260808 15:47:32.808455 19291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance:
uuid: "26d43a950b8044d48920bb5674ebea07"
format_stamp: "Formatted at 2026-08-08 15:47:32 on dist-test-slave-8tdl"
server_key: "dfb982db71f68266a7b62eee27002007"
server_key_iv: "f8231cdc73c574c8402b2d9f8de17ec8"
server_key_version: "encryptionkey@0"
I20260808 15:47:32.812397 19291 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 15:47:32.815088 19306 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:32.816418 19291 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:47:32.816542 19291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "26d43a950b8044d48920bb5674ebea07"
format_stamp: "Formatted at 2026-08-08 15:47:32 on dist-test-slave-8tdl"
server_key: "dfb982db71f68266a7b62eee27002007"
server_key_iv: "f8231cdc73c574c8402b2d9f8de17ec8"
server_key_version: "encryptionkey@0"
I20260808 15:47:32.816650 19291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:32.853318 19291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:32.856778 19291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:32.857010 19291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:32.857650 19291 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:47:32.858507 19291 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:47:32.858558 19291 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:32.858629 19291 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:47:32.858666 19291 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:32.868108 19291 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:40769
I20260808 15:47:32.868139 19423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:40769 every 8 connection(s)
I20260808 15:47:32.869052 19291 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:47:32.870069 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 19291
I20260808 15:47:32.870201 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance
I20260808 15:47:32.870476 8349 external_mini_cluster.cc:1428] Setting key f593a8f15bdca84c8d9c04c40d2a0a2d
Aug 08 15:47:32 dist-test-slave-8tdl krb5kdc[19036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204052, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.39.67@KRBTEST.COM; defaulting to no policy
I20260808 15:47:32.884677 19127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:32.871166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:47359 (local address 127.8.39.126:39795)
0808 15:47:32.871313 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:32.871317 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:32.872246 (+ 929us) server_negotiation.cc:407] Connection header received
0808 15:47:32.873670 (+ 1424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:32.873676 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:32.873743 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:32.873841 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:32.875241 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:32.876044 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:32.877303 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:32.877609 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:32.877733 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:32.880579 (+ 2846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:32.880585 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:32.880589 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:32.880624 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:32.882487 (+ 1863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:32.883065 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:32.883068 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:32.883069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:32.883207 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:32.883577 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:32.883579 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:32.883580 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:32.883765 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:32.883843 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:32.884421 (+ 578us) server_negotiation.cc:299] Negotiation successful
0808 15:47:32.884534 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.67@KRBTEST.COM" created.
I20260808 15:47:32.885718 19427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:32.871592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:39795 (local address 127.8.39.66:47359)
0808 15:47:32.872078 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:32.872133 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:32.873448 (+ 1315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:32.874001 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:32.874008 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:32.874405 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:32.875016 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:32.875032 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:32.876190 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:32.876195 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:32.877178 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:32.877187 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:32.877778 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:32.877782 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:32.877952 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:32.878617 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:32.878635 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:32.880386 (+ 1751us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:32.882608 (+ 2222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:32.882613 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:32.882627 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:32.882967 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:32.883297 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:32.883300 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:32.883301 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:32.883463 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:32.883886 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:32.883893 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:32.884145 (+ 252us) client_negotiation.cc:769] Sending connection context
0808 15:47:32.884308 (+ 163us) client_negotiation.cc:240] Negotiation successful
0808 15:47:32.884595 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":156,"threads_started":1}
I20260808 15:47:32.887012 19424 heartbeater.cc:347] Connected to a master server at 127.8.39.126:39795
I20260808 15:47:32.887293 19424 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:32.887814 19424 heartbeater.cc:511] Master 127.8.39.126:39795 requested a full tablet report, sending...
I20260808 15:47:32.889019 19085 ts_manager.cc:194] Registered new tserver with Master: 26d43a950b8044d48920bb5674ebea07 (127.8.39.66:40769)
I20260808 15:47:32.889914 19085 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.66@KRBTEST.COM'} at 127.8.39.66:47359
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
I20260808 15:47:32.902853 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:0
--local_ip_for_outbound_sockets=127.8.39.67
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:39795
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:39329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:47:33.016187 19430 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:47:33.016455 19430 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:47:33.016499 19430 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:47:33.020653 19430 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:47:33.020713 19430 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:47:33.020803 19430 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:47:33.026073 19430 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:39329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:39795
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19430
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:47:33.027164 19430 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:47:33.028187 19430 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:47:33.037534 19438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:33.037576 19440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:47:33.037536 19437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:47:33.037866 19430 server_base.cc:1034] running on GCE node
I20260808 15:47:33.038404 19430 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:47:33.039212 19430 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:47:33.040447 19430 hybrid_clock.cc:648] HybridClock initialized: now 1786204053040428 us; error 34 us; skew 500 ppm
Aug 08 15:47:33 dist-test-slave-8tdl krb5kdc[19036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204053, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:47:33.043430 19430 init.cc:377] Logged in from keytab as kudu/127.8.39.67@KRBTEST.COM (short username kudu)
I20260808 15:47:33.044364 19430 webserver.cc:460] Webserver started at http://127.8.39.67:44771/ using document root <none> and password file <none>
I20260808 15:47:33.045089 19430 fs_manager.cc:359] Metadata directory not provided
I20260808 15:47:33.045189 19430 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:47:33.045457 19430 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:47:33.047665 19430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/data/instance:
uuid: "940bca702742432b879c213ce5aaf605"
format_stamp: "Formatted at 2026-08-08 15:47:33 on dist-test-slave-8tdl"
server_key: "52a54afd2fc3cf0da11c0b3165bfd191"
server_key_iv: "50c7153f017ba61ddee2e408826c9546"
server_key_version: "encryptionkey@0"
I20260808 15:47:33.048197 19430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance:
uuid: "940bca702742432b879c213ce5aaf605"
format_stamp: "Formatted at 2026-08-08 15:47:33 on dist-test-slave-8tdl"
server_key: "52a54afd2fc3cf0da11c0b3165bfd191"
server_key_iv: "50c7153f017ba61ddee2e408826c9546"
server_key_version: "encryptionkey@0"
I20260808 15:47:33.052083 19430 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 15:47:33.054538 19447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:33.056061 19430 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:47:33.056259 19430 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "940bca702742432b879c213ce5aaf605"
format_stamp: "Formatted at 2026-08-08 15:47:33 on dist-test-slave-8tdl"
server_key: "52a54afd2fc3cf0da11c0b3165bfd191"
server_key_iv: "50c7153f017ba61ddee2e408826c9546"
server_key_version: "encryptionkey@0"
I20260808 15:47:33.056381 19430 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:47:33.067106 19430 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:47:33.070595 19430 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:47:33.070878 19430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:47:33.071535 19430 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:47:33.072424 19430 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:47:33.072477 19430 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:33.072548 19430 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:47:33.072585 19430 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:47:33.082722 19430 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:33363
I20260808 15:47:33.082753 19563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:33363 every 8 connection(s)
I20260808 15:47:33.083808 19430 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:47:33.090794 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 19430
I20260808 15:47:33.090981 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance
I20260808 15:47:33.091387 8349 external_mini_cluster.cc:1428] Setting key 788f60d705e9e5278b36211b4f95fbbb
Aug 08 15:47:33 dist-test-slave-8tdl krb5kdc[19036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204053, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:47:33.097667 19127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:33.085685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:41411 (local address 127.8.39.126:39795)
0808 15:47:33.085821 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:33.085825 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:33.086695 (+ 870us) server_negotiation.cc:407] Connection header received
0808 15:47:33.088054 (+ 1359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:33.088058 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:33.088121 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:33.088219 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:33.089337 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.089880 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.091176 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.091458 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.091583 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:33.094456 (+ 2873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:33.094459 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:33.094461 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:33.094486 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:33.095844 (+ 1358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:33.096286 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:33.096288 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:33.096289 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:33.096362 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:33.096647 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:33.096649 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:33.096650 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:33.096807 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:33.096879 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:33.097417 (+ 538us) server_negotiation.cc:299] Negotiation successful
0808 15:47:33.097539 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 15:47:33.098408 19566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:33.086057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:39795 (local address 127.8.39.67:41411)
0808 15:47:33.086521 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:33.086565 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:33.087811 (+ 1246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:33.088386 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:33.088392 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:33.088734 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:47:33.089190 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:33.089202 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.090012 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.090017 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:33.090990 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:33.091001 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.091626 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.091631 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:33.091809 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:33.092500 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:47:33.092515 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:47:33.094300 (+ 1785us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:47:33.095947 (+ 1647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:33.095952 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:33.095962 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:33.096203 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:33.096442 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:47:33.096444 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:47:33.096445 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:47:33.096571 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:47:33.096910 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:47:33.096915 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:47:33.097131 (+ 216us) client_negotiation.cc:769] Sending connection context
0808 15:47:33.097282 (+ 151us) client_negotiation.cc:240] Negotiation successful
0808 15:47:33.097527 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":114,"threads_started":1}
I20260808 15:47:33.099632 19564 heartbeater.cc:347] Connected to a master server at 127.8.39.126:39795
I20260808 15:47:33.099984 19564 heartbeater.cc:464] Registering TS with master...
I20260808 15:47:33.100485 19564 heartbeater.cc:511] Master 127.8.39.126:39795 requested a full tablet report, sending...
I20260808 15:47:33.101495 19085 ts_manager.cc:194] Registered new tserver with Master: 940bca702742432b879c213ce5aaf605 (127.8.39.67:33363)
I20260808 15:47:33.102109 19085 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.67@KRBTEST.COM'} at 127.8.39.67:41411
I20260808 15:47:33.105379 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:47:33.114868 19127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:33.107405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50328 (local address 127.8.39.126:39795)
0808 15:47:33.107524 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:33.107527 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:33.107684 (+ 157us) server_negotiation.cc:407] Connection header received
0808 15:47:33.107785 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:33.107787 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:33.107822 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:33.107886 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:47:33.108587 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.109101 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.110160 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.110374 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.110454 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:33.111867 (+ 1413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:47:33.111870 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:47:33.111872 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:47:33.111893 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:47:33.113170 (+ 1277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:33.113596 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:33.113599 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:33.113600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:33.113682 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:47:33.114036 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:47:33.114038 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:47:33.114040 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:47:33.114258 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:47:33.114368 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:33.114569 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 15:47:33.114663 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 15:47:33.117869 19085 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50328:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:47:33.121176 19085 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:47:33.136277 19577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:33.129789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57860 (local address 127.8.39.65:39403)
0808 15:47:33.130645 (+ 856us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:33.130662 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:33.130708 (+ 46us) server_negotiation.cc:407] Connection header received
0808 15:47:33.131006 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:33.131013 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:33.131224 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:33.131386 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:47:33.131712 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.132983 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.134732 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.135533 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.135849 (+ 316us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:33.135996 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:33.136050 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 15:47:33.136139 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":744,"thread_start_us":153,"threads_started":1}
I20260808 15:47:33.136267 19575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:33.129645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:39403 (local address 127.0.0.1:57860)
0808 15:47:33.129984 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:33.130031 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:33.130834 (+ 803us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:33.131381 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:33.131387 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:33.131409 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:47:33.131569 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:33.131581 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.133117 (+ 1536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.133120 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:33.134582 (+ 1462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:33.134593 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.135679 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.135683 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:33.135797 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:33.135914 (+ 117us) client_negotiation.cc:769] Sending connection context
0808 15:47:33.135986 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 15:47:33.136105 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":182,"thread_start_us":109,"threads_started":1}
I20260808 15:47:33.136309 19581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:33.130826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58680 (local address 127.8.39.66:40769)
0808 15:47:33.131178 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:33.131190 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:33.131212 (+ 22us) server_negotiation.cc:407] Connection header received
0808 15:47:33.131305 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:33.131327 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:33.131526 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:33.131682 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:47:33.131961 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.133352 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.134516 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.135414 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.135532 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:33.135709 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:33.136073 (+ 364us) server_negotiation.cc:299] Negotiation successful
0808 15:47:33.136174 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":137,"threads_started":1}
I20260808 15:47:33.136271 19578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:33.129944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:33363 (local address 127.0.0.1:45852)
0808 15:47:33.130225 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:33.130241 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:33.130368 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:33.131754 (+ 1386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:33.131757 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:33.131769 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:47:33.131856 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:33.131860 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.133001 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.133007 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:33.134582 (+ 1575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:33.134593 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.135566 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.135569 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:33.135684 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:33.135800 (+ 116us) client_negotiation.cc:769] Sending connection context
0808 15:47:33.135913 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 15:47:33.136092 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":191,"thread_start_us":127,"threads_started":1}
I20260808 15:47:33.136718 19579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:33.130370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:40769 (local address 127.0.0.1:58680)
0808 15:47:33.131090 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:33.131105 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:33.131186 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:33.131679 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:33.131685 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:33.131709 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:47:33.131845 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:33.131852 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.133510 (+ 1658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.133515 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:33.134384 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:33.134393 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.135736 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.135743 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:33.135896 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:33.135916 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 15:47:33.135999 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 15:47:33.136503 (+ 504us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":656,"mutex_wait_us":464,"thread_start_us":100,"threads_started":1}
I20260808 15:47:33.137308 19580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:33.130445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45852 (local address 127.8.39.67:33363)
0808 15:47:33.131299 (+ 854us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:33.131313 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:33.131337 (+ 24us) server_negotiation.cc:407] Connection header received
0808 15:47:33.131408 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:33.131412 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:33.131580 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:33.132032 (+ 452us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:47:33.132160 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.132863 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.134775 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.135427 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.135569 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:33.135719 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:33.137101 (+ 1382us) server_negotiation.cc:299] Negotiation successful
0808 15:47:33.137197 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":746,"thread_start_us":113,"threads_started":1}
I20260808 15:47:33.139678 19497 tablet_service.cc:1467] Processing CreateTablet for tablet c9364844d99e418196ee2f4a218b3d76 (DEFAULT_TABLE table=test-table [id=4c266e99b30240b1af26d66f75a25f19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:47:33.139740 19217 tablet_service.cc:1467] Processing CreateTablet for tablet c9364844d99e418196ee2f4a218b3d76 (DEFAULT_TABLE table=test-table [id=4c266e99b30240b1af26d66f75a25f19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:47:33.139742 19357 tablet_service.cc:1467] Processing CreateTablet for tablet c9364844d99e418196ee2f4a218b3d76 (DEFAULT_TABLE table=test-table [id=4c266e99b30240b1af26d66f75a25f19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:47:33.140772 19357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9364844d99e418196ee2f4a218b3d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:33.140771 19217 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9364844d99e418196ee2f4a218b3d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:33.140789 19497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9364844d99e418196ee2f4a218b3d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:47:33.147380 19582 tablet_bootstrap.cc:492] T c9364844d99e418196ee2f4a218b3d76 P 940bca702742432b879c213ce5aaf605: Bootstrap starting.
I20260808 15:47:33.148042 19583 tablet_bootstrap.cc:492] T c9364844d99e418196ee2f4a218b3d76 P ce63e1e8dac6443a86792ee94d91ac65: Bootstrap starting.
I20260808 15:47:33.148463 19584 tablet_bootstrap.cc:492] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07: Bootstrap starting.
I20260808 15:47:33.150333 19583 tablet_bootstrap.cc:654] T c9364844d99e418196ee2f4a218b3d76 P ce63e1e8dac6443a86792ee94d91ac65: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:33.150660 19584 tablet_bootstrap.cc:654] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:33.150853 19582 tablet_bootstrap.cc:654] T c9364844d99e418196ee2f4a218b3d76 P 940bca702742432b879c213ce5aaf605: Neither blocks nor log segments found. Creating new log.
I20260808 15:47:33.151345 19583 log.cc:824] T c9364844d99e418196ee2f4a218b3d76 P ce63e1e8dac6443a86792ee94d91ac65: Log is configured to *not* fsync() on all Append() calls
I20260808 15:47:33.151556 19584 log.cc:824] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07: Log is configured to *not* fsync() on all Append() calls
I20260808 15:47:33.151721 19582 log.cc:824] T c9364844d99e418196ee2f4a218b3d76 P 940bca702742432b879c213ce5aaf605: Log is configured to *not* fsync() on all Append() calls
I20260808 15:47:33.153358 19584 tablet_bootstrap.cc:492] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07: No bootstrap required, opened a new log
I20260808 15:47:33.153509 19583 tablet_bootstrap.cc:492] T c9364844d99e418196ee2f4a218b3d76 P ce63e1e8dac6443a86792ee94d91ac65: No bootstrap required, opened a new log
I20260808 15:47:33.153510 19582 tablet_bootstrap.cc:492] T c9364844d99e418196ee2f4a218b3d76 P 940bca702742432b879c213ce5aaf605: No bootstrap required, opened a new log
I20260808 15:47:33.153600 19584 ts_tablet_manager.cc:1397] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 15:47:33.153692 19583 ts_tablet_manager.cc:1397] T c9364844d99e418196ee2f4a218b3d76 P ce63e1e8dac6443a86792ee94d91ac65: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260808 15:47:33.153692 19582 ts_tablet_manager.cc:1397] T c9364844d99e418196ee2f4a218b3d76 P 940bca702742432b879c213ce5aaf605: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 15:47:33.156590 19584 raft_consensus.cc:348] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce63e1e8dac6443a86792ee94d91ac65" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39403 } } peers { permanent_uuid: "26d43a950b8044d48920bb5674ebea07" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40769 } } peers { permanent_uuid: "940bca702742432b879c213ce5aaf605" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 33363 } }
I20260808 15:47:33.156831 19584 raft_consensus.cc:374] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:33.156906 19584 raft_consensus.cc:729] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26d43a950b8044d48920bb5674ebea07, State: Initialized, Role: FOLLOWER
I20260808 15:47:33.157377 19584 consensus_queue.cc:260] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce63e1e8dac6443a86792ee94d91ac65" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39403 } } peers { permanent_uuid: "26d43a950b8044d48920bb5674ebea07" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40769 } } peers { permanent_uuid: "940bca702742432b879c213ce5aaf605" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 33363 } }
I20260808 15:47:33.157653 19582 raft_consensus.cc:348] T c9364844d99e418196ee2f4a218b3d76 P 940bca702742432b879c213ce5aaf605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce63e1e8dac6443a86792ee94d91ac65" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39403 } } peers { permanent_uuid: "26d43a950b8044d48920bb5674ebea07" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40769 } } peers { permanent_uuid: "940bca702742432b879c213ce5aaf605" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 33363 } }
I20260808 15:47:33.157917 19582 raft_consensus.cc:374] T c9364844d99e418196ee2f4a218b3d76 P 940bca702742432b879c213ce5aaf605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:33.158006 19582 raft_consensus.cc:729] T c9364844d99e418196ee2f4a218b3d76 P 940bca702742432b879c213ce5aaf605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 940bca702742432b879c213ce5aaf605, State: Initialized, Role: FOLLOWER
I20260808 15:47:33.158046 19583 raft_consensus.cc:348] T c9364844d99e418196ee2f4a218b3d76 P ce63e1e8dac6443a86792ee94d91ac65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce63e1e8dac6443a86792ee94d91ac65" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39403 } } peers { permanent_uuid: "26d43a950b8044d48920bb5674ebea07" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40769 } } peers { permanent_uuid: "940bca702742432b879c213ce5aaf605" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 33363 } }
I20260808 15:47:33.158298 19583 raft_consensus.cc:374] T c9364844d99e418196ee2f4a218b3d76 P ce63e1e8dac6443a86792ee94d91ac65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:47:33.158393 19583 raft_consensus.cc:729] T c9364844d99e418196ee2f4a218b3d76 P ce63e1e8dac6443a86792ee94d91ac65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce63e1e8dac6443a86792ee94d91ac65, State: Initialized, Role: FOLLOWER
I20260808 15:47:33.158465 19584 ts_tablet_manager.cc:1428] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 15:47:33.158492 19582 consensus_queue.cc:260] T c9364844d99e418196ee2f4a218b3d76 P 940bca702742432b879c213ce5aaf605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce63e1e8dac6443a86792ee94d91ac65" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39403 } } peers { permanent_uuid: "26d43a950b8044d48920bb5674ebea07" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40769 } } peers { permanent_uuid: "940bca702742432b879c213ce5aaf605" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 33363 } }
I20260808 15:47:33.158810 19424 heartbeater.cc:503] Master 127.8.39.126:39795 was elected leader, sending a full tablet report...
I20260808 15:47:33.158953 19583 consensus_queue.cc:260] T c9364844d99e418196ee2f4a218b3d76 P ce63e1e8dac6443a86792ee94d91ac65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce63e1e8dac6443a86792ee94d91ac65" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39403 } } peers { permanent_uuid: "26d43a950b8044d48920bb5674ebea07" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40769 } } peers { permanent_uuid: "940bca702742432b879c213ce5aaf605" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 33363 } }
I20260808 15:47:33.159540 19582 ts_tablet_manager.cc:1428] T c9364844d99e418196ee2f4a218b3d76 P 940bca702742432b879c213ce5aaf605: Time spent starting tablet: real 0.006s user 0.001s sys 0.005s
I20260808 15:47:33.159614 19285 heartbeater.cc:503] Master 127.8.39.126:39795 was elected leader, sending a full tablet report...
I20260808 15:47:33.159850 19583 ts_tablet_manager.cc:1428] T c9364844d99e418196ee2f4a218b3d76 P ce63e1e8dac6443a86792ee94d91ac65: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 15:47:33.159897 19564 heartbeater.cc:503] Master 127.8.39.126:39795 was elected leader, sending a full tablet report...
W20260808 15:47:33.334939 19565 tablet.cc:2369] T c9364844d99e418196ee2f4a218b3d76 P 940bca702742432b879c213ce5aaf605: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:47:33.368888 19286 tablet.cc:2369] T c9364844d99e418196ee2f4a218b3d76 P ce63e1e8dac6443a86792ee94d91ac65: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:47:33.370217 19426 tablet.cc:2369] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:47:33.417253 19588 raft_consensus.cc:482] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:47:33.417541 19588 raft_consensus.cc:504] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce63e1e8dac6443a86792ee94d91ac65" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39403 } } peers { permanent_uuid: "26d43a950b8044d48920bb5674ebea07" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40769 } } peers { permanent_uuid: "940bca702742432b879c213ce5aaf605" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 33363 } }
I20260808 15:47:33.418797 19588 leader_election.cc:288] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce63e1e8dac6443a86792ee94d91ac65 (127.8.39.65:39403), 940bca702742432b879c213ce5aaf605 (127.8.39.67:33363)
I20260808 15:47:33.423103 19580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:33.419202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:40089 (local address 127.8.39.67:33363)
0808 15:47:33.419342 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:33.419347 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:33.419612 (+ 265us) server_negotiation.cc:407] Connection header received
0808 15:47:33.419838 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:33.419843 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:33.419900 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:33.419956 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:47:33.420351 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.420921 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.422042 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.422478 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.422562 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:33.422654 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:33.422872 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 15:47:33.422968 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 15:47:33.423116 19577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:33.419258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:58757 (local address 127.8.39.65:39403)
0808 15:47:33.419398 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:33.419403 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:33.419735 (+ 332us) server_negotiation.cc:407] Connection header received
0808 15:47:33.419904 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:33.419907 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:33.419955 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:33.419995 (+ 40us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:47:33.420464 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.421067 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.422118 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.422514 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.422637 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:33.422727 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:33.422941 (+ 214us) server_negotiation.cc:299] Negotiation successful
0808 15:47:33.423014 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 15:47:33.423116 19592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:33.419081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:39403 (local address 127.8.39.66:58757)
0808 15:47:33.419620 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:33.419636 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:33.419750 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:33.420156 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:33.420159 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:33.420182 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:47:33.420310 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:33.420316 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.421178 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.421181 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:33.421987 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:33.422001 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.422657 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.422663 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:33.422785 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:33.422803 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 15:47:33.422906 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 15:47:33.422973 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"mutex_wait_us":242,"thread_start_us":83,"threads_started":1}
I20260808 15:47:33.423123 19591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:33.419080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:33363 (local address 127.8.39.66:40089)
0808 15:47:33.419503 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:33.419520 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:47:33.419661 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:47:33.420108 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:47:33.420111 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:47:33.420134 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:47:33.420236 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:33.420241 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.421026 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.421030 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:33.421881 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:47:33.421890 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.422601 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.422608 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:47:33.422727 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:33.422758 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 15:47:33.422830 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 15:47:33.422915 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":107,"threads_started":1}
I20260808 15:47:33.423702 19237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9364844d99e418196ee2f4a218b3d76" candidate_uuid: "26d43a950b8044d48920bb5674ebea07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce63e1e8dac6443a86792ee94d91ac65" is_pre_election: true
I20260808 15:47:33.423964 19517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9364844d99e418196ee2f4a218b3d76" candidate_uuid: "26d43a950b8044d48920bb5674ebea07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "940bca702742432b879c213ce5aaf605" is_pre_election: true
I20260808 15:47:33.424016 19237 raft_consensus.cc:2454] T c9364844d99e418196ee2f4a218b3d76 P ce63e1e8dac6443a86792ee94d91ac65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26d43a950b8044d48920bb5674ebea07 in term 0.
I20260808 15:47:33.424249 19517 raft_consensus.cc:2454] T c9364844d99e418196ee2f4a218b3d76 P 940bca702742432b879c213ce5aaf605 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26d43a950b8044d48920bb5674ebea07 in term 0.
I20260808 15:47:33.424540 19310 leader_election.cc:302] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26d43a950b8044d48920bb5674ebea07, ce63e1e8dac6443a86792ee94d91ac65; no voters:
I20260808 15:47:33.424839 19588 raft_consensus.cc:2781] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:47:33.424925 19588 raft_consensus.cc:482] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:47:33.424968 19588 raft_consensus.cc:3037] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:33.426014 19588 raft_consensus.cc:504] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce63e1e8dac6443a86792ee94d91ac65" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39403 } } peers { permanent_uuid: "26d43a950b8044d48920bb5674ebea07" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40769 } } peers { permanent_uuid: "940bca702742432b879c213ce5aaf605" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 33363 } }
I20260808 15:47:33.426364 19588 leader_election.cc:288] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07 [CANDIDATE]: Term 1 election: Requested vote from peers ce63e1e8dac6443a86792ee94d91ac65 (127.8.39.65:39403), 940bca702742432b879c213ce5aaf605 (127.8.39.67:33363)
I20260808 15:47:33.426661 19237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9364844d99e418196ee2f4a218b3d76" candidate_uuid: "26d43a950b8044d48920bb5674ebea07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce63e1e8dac6443a86792ee94d91ac65"
I20260808 15:47:33.426787 19517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9364844d99e418196ee2f4a218b3d76" candidate_uuid: "26d43a950b8044d48920bb5674ebea07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "940bca702742432b879c213ce5aaf605"
I20260808 15:47:33.426832 19237 raft_consensus.cc:3037] T c9364844d99e418196ee2f4a218b3d76 P ce63e1e8dac6443a86792ee94d91ac65 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:33.426967 19517 raft_consensus.cc:3037] T c9364844d99e418196ee2f4a218b3d76 P 940bca702742432b879c213ce5aaf605 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:47:33.427985 19237 raft_consensus.cc:2454] T c9364844d99e418196ee2f4a218b3d76 P ce63e1e8dac6443a86792ee94d91ac65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26d43a950b8044d48920bb5674ebea07 in term 1.
I20260808 15:47:33.428067 19517 raft_consensus.cc:2454] T c9364844d99e418196ee2f4a218b3d76 P 940bca702742432b879c213ce5aaf605 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26d43a950b8044d48920bb5674ebea07 in term 1.
I20260808 15:47:33.428275 19310 leader_election.cc:302] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26d43a950b8044d48920bb5674ebea07, ce63e1e8dac6443a86792ee94d91ac65; no voters:
I20260808 15:47:33.428462 19588 raft_consensus.cc:2781] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:47:33.428715 19588 raft_consensus.cc:686] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07 [term 1 LEADER]: Becoming Leader. State: Replica: 26d43a950b8044d48920bb5674ebea07, State: Running, Role: LEADER
I20260808 15:47:33.429067 19588 consensus_queue.cc:237] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce63e1e8dac6443a86792ee94d91ac65" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39403 } } peers { permanent_uuid: "26d43a950b8044d48920bb5674ebea07" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40769 } } peers { permanent_uuid: "940bca702742432b879c213ce5aaf605" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 33363 } }
I20260808 15:47:33.432291 19084 catalog_manager.cc:5495] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26d43a950b8044d48920bb5674ebea07 (127.8.39.66). New cstate: current_term: 1 leader_uuid: "26d43a950b8044d48920bb5674ebea07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce63e1e8dac6443a86792ee94d91ac65" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26d43a950b8044d48920bb5674ebea07" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "940bca702742432b879c213ce5aaf605" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 33363 } health_report { overall_health: UNKNOWN } } }
I20260808 15:47:33.499959 19581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:33.496025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58694 (local address 127.8.39.66:40769)
0808 15:47:33.496164 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 15:47:33.496168 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:47:33.496183 (+ 15us) server_negotiation.cc:407] Connection header received
0808 15:47:33.496272 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:47:33.496275 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:47:33.496330 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:47:33.496414 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:47:33.496652 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.497176 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.498133 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:47:33.498348 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:47:33.498438 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:47:33.498789 (+ 351us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:47:33.499262 (+ 473us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:47:33.499365 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 15:47:33.499635 (+ 270us) server_negotiation.cc:299] Negotiation successful
0808 15:47:33.499691 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 15:47:33.506434 19237 raft_consensus.cc:1261] T c9364844d99e418196ee2f4a218b3d76 P ce63e1e8dac6443a86792ee94d91ac65 [term 1 FOLLOWER]: Refusing update from remote peer 26d43a950b8044d48920bb5674ebea07: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:47:33.506448 19517 raft_consensus.cc:1261] T c9364844d99e418196ee2f4a218b3d76 P 940bca702742432b879c213ce5aaf605 [term 1 FOLLOWER]: Refusing update from remote peer 26d43a950b8044d48920bb5674ebea07: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:47:33.507306 19593 consensus_queue.cc:1035] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce63e1e8dac6443a86792ee94d91ac65" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:47:33.507495 19588 consensus_queue.cc:1035] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "940bca702742432b879c213ce5aaf605" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:47:33.514729 19596 mvcc.cc:205] Tried to move back new op lower bound from 7316291803154206720 to 7316291802848350208. Current Snapshot: MvccSnapshot[applied={T|T < 7316291803154206720}]
I20260808 15:47:33.517553 19597 mvcc.cc:205] Tried to move back new op lower bound from 7316291803154206720 to 7316291802848350208. Current Snapshot: MvccSnapshot[applied={T|T < 7316291803154206720 or (T in {7316291803154206720})}]
I20260808 15:47:33.517758 19598 mvcc.cc:205] Tried to move back new op lower bound from 7316291803154206720 to 7316291802848350208. Current Snapshot: MvccSnapshot[applied={T|T < 7316291803154206720}]
I20260808 15:47:33.524749 19084 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50328:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:47:33.524955 19084 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50328:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:47:33.527684 19084 catalog_manager.cc:5782] T 00000000000000000000000000000000 P af59b9943daa44aa8871cf842979d2b5: Sending DeleteTablet for 3 replicas of tablet c9364844d99e418196ee2f4a218b3d76
I20260808 15:47:33.528541 19357 tablet_service.cc:1514] Processing DeleteTablet for tablet c9364844d99e418196ee2f4a218b3d76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:47:33 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:58680
I20260808 15:47:33.528587 19497 tablet_service.cc:1514] Processing DeleteTablet for tablet c9364844d99e418196ee2f4a218b3d76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:47:33 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:45852
I20260808 15:47:33.529277 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 19151
I20260808 15:47:33.529271 19217 tablet_service.cc:1514] Processing DeleteTablet for tablet c9364844d99e418196ee2f4a218b3d76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:47:33 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:57860
I20260808 15:47:33.529399 19605 tablet_replica.cc:330] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07: stopping tablet replica
I20260808 15:47:33.529717 19605 raft_consensus.cc:2229] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:47:33.530076 19605 raft_consensus.cc:2258] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:47:33.531800 19605 ts_tablet_manager.cc:1905] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:47:33.534852 19605 ts_tablet_manager.cc:1918] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:47:33.534978 19605 log.cc:1196] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-1/wal/wals/c9364844d99e418196ee2f4a218b3d76
I20260808 15:47:33.535355 19605 ts_tablet_manager.cc:1939] T c9364844d99e418196ee2f4a218b3d76 P 26d43a950b8044d48920bb5674ebea07: Deleting consensus metadata
I20260808 15:47:33.536898 19071 catalog_manager.cc:4841] TS 26d43a950b8044d48920bb5674ebea07 (127.8.39.66:40769): tablet c9364844d99e418196ee2f4a218b3d76 (table test-table [id=4c266e99b30240b1af26d66f75a25f19]) successfully deleted
W20260808 15:47:33.538640 19071 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.39.65:39403 (error 108)
I20260808 15:47:33.539043 19606 tablet_replica.cc:330] T c9364844d99e418196ee2f4a218b3d76 P 940bca702742432b879c213ce5aaf605: stopping tablet replica
I20260808 15:47:33.539441 19606 raft_consensus.cc:2229] T c9364844d99e418196ee2f4a218b3d76 P 940bca702742432b879c213ce5aaf605 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:47:33.539799 19606 raft_consensus.cc:2258] T c9364844d99e418196ee2f4a218b3d76 P 940bca702742432b879c213ce5aaf605 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:47:33.539913 19579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:47:33.539563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:39403 (local address 127.0.0.1:57866)
0808 15:47:33.539745 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 15:47:33.539818 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.65:39403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
W20260808 15:47:33.540091 19071 catalog_manager.cc:4584] TS ce63e1e8dac6443a86792ee94d91ac65 (127.8.39.65:39403): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c9364844d99e418196ee2f4a218b3d76: Network error: Client connection negotiation failed: client connection to 127.8.39.65:39403: connect: Connection refused (error 111)
I20260808 15:47:33.540177 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 19291
I20260808 15:47:33.543174 19606 ts_tablet_manager.cc:1905] T c9364844d99e418196ee2f4a218b3d76 P 940bca702742432b879c213ce5aaf605: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:47:33.545893 19606 ts_tablet_manager.cc:1918] T c9364844d99e418196ee2f4a218b3d76 P 940bca702742432b879c213ce5aaf605: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:47:33.545980 19606 log.cc:1196] T c9364844d99e418196ee2f4a218b3d76 P 940bca702742432b879c213ce5aaf605: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/c9364844d99e418196ee2f4a218b3d76
I20260808 15:47:33.546295 19606 ts_tablet_manager.cc:1939] T c9364844d99e418196ee2f4a218b3d76 P 940bca702742432b879c213ce5aaf605: Deleting consensus metadata
I20260808 15:47:33.547901 19068 catalog_manager.cc:4841] TS 940bca702742432b879c213ce5aaf605 (127.8.39.67:33363): tablet c9364844d99e418196ee2f4a218b3d76 (table test-table [id=4c266e99b30240b1af26d66f75a25f19]) successfully deleted
I20260808 15:47:33.550019 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 19430
I20260808 15:47:33.557843 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 19050
2026-08-08T15:47:33Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2738 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:47:33 dist-test-slave-8tdl krb5kdc[19610](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:47:33 dist-test-slave-8tdl krb5kdc[19610](info): set up 2 sockets
Aug 08 15:47:33 dist-test-slave-8tdl krb5kdc[19610](info): commencing operation
krb5kdc: starting...
W20260808 15:47:34.669149 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.086s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:47:34 dist-test-slave-8tdl krb5kdc[19610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:47:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:47:34Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.8.39.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.8.39.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.8.39.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/rangeradmin_127.8.39.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.8.39.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/rangeradmin_127.8.39.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.8.39.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.8.39.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.8.39.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/rangerlookup_127.8.39.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.8.39.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/rangerlookup_127.8.39.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.8.39.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.8.39.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.8.39.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/HTTP_127.8.39.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.8.39.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/HTTP_127.8.39.84@KRBTEST.COM.keytab.
I20260808 15:47:34.866617 8349 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskCGl7YH/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/postgres -l logfile start
2026-08-08 15:47:37.610 UTC [19641] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 15:47:37.610 UTC [19641] LOG: listening on IPv4 address "127.8.39.84", port 39227
2026-08-08 15:47:37.614 UTC [19641] LOG: listening on Unix socket "/tmp/.s.PGSQL.39227"
2026-08-08 15:47:37.651 UTC [19644] LOG: database system was shut down at 2026-08-08 15:47:36 UTC
2026-08-08 15:47:37.656 UTC [19641] LOG: database system is ready to accept connections
I20260808 15:47:38.645601 8349 mini_postgres.cc:96] Postgres bound to 39227
2026-08-08 15:47:38.654 UTC [19653] FATAL: database "slave" does not exist
127.8.39.84:39227 - accepting connections
I20260808 15:47:38.655365 8349 mini_ranger.cc:161] Starting Ranger...
I20260808 15:47:38.674420 8349 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 15:47:39.207628 8349 mini_ranger.cc:87] Created ranger Postgres database
I20260808 15:47:39.207716 8349 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ranger-admin
2026-08-08 15:47:39,545 [I] DB FLAVOR :POSTGRES
2026-08-08 15:47:39,546 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 15:47:39,546 [I] Checking connection..
2026-08-08 15:47:39,546 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:39227/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 15:47:39,829 [I] Checking connection passed.
2026-08-08 15:47:39,829 [I] --------- Verifying version history table ---------
2026-08-08 15:47:39,830 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:39227/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 15:47:40,106 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 15:47:40,106 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:39227/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 15:47:40,350 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 15:47:40,350 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 15:47:40,351 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:39227/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 15:47:40.626 UTC [19721] WARNING: there is no transaction in progress
2026-08-08 15:47:40,634 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 15:47:40,634 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:39227/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 15:47:40,917 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 15:47:40,917 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 15:47:40,918 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:39227/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 15:47:41,215 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:39227/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 15:47:41,480 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:39227/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-8tdl.c.gcp-upstream.internal','N') ;"
2026-08-08 15:47:41,748 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:39227/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 15:47:42,006 [I] Table x_portal_user does not exist in database ranger
2026-08-08 15:47:42,006 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:39227/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 15:47:42,262 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 15:47:42,262 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:39227/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 15:47:42,519 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:39227/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 15:47:42,779 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 15:47:42,779 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:39227/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 15:47:43.813 UTC [19835] WARNING: there is no transaction in progress
2026-08-08 15:47:43.832 UTC [19835] WARNING: there is no transaction in progress
2026-08-08 15:47:43.850 UTC [19835] WARNING: there is no transaction in progress
2026-08-08 15:47:43.867 UTC [19835] WARNING: there is no transaction in progress
2026-08-08 15:47:43.885 UTC [19835] WARNING: there is no transaction in progress
2026-08-08 15:47:43.905 UTC [19835] WARNING: there is no transaction in progress
2026-08-08 15:47:43.974 UTC [19835] WARNING: there is no transaction in progress
2026-08-08 15:47:43.981 UTC [19835] WARNING: there is no transaction in progress
2026-08-08 15:47:43.997 UTC [19835] WARNING: there is no transaction in progress
2026-08-08 15:47:44.008 UTC [19835] WARNING: there is no transaction in progress
2026-08-08 15:47:44.019 UTC [19835] WARNING: there is no transaction in progress
2026-08-08 15:47:44.034 UTC [19835] WARNING: there is no transaction in progress
2026-08-08 15:47:44.044 UTC [19835] WARNING: there is no transaction in progress
2026-08-08 15:47:44.051 UTC [19835] WARNING: there is no transaction in progress
2026-08-08 15:47:44.058 UTC [19835] WARNING: there is no transaction in progress
2026-08-08 15:47:44.065 UTC [19835] WARNING: there is no transaction in progress
2026-08-08 15:47:44,770 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 15:47:44,771 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:39227/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 15:47:45,016 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 15:47:45,017 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:39227/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 15:47:45,288 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 15:47:45,288 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:39227/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 15:47:45,570 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 15:47:45,570 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:39227/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 15:47:45,835 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:39227/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 15:47:46,107 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:39227/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-8tdl.c.gcp-upstream.internal';"
2026-08-08 15:47:46,376 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 15:47:46,377 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:39227/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 15:47:46,662 [I] DB_PATCHES have already been applied
I20260808 15:47:46.668951 8349 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ranger-admin:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskCGl7YH/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 15:47:46.669065 8349 mini_ranger.cc:193] Using host: 127.8.39.84
I20260808 15:47:46.674252 8349 mini_ranger.cc:227] Ranger admin URL: http://127.8.39.84:53177
Aug 08, 2026 3:47:46 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 3:47:46 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 3:47:47 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 3:47:47 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 3:47:47 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 3:47:47 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 3:47:47 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 15:47:47.853554 8349 mini_ranger.cc:160] Time spent starting Ranger: real 9.198s user 0.003s sys 0.011s
Aug 08, 2026 3:48:10 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 3:48:10 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 08, 2026 3:48:10 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 3:48:10 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 3:48:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 3:48:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 3:48:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 3:48:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 3:48:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 3:48:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 3:48:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 3:48:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 3:48:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 3:48:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 3:48:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 3:48:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 3:48:10 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 3:48:11 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 15:48:11.652654 8349 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.8.39.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.8.39.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.8.39.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/rangerkms_127.8.39.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.8.39.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/rangerkms_127.8.39.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.8.39.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.8.39.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.8.39.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/HTTP_127.8.39.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.8.39.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/HTTP_127.8.39.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 15:48:11 dist-test-slave-8tdl krb5kdc[19610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204091, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 15:48:11.759720 8349 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 15:48:11.771629 8349 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 15:48:12.667033 8349 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 15:48:12.667122 8349 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ranger-kms
I20260808 15:48:12.667228 8349 mini_ranger_kms.cc:227] Using postgres at 127.8.39.84:39227
2026-08-08 15:48:12,946 [I] DB FLAVOR :POSTGRES
2026-08-08 15:48:12,946 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 15:48:12,946 [I] Checking connection
2026-08-08 15:48:12,946 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:39227/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 15:48:13,187 [I] connection success
2026-08-08 15:48:13,187 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 15:48:13,187 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 15:48:13,187 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:39227/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 15:48:13,478 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 15:48:13,479 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 15:48:13,479 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 15:48:13,479 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:39227/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 15:48:13,785 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 15:48:14.303752 8349 mini_ranger_kms.cc:310] Created kms service
I20260808 15:48:14.507489 8349 mini_ranger_kms.cc:326] Created kudu user
I20260808 15:48:14.555722 8349 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 15:48:14 dist-test-slave-8tdl krb5kdc[19610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204091, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.8.39.84@KRBTEST.COM
I20260808 15:48:14.964366 8349 mini_ranger_kms.cc:384] Added ranger policy
I20260808 15:48:14.964536 8349 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ranger-kms:/tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 15:48:14.964567 8349 mini_ranger_kms.cc:240] Using host: 127.8.39.84
I20260808 15:48:14.969271 8349 mini_ranger_kms.cc:276] Ranger KMS PID: 20025
I20260808 15:48:14.969424 8349 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.8.39.84:36917
Aug 08, 2026 3:48:16 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 3:48:16 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 3:48:16 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 3:48:16 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 3:48:16 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 3:48:16 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260808 15:48:17.337716 8349 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.578s user 0.016s sys 0.246s
I20260808 15:48:17.337857 8349 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 15:48:17.337996 8349 mini_ranger_kms.cc:401] 127.8.39.84:36917/kms/v1/keys
Aug 08 15:48:17 dist-test-slave-8tdl krb5kdc[19610](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786204097, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.39.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 08 15:48:17 dist-test-slave-8tdl krb5kdc[19610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204097, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.39.84@KRBTEST.COM for HTTP/127.8.39.84@KRBTEST.COM
Aug 08 15:48:18 dist-test-slave-8tdl krb5kdc[19610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204097, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.39.84@KRBTEST.COM for HTTP/127.8.39.84@KRBTEST.COM
Aug 08 15:48:20 dist-test-slave-8tdl krb5kdc[19610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:48:20.666668 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:44083
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:33043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:44083
--ranger_config_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.39.84:36917/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:48:20.805717 20079 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:48:20.806054 20079 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:48:20.806130 20079 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:48:20.810307 20079 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:48:20.810544 20079 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:48:20.810642 20079 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:48:20.810701 20079 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:48:20.810741 20079 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:48:20.816699 20079 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:33043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/master-0/wal
--ranger_kms_url=127.8.39.84:36917/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:44083
--ranger_config_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:44083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20079
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:48:20.817844 20079 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:48:20.818931 20079 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:48:20.828341 20087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:48:20.828385 20084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:48:20.828364 20079 server_base.cc:1034] running on GCE node
W20260808 15:48:20.828310 20085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:48:20.829181 20079 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:48:20.830291 20079 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:48:20.831480 20079 hybrid_clock.cc:648] HybridClock initialized: now 1786204100831460 us; error 32 us; skew 500 ppm
Aug 08 15:48:20 dist-test-slave-8tdl krb5kdc[19610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204100, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:48:20.840824 20079 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:48:20.841914 20079 webserver.cc:460] Webserver started at http://127.8.39.126:33137/ using document root <none> and password file <none>
I20260808 15:48:20.842495 20079 fs_manager.cc:359] Metadata directory not provided
I20260808 15:48:20.842576 20079 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:48:20.842860 20079 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 15:48:20 dist-test-slave-8tdl krb5kdc[19610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204100, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for HTTP/127.8.39.84@KRBTEST.COM
I20260808 15:48:20.894466 20079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "3b79d01c44ab49de9dc9c54a22fd333e"
format_stamp: "Formatted at 2026-08-08 15:48:20 on dist-test-slave-8tdl"
server_key: "ec4d3a16ce12b77587c794d4fd1c68a9"
server_key_iv: "1754341dfc772bc6dfc77063e8f526c7"
server_key_version: "kuduclusterkey@0"
I20260808 15:48:20.895442 20079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "3b79d01c44ab49de9dc9c54a22fd333e"
format_stamp: "Formatted at 2026-08-08 15:48:20 on dist-test-slave-8tdl"
server_key: "ec4d3a16ce12b77587c794d4fd1c68a9"
server_key_iv: "1754341dfc772bc6dfc77063e8f526c7"
server_key_version: "kuduclusterkey@0"
I20260808 15:48:20.901098 20079 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 15:48:20.920325 20095 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:48:20.922174 20079 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 15:48:20.922363 20079 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "3b79d01c44ab49de9dc9c54a22fd333e"
format_stamp: "Formatted at 2026-08-08 15:48:20 on dist-test-slave-8tdl"
server_key: "ec4d3a16ce12b77587c794d4fd1c68a9"
server_key_iv: "1754341dfc772bc6dfc77063e8f526c7"
server_key_version: "kuduclusterkey@0"
I20260808 15:48:20.922526 20079 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:48:20.941128 20079 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:48:20.944698 20079 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:48:20.945012 20079 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:48:20.954336 20079 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:44083
I20260808 15:48:20.954365 20147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:44083 every 8 connection(s)
I20260808 15:48:20.955478 20079 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:48:20.957326 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 20079
I20260808 15:48:20.957497 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:48:20.957871 8349 external_mini_cluster.cc:1428] Setting key c667103ce4389d5fadedbefed7364283
I20260808 15:48:20.959038 20148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:48:20.965714 20148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b79d01c44ab49de9dc9c54a22fd333e: Bootstrap starting.
I20260808 15:48:20.968617 20148 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b79d01c44ab49de9dc9c54a22fd333e: Neither blocks nor log segments found. Creating new log.
I20260808 15:48:20.969877 20148 log.cc:824] T 00000000000000000000000000000000 P 3b79d01c44ab49de9dc9c54a22fd333e: Log is configured to *not* fsync() on all Append() calls
Aug 08 15:48:20 dist-test-slave-8tdl krb5kdc[19610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:48:20.972529 20148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b79d01c44ab49de9dc9c54a22fd333e: No bootstrap required, opened a new log
I20260808 15:48:20.976416 20151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:48:20.959400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43330 (local address 127.8.39.126:44083)
0808 15:48:20.959929 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0808 15:48:20.959950 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 15:48:20.960163 (+ 213us) server_negotiation.cc:407] Connection header received
0808 15:48:20.961185 (+ 1022us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:48:20.961210 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:48:20.961656 (+ 446us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:48:20.962046 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:48:20.963023 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:48:20.965021 (+ 1998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:48:20.966225 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:48:20.967157 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:48:20.967336 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:48:20.970960 (+ 3624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:48:20.970967 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:48:20.970982 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:48:20.971009 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:48:20.973316 (+ 2307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:48:20.973809 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:48:20.973814 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:48:20.973819 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:48:20.973991 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:48:20.974300 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:48:20.974307 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:48:20.974309 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:48:20.974765 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:48:20.975063 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0808 15:48:20.975344 (+ 281us) server_negotiation.cc:299] Negotiation successful
0808 15:48:20.975654 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":162,"threads_started":1}
I20260808 15:48:20.977624 20148 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b79d01c44ab49de9dc9c54a22fd333e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b79d01c44ab49de9dc9c54a22fd333e" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 44083 } }
I20260808 15:48:20.977927 20148 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3b79d01c44ab49de9dc9c54a22fd333e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:48:20.977989 20148 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b79d01c44ab49de9dc9c54a22fd333e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b79d01c44ab49de9dc9c54a22fd333e, State: Initialized, Role: FOLLOWER
I20260808 15:48:20.978483 20148 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b79d01c44ab49de9dc9c54a22fd333e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b79d01c44ab49de9dc9c54a22fd333e" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 44083 } }
I20260808 15:48:20.978641 20148 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3b79d01c44ab49de9dc9c54a22fd333e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:48:20.978724 20148 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b79d01c44ab49de9dc9c54a22fd333e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:48:20.978816 20148 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b79d01c44ab49de9dc9c54a22fd333e [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:48:20.980160 20148 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b79d01c44ab49de9dc9c54a22fd333e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b79d01c44ab49de9dc9c54a22fd333e" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 44083 } }
I20260808 15:48:20.980543 20148 leader_election.cc:302] T 00000000000000000000000000000000 P 3b79d01c44ab49de9dc9c54a22fd333e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b79d01c44ab49de9dc9c54a22fd333e; no voters:
I20260808 15:48:20.980938 20148 leader_election.cc:288] T 00000000000000000000000000000000 P 3b79d01c44ab49de9dc9c54a22fd333e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:48:20.981055 20153 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3b79d01c44ab49de9dc9c54a22fd333e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:48:20.981315 20153 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3b79d01c44ab49de9dc9c54a22fd333e [term 1 LEADER]: Becoming Leader. State: Replica: 3b79d01c44ab49de9dc9c54a22fd333e, State: Running, Role: LEADER
I20260808 15:48:20.981647 20153 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b79d01c44ab49de9dc9c54a22fd333e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b79d01c44ab49de9dc9c54a22fd333e" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 44083 } }
I20260808 15:48:20.982256 20148 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b79d01c44ab49de9dc9c54a22fd333e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:48:20.983454 20154 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b79d01c44ab49de9dc9c54a22fd333e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3b79d01c44ab49de9dc9c54a22fd333e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b79d01c44ab49de9dc9c54a22fd333e" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 44083 } } }
I20260808 15:48:20.983590 20154 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b79d01c44ab49de9dc9c54a22fd333e [sys.catalog]: This master's current role is: LEADER
I20260808 15:48:20.983945 20155 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b79d01c44ab49de9dc9c54a22fd333e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b79d01c44ab49de9dc9c54a22fd333e. Latest consensus state: current_term: 1 leader_uuid: "3b79d01c44ab49de9dc9c54a22fd333e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b79d01c44ab49de9dc9c54a22fd333e" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 44083 } } }
I20260808 15:48:20.984040 20155 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b79d01c44ab49de9dc9c54a22fd333e [sys.catalog]: This master's current role is: LEADER
I20260808 15:48:20.984007 20162 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:48:20.987783 20162 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:48:20.988713 20148 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 15:48:21.003547 20162 catalog_manager.cc:1347] Generated new cluster ID: 8592b556e17846efaa69ac9f03fc6e5e
I20260808 15:48:21.003823 20162 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:48:21.023095 20162 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:48:21.029596 20162 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:48:21.038523 20162 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3b79d01c44ab49de9dc9c54a22fd333e: Generated new TSK 0
I20260808 15:48:21.039666 20162 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.39.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
I20260808 15:48:21.940258 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.39.84:36917/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:0
--local_ip_for_outbound_sockets=127.8.39.65
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:44083
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:33043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:48:22.137861 20194 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:48:22.138146 20194 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:48:22.138191 20194 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:48:22.142779 20194 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:48:22.142844 20194 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:48:22.142940 20194 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:48:22.148689 20194 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:33043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.8.39.84:36917/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:44083
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20194
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:48:22.149880 20194 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:48:22.151293 20194 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:48:22.164034 20203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:48:22.164034 20200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:48:22.164525 20201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:48:22.164608 20194 server_base.cc:1034] running on GCE node
I20260808 15:48:22.165135 20194 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:48:22.165958 20194 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:48:22.167186 20194 hybrid_clock.cc:648] HybridClock initialized: now 1786204102167155 us; error 51 us; skew 500 ppm
Aug 08 15:48:22 dist-test-slave-8tdl krb5kdc[19610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204102, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:48:22.170660 20194 init.cc:377] Logged in from keytab as kudu/127.8.39.65@KRBTEST.COM (short username kudu)
I20260808 15:48:22.171804 20194 webserver.cc:460] Webserver started at http://127.8.39.65:38093/ using document root <none> and password file <none>
I20260808 15:48:22.172397 20194 fs_manager.cc:359] Metadata directory not provided
I20260808 15:48:22.172502 20194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:48:22.172748 20194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 15:48:22 dist-test-slave-8tdl krb5kdc[19610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204102, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for HTTP/127.8.39.84@KRBTEST.COM
I20260808 15:48:22.192180 20194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-0/data/instance:
uuid: "c78d5dc9a56f4ccc8ad8a9486ef2d9ad"
format_stamp: "Formatted at 2026-08-08 15:48:22 on dist-test-slave-8tdl"
server_key: "d6b3cee9b61afa6deaa12979d0e4ce7f"
server_key_iv: "d045a285933a62791197a69344d2e624"
server_key_version: "kuduclusterkey@0"
I20260808 15:48:22.193487 20194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance:
uuid: "c78d5dc9a56f4ccc8ad8a9486ef2d9ad"
format_stamp: "Formatted at 2026-08-08 15:48:22 on dist-test-slave-8tdl"
server_key: "d6b3cee9b61afa6deaa12979d0e4ce7f"
server_key_iv: "d045a285933a62791197a69344d2e624"
server_key_version: "kuduclusterkey@0"
I20260808 15:48:22.200116 20194 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 15:48:22.219437 20212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:48:22.221392 20194 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 15:48:22.221541 20194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "c78d5dc9a56f4ccc8ad8a9486ef2d9ad"
format_stamp: "Formatted at 2026-08-08 15:48:22 on dist-test-slave-8tdl"
server_key: "d6b3cee9b61afa6deaa12979d0e4ce7f"
server_key_iv: "d045a285933a62791197a69344d2e624"
server_key_version: "kuduclusterkey@0"
I20260808 15:48:22.221704 20194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:48:22.258204 20194 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:48:22.262144 20194 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:48:22.262388 20194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:48:22.263236 20194 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:48:22.264438 20194 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:48:22.264504 20194 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:48:22.264571 20194 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:48:22.264599 20194 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:48:22.282401 20194 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:36553
I20260808 15:48:22.283164 20329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:36553 every 8 connection(s)
I20260808 15:48:22.283623 20194 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:48:22.292308 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 20194
I20260808 15:48:22.292476 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance
I20260808 15:48:22.292789 8349 external_mini_cluster.cc:1428] Setting key fc99e4c39c30d047c08b0353facee455
Aug 08 15:48:22 dist-test-slave-8tdl krb5kdc[19610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204102, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:48:22.304174 20332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:48:22.285713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:52185 (local address 127.8.39.126:44083)
0808 15:48:22.286796 (+ 1083us) server_negotiation.cc:206] Beginning negotiation
0808 15:48:22.286801 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:48:22.287405 (+ 604us) server_negotiation.cc:407] Connection header received
0808 15:48:22.288984 (+ 1579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:48:22.288988 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:48:22.289048 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:48:22.289160 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:48:22.291018 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:48:22.292341 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:48:22.294621 (+ 2280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:48:22.295057 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:48:22.295148 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:48:22.299033 (+ 3885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:48:22.299038 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:48:22.299041 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:48:22.299071 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:48:22.301318 (+ 2247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:48:22.302028 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:48:22.302032 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:48:22.302034 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:48:22.302140 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:48:22.302608 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:48:22.302612 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:48:22.302614 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:48:22.302908 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:48:22.302999 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 15:48:22.303827 (+ 828us) server_negotiation.cc:299] Negotiation successful
0808 15:48:22.303973 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":950,"thread_start_us":112,"threads_started":1}
I20260808 15:48:22.306011 20333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:48:22.286236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:44083 (local address 127.8.39.65:52185)
0808 15:48:22.287212 (+ 976us) negotiation.cc:107] Waiting for socket to connect
0808 15:48:22.287281 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0808 15:48:22.288694 (+ 1413us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:48:22.289504 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:48:22.289513 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:48:22.290006 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:48:22.290821 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:48:22.290843 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:48:22.292607 (+ 1764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:48:22.292611 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:48:22.294444 (+ 1833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:48:22.294457 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:48:22.295381 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:48:22.295386 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:48:22.295664 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:48:22.296541 (+ 877us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:48:22.296578 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:48:22.298748 (+ 2170us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:48:22.301468 (+ 2720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:48:22.301475 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:48:22.301493 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:48:22.301889 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:48:22.302267 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:48:22.302270 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:48:22.302273 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:48:22.302469 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:48:22.303078 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:48:22.303085 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:48:22.303498 (+ 413us) client_negotiation.cc:769] Sending connection context
0808 15:48:22.304393 (+ 895us) client_negotiation.cc:240] Negotiation successful
0808 15:48:22.304778 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":697,"thread_start_us":238,"threads_started":1}
I20260808 15:48:22.307631 20330 heartbeater.cc:347] Connected to a master server at 127.8.39.126:44083
I20260808 15:48:22.307906 20330 heartbeater.cc:464] Registering TS with master...
I20260808 15:48:22.308487 20330 heartbeater.cc:511] Master 127.8.39.126:44083 requested a full tablet report, sending...
I20260808 15:48:22.310351 20112 ts_manager.cc:194] Registered new tserver with Master: c78d5dc9a56f4ccc8ad8a9486ef2d9ad (127.8.39.65:36553)
I20260808 15:48:22.311906 20112 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.65@KRBTEST.COM'} at 127.8.39.65:52185
WARNING: no policy specified for kudu/127.8.39.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
I20260808 15:48:22.341542 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.39.84:36917/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:0
--local_ip_for_outbound_sockets=127.8.39.66
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:44083
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:33043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 15:48:22 dist-test-slave-8tdl krb5kdc[19610](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786204102, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 15:48:22.497030 20336 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:48:22.497344 20336 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:48:22.497484 20336 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:48:22.502213 20336 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:48:22.502347 20336 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:48:22.502473 20336 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:48:22.509162 20336 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:33043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.8.39.84:36917/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:44083
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20336
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:48:22.510730 20336 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:48:22.511941 20336 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:48:22.523159 20343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:48:22.523211 20342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:48:22.523453 20336 server_base.cc:1034] running on GCE node
W20260808 15:48:22.523667 20345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:48:22.524209 20336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:48:22.525337 20336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:48:22.526572 20336 hybrid_clock.cc:648] HybridClock initialized: now 1786204102526519 us; error 50 us; skew 500 ppm
Aug 08 15:48:22 dist-test-slave-8tdl krb5kdc[19610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204102, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:48:22.530848 20336 init.cc:377] Logged in from keytab as kudu/127.8.39.66@KRBTEST.COM (short username kudu)
I20260808 15:48:22.531912 20336 webserver.cc:460] Webserver started at http://127.8.39.66:39847/ using document root <none> and password file <none>
I20260808 15:48:22.532665 20336 fs_manager.cc:359] Metadata directory not provided
I20260808 15:48:22.532766 20336 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:48:22.533013 20336 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 15:48:22 dist-test-slave-8tdl krb5kdc[19610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204102, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for HTTP/127.8.39.84@KRBTEST.COM
I20260808 15:48:22.551167 20336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-1/data/instance:
uuid: "5e22d982027c4100a7f92e6d24f45e55"
format_stamp: "Formatted at 2026-08-08 15:48:22 on dist-test-slave-8tdl"
server_key: "6c7a30467b54635275e90849caeddc65"
server_key_iv: "7a7ad903081ba89983d7c73476018359"
server_key_version: "kuduclusterkey@0"
I20260808 15:48:22.552147 20336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance:
uuid: "5e22d982027c4100a7f92e6d24f45e55"
format_stamp: "Formatted at 2026-08-08 15:48:22 on dist-test-slave-8tdl"
server_key: "6c7a30467b54635275e90849caeddc65"
server_key_iv: "7a7ad903081ba89983d7c73476018359"
server_key_version: "kuduclusterkey@0"
I20260808 15:48:22.559105 20336 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 15:48:22.587582 20352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:48:22.592730 20336 fs_manager.cc:725] Time spent opening block manager: real 0.016s user 0.003s sys 0.000s
I20260808 15:48:22.592921 20336 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "5e22d982027c4100a7f92e6d24f45e55"
format_stamp: "Formatted at 2026-08-08 15:48:22 on dist-test-slave-8tdl"
server_key: "6c7a30467b54635275e90849caeddc65"
server_key_iv: "7a7ad903081ba89983d7c73476018359"
server_key_version: "kuduclusterkey@0"
I20260808 15:48:22.593092 20336 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:48:22.650345 20336 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:48:22.654981 20336 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:48:22.655267 20336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:48:22.656070 20336 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:48:22.659499 20336 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:48:22.659637 20336 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260808 15:48:22.659770 20336 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:48:22.659865 20336 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:48:22.678745 20336 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:37143
I20260808 15:48:22.678848 20468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:37143 every 8 connection(s)
I20260808 15:48:22.680243 20336 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:48:22.688926 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 20336
I20260808 15:48:22.689070 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance
I20260808 15:48:22.689396 8349 external_mini_cluster.cc:1428] Setting key 46501a6c517e49785fc32263e0c7f64f
Aug 08 15:48:22 dist-test-slave-8tdl krb5kdc[19610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204102, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.39.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.67@KRBTEST.COM" created.
I20260808 15:48:22.711359 20332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:48:22.687677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:38807 (local address 127.8.39.126:44083)
0808 15:48:22.687796 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 15:48:22.687800 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:48:22.687820 (+ 20us) server_negotiation.cc:407] Connection header received
0808 15:48:22.690270 (+ 2450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:48:22.690275 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:48:22.690338 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:48:22.690396 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:48:22.692261 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:48:22.693126 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:48:22.697702 (+ 4576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:48:22.698161 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:48:22.698253 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:48:22.704457 (+ 6204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:48:22.704461 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:48:22.704464 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:48:22.704504 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:48:22.706457 (+ 1953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:48:22.708136 (+ 1679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:48:22.708143 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:48:22.708147 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:48:22.708246 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:48:22.709639 (+ 1393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:48:22.709644 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:48:22.709648 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:48:22.709938 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:48:22.710033 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 15:48:22.710943 (+ 910us) server_negotiation.cc:299] Negotiation successful
0808 15:48:22.711101 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 15:48:22.713243 20471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:48:22.686467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:44083 (local address 127.8.39.66:38807)
0808 15:48:22.687374 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0808 15:48:22.687434 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 15:48:22.688739 (+ 1305us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:48:22.690860 (+ 2121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:48:22.690872 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:48:22.691255 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:48:22.692060 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:48:22.692093 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:48:22.695902 (+ 3809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:48:22.695909 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:48:22.697529 (+ 1620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:48:22.697545 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:48:22.698510 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:48:22.698517 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:48:22.698799 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:48:22.699611 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:48:22.699640 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:48:22.704168 (+ 4528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:48:22.706633 (+ 2465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:48:22.706642 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:48:22.706662 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:48:22.707991 (+ 1329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:48:22.708368 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:48:22.708372 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:48:22.708374 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:48:22.709501 (+ 1127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:48:22.710132 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:48:22.710140 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:48:22.710593 (+ 453us) client_negotiation.cc:769] Sending connection context
0808 15:48:22.711561 (+ 968us) client_negotiation.cc:240] Negotiation successful
0808 15:48:22.711981 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":694,"thread_start_us":219,"threads_started":1}
I20260808 15:48:22.714701 20469 heartbeater.cc:347] Connected to a master server at 127.8.39.126:44083
I20260808 15:48:22.714956 20469 heartbeater.cc:464] Registering TS with master...
I20260808 15:48:22.715487 20469 heartbeater.cc:511] Master 127.8.39.126:44083 requested a full tablet report, sending...
I20260808 15:48:22.719239 20112 ts_manager.cc:194] Registered new tserver with Master: 5e22d982027c4100a7f92e6d24f45e55 (127.8.39.66:37143)
I20260808 15:48:22.720131 20112 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.66@KRBTEST.COM'} at 127.8.39.66:38807
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
I20260808 15:48:22.733810 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.39.84:36917/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:0
--local_ip_for_outbound_sockets=127.8.39.67
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:44083
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:33043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:48:22.910770 20474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:48:22.911100 20474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:48:22.911198 20474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:48:22.915752 20474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:48:22.915840 20474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:48:22.915940 20474 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:48:22.922247 20474 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:33043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.8.39.84:36917/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:44083
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20474
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:48:22.923954 20474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:48:22.925607 20474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:48:22.937940 20480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:48:22.938372 20479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:48:22.938510 20482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:48:22.938771 20474 server_base.cc:1034] running on GCE node
I20260808 15:48:22.939258 20474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:48:22.940073 20474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:48:22.943347 20474 hybrid_clock.cc:648] HybridClock initialized: now 1786204102943261 us; error 97 us; skew 500 ppm
Aug 08 15:48:22 dist-test-slave-8tdl krb5kdc[19610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204102, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:48:22.947623 20474 init.cc:377] Logged in from keytab as kudu/127.8.39.67@KRBTEST.COM (short username kudu)
I20260808 15:48:22.948818 20474 webserver.cc:460] Webserver started at http://127.8.39.67:40469/ using document root <none> and password file <none>
I20260808 15:48:22.949676 20474 fs_manager.cc:359] Metadata directory not provided
I20260808 15:48:22.949823 20474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:48:22.950125 20474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 15:48:22 dist-test-slave-8tdl krb5kdc[19610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204102, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for HTTP/127.8.39.84@KRBTEST.COM
I20260808 15:48:22.968609 20474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-2/data/instance:
uuid: "96fb011dd9fc4003a2b40f1eb3edc082"
format_stamp: "Formatted at 2026-08-08 15:48:22 on dist-test-slave-8tdl"
server_key: "334235ee72df8b12a642e5ba2295d1f2"
server_key_iv: "1d76b9d22f6c1002c747b5f0b35903d1"
server_key_version: "kuduclusterkey@0"
I20260808 15:48:22.969697 20474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance:
uuid: "96fb011dd9fc4003a2b40f1eb3edc082"
format_stamp: "Formatted at 2026-08-08 15:48:22 on dist-test-slave-8tdl"
server_key: "334235ee72df8b12a642e5ba2295d1f2"
server_key_iv: "1d76b9d22f6c1002c747b5f0b35903d1"
server_key_version: "kuduclusterkey@0"
Aug 08 15:48:22 dist-test-slave-8tdl krb5kdc[19610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204102, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for HTTP/127.8.39.84@KRBTEST.COM
I20260808 15:48:22.976150 20474 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260808 15:48:23.002202 20489 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:48:23.004073 20474 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260808 15:48:23.004227 20474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "96fb011dd9fc4003a2b40f1eb3edc082"
format_stamp: "Formatted at 2026-08-08 15:48:22 on dist-test-slave-8tdl"
server_key: "334235ee72df8b12a642e5ba2295d1f2"
server_key_iv: "1d76b9d22f6c1002c747b5f0b35903d1"
server_key_version: "kuduclusterkey@0"
I20260808 15:48:23.004386 20474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:48:23.023351 20474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:48:23.027091 20474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:48:23.027344 20474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:48:23.028107 20474 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:48:23.029282 20474 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:48:23.029374 20474 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:48:23.029502 20474 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:48:23.029556 20474 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:48:23.061700 20474 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:42857
I20260808 15:48:23.067884 20606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:42857 every 8 connection(s)
I20260808 15:48:23.068498 20474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:48:23.073014 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 20474
I20260808 15:48:23.073233 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance
I20260808 15:48:23.073792 8349 external_mini_cluster.cc:1428] Setting key 19681fc458f5a1388c68cf9008bffbd8
Aug 08 15:48:23 dist-test-slave-8tdl krb5kdc[19610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204102, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:48:23.112514 20332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:48:23.076939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:56953 (local address 127.8.39.126:44083)
0808 15:48:23.077084 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 15:48:23.077089 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:48:23.089019 (+ 11930us) server_negotiation.cc:407] Connection header received
0808 15:48:23.090582 (+ 1563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:48:23.090585 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:48:23.090642 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:48:23.090715 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:48:23.094797 (+ 4082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.095663 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.099592 (+ 3929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.099957 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.100043 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:48:23.107371 (+ 7328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:48:23.107376 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:48:23.107379 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:48:23.107411 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:48:23.109255 (+ 1844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:48:23.110032 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:48:23.110035 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:48:23.110038 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:48:23.110139 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:48:23.110577 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:48:23.110581 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:48:23.110583 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:48:23.110852 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:48:23.110952 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 15:48:23.112205 (+ 1253us) server_negotiation.cc:299] Negotiation successful
0808 15:48:23.112349 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 15:48:23.114295 20609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:48:23.077477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:44083 (local address 127.8.39.67:56953)
0808 15:48:23.088808 (+ 11331us) negotiation.cc:107] Waiting for socket to connect
0808 15:48:23.088900 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0808 15:48:23.090300 (+ 1400us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:48:23.091212 (+ 912us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:48:23.091223 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:48:23.091729 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:48:23.092496 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:48:23.092517 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.095854 (+ 3337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.095857 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:48:23.097425 (+ 1568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:48:23.097439 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.100983 (+ 3544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.100988 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:48:23.101221 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:48:23.103128 (+ 1907us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:48:23.103153 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:48:23.107106 (+ 3953us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:48:23.109431 (+ 2325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:48:23.109437 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:48:23.109456 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:48:23.109859 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:48:23.110258 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:48:23.110262 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:48:23.110264 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:48:23.110464 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:48:23.111274 (+ 810us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:48:23.111282 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:48:23.111694 (+ 412us) client_negotiation.cc:769] Sending connection context
0808 15:48:23.112849 (+ 1155us) client_negotiation.cc:240] Negotiation successful
0808 15:48:23.113209 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10967,"thread_start_us":181,"threads_started":1}
I20260808 15:48:23.115629 20607 heartbeater.cc:347] Connected to a master server at 127.8.39.126:44083
I20260808 15:48:23.115862 20607 heartbeater.cc:464] Registering TS with master...
I20260808 15:48:23.116405 20607 heartbeater.cc:511] Master 127.8.39.126:44083 requested a full tablet report, sending...
I20260808 15:48:23.117478 20112 ts_manager.cc:194] Registered new tserver with Master: 96fb011dd9fc4003a2b40f1eb3edc082 (127.8.39.67:42857)
I20260808 15:48:23.118191 20112 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.67@KRBTEST.COM'} at 127.8.39.67:56953
I20260808 15:48:23.124588 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:48:23.145356 20332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:48:23.127187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43334 (local address 127.8.39.126:44083)
0808 15:48:23.127305 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 15:48:23.127309 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:48:23.135660 (+ 8351us) server_negotiation.cc:407] Connection header received
0808 15:48:23.135891 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:48:23.135895 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:48:23.135950 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:48:23.136005 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:48:23.137068 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.137901 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.139201 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.139555 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.139633 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:48:23.141585 (+ 1952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:48:23.141589 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:48:23.141592 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:48:23.141622 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:48:23.143374 (+ 1752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:48:23.143886 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:48:23.143890 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:48:23.143892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:48:23.143980 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:48:23.144294 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:48:23.144297 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:48:23.144299 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:48:23.144531 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:48:23.144636 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 15:48:23.145035 (+ 399us) server_negotiation.cc:299] Negotiation successful
0808 15:48:23.145169 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 15:48:23.149581 20112 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43334:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:48:23.154126 20112 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:48:23.216588 20625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:48:23.193960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:42857 (local address 127.0.0.1:51322)
0808 15:48:23.199475 (+ 5515us) negotiation.cc:107] Waiting for socket to connect
0808 15:48:23.199487 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:48:23.199565 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:48:23.200706 (+ 1141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:48:23.200712 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:48:23.200734 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:48:23.200870 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:48:23.200881 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.204842 (+ 3961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.204846 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:48:23.206255 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:48:23.206267 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.215954 (+ 9687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.215972 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:48:23.216115 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:48:23.216164 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 15:48:23.216278 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 15:48:23.216429 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5455,"thread_start_us":91,"threads_started":1}
I20260808 15:48:23.218134 20623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:48:23.194814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:36553 (local address 127.0.0.1:57374)
0808 15:48:23.201096 (+ 6282us) negotiation.cc:107] Waiting for socket to connect
0808 15:48:23.201109 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:48:23.201189 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:48:23.201871 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:48:23.201874 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:48:23.201888 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:48:23.202019 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:48:23.202029 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.211844 (+ 9815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.211848 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:48:23.213103 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:48:23.213117 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.217702 (+ 4585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.217706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:48:23.217808 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:48:23.217833 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 15:48:23.217901 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 15:48:23.217992 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6222,"thread_start_us":131,"threads_started":1}
I20260808 15:48:23.220885 20626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:48:23.195299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57374 (local address 127.8.39.65:36553)
0808 15:48:23.199805 (+ 4506us) server_negotiation.cc:206] Beginning negotiation
0808 15:48:23.199813 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:48:23.201283 (+ 1470us) server_negotiation.cc:407] Connection header received
0808 15:48:23.201380 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:48:23.201386 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:48:23.201581 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:48:23.201718 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:48:23.202155 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.203378 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.213287 (+ 9909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.214234 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.214350 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:48:23.214521 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 15:48:23.220622 (+ 6101us) server_negotiation.cc:299] Negotiation successful
0808 15:48:23.220747 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4388,"thread_start_us":119,"threads_started":1}
I20260808 15:48:23.221557 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:48:23.194340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51322 (local address 127.8.39.67:42857)
0808 15:48:23.200016 (+ 5676us) server_negotiation.cc:206] Beginning negotiation
0808 15:48:23.200027 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 15:48:23.200052 (+ 25us) server_negotiation.cc:407] Connection header received
0808 15:48:23.200131 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:48:23.200136 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:48:23.200354 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:48:23.200519 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:48:23.203537 (+ 3018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.204697 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.214725 (+ 10028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.215617 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.215741 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:48:23.215894 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 15:48:23.221244 (+ 5350us) server_negotiation.cc:299] Negotiation successful
0808 15:48:23.221365 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5567,"thread_start_us":149,"threads_started":1}
I20260808 15:48:23.225087 20247 tablet_service.cc:1467] Processing CreateTablet for tablet f365863d71464a848c252fd33c13b2b6 (DEFAULT_TABLE table=test-table [id=31fbe7bb4b674cc4acefc54b2b2c8cdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:48:23.226284 20247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f365863d71464a848c252fd33c13b2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:48:23.238005 20538 tablet_service.cc:1467] Processing CreateTablet for tablet f365863d71464a848c252fd33c13b2b6 (DEFAULT_TABLE table=test-table [id=31fbe7bb4b674cc4acefc54b2b2c8cdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:48:23.239380 20538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f365863d71464a848c252fd33c13b2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:48:23.253147 20621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:48:23.192422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:37143 (local address 127.0.0.1:57816)
0808 15:48:23.199051 (+ 6629us) negotiation.cc:107] Waiting for socket to connect
0808 15:48:23.199112 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 15:48:23.199243 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:48:23.218914 (+ 19671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:48:23.218918 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:48:23.218938 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:48:23.219042 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:48:23.219047 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.249899 (+ 30852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.249903 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:48:23.251144 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:48:23.251162 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.252649 (+ 1487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.252653 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:48:23.252758 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:48:23.252790 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 15:48:23.252843 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 15:48:23.252930 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6411,"thread_start_us":140,"threads_started":1}
I20260808 15:48:23.254563 20622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:48:23.192560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57816 (local address 127.8.39.66:37143)
0808 15:48:23.217155 (+ 24595us) server_negotiation.cc:206] Beginning negotiation
0808 15:48:23.217177 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 15:48:23.217207 (+ 30us) server_negotiation.cc:407] Connection header received
0808 15:48:23.217290 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:48:23.217296 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:48:23.217537 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:48:23.219212 (+ 1675us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:48:23.219371 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.220452 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.251405 (+ 30953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.252481 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.253929 (+ 1448us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:48:23.254149 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 15:48:23.254224 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 15:48:23.254342 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24455,"thread_start_us":150,"threads_started":1}
I20260808 15:48:23.258074 20382 tablet_service.cc:1467] Processing CreateTablet for tablet f365863d71464a848c252fd33c13b2b6 (DEFAULT_TABLE table=test-table [id=31fbe7bb4b674cc4acefc54b2b2c8cdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:48:23.259759 20382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f365863d71464a848c252fd33c13b2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:48:23.283360 20627 tablet_bootstrap.cc:492] T f365863d71464a848c252fd33c13b2b6 P 96fb011dd9fc4003a2b40f1eb3edc082: Bootstrap starting.
I20260808 15:48:23.287309 20627 tablet_bootstrap.cc:654] T f365863d71464a848c252fd33c13b2b6 P 96fb011dd9fc4003a2b40f1eb3edc082: Neither blocks nor log segments found. Creating new log.
I20260808 15:48:23.287873 20628 tablet_bootstrap.cc:492] T f365863d71464a848c252fd33c13b2b6 P c78d5dc9a56f4ccc8ad8a9486ef2d9ad: Bootstrap starting.
I20260808 15:48:23.292397 20628 tablet_bootstrap.cc:654] T f365863d71464a848c252fd33c13b2b6 P c78d5dc9a56f4ccc8ad8a9486ef2d9ad: Neither blocks nor log segments found. Creating new log.
I20260808 15:48:23.293951 20628 log.cc:824] T f365863d71464a848c252fd33c13b2b6 P c78d5dc9a56f4ccc8ad8a9486ef2d9ad: Log is configured to *not* fsync() on all Append() calls
I20260808 15:48:23.295179 20627 log.cc:824] T f365863d71464a848c252fd33c13b2b6 P 96fb011dd9fc4003a2b40f1eb3edc082: Log is configured to *not* fsync() on all Append() calls
I20260808 15:48:23.295778 20629 tablet_bootstrap.cc:492] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55: Bootstrap starting.
I20260808 15:48:23.301985 20629 tablet_bootstrap.cc:654] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55: Neither blocks nor log segments found. Creating new log.
I20260808 15:48:23.307727 20629 log.cc:824] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55: Log is configured to *not* fsync() on all Append() calls
I20260808 15:48:23.310588 20627 tablet_bootstrap.cc:492] T f365863d71464a848c252fd33c13b2b6 P 96fb011dd9fc4003a2b40f1eb3edc082: No bootstrap required, opened a new log
I20260808 15:48:23.310943 20627 ts_tablet_manager.cc:1397] T f365863d71464a848c252fd33c13b2b6 P 96fb011dd9fc4003a2b40f1eb3edc082: Time spent bootstrapping tablet: real 0.028s user 0.008s sys 0.000s
I20260808 15:48:23.314477 20330 heartbeater.cc:503] Master 127.8.39.126:44083 was elected leader, sending a full tablet report...
I20260808 15:48:23.319546 20628 tablet_bootstrap.cc:492] T f365863d71464a848c252fd33c13b2b6 P c78d5dc9a56f4ccc8ad8a9486ef2d9ad: No bootstrap required, opened a new log
I20260808 15:48:23.319873 20628 ts_tablet_manager.cc:1397] T f365863d71464a848c252fd33c13b2b6 P c78d5dc9a56f4ccc8ad8a9486ef2d9ad: Time spent bootstrapping tablet: real 0.032s user 0.007s sys 0.000s
I20260808 15:48:23.324929 20628 raft_consensus.cc:348] T f365863d71464a848c252fd33c13b2b6 P c78d5dc9a56f4ccc8ad8a9486ef2d9ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e22d982027c4100a7f92e6d24f45e55" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 37143 } } peers { permanent_uuid: "96fb011dd9fc4003a2b40f1eb3edc082" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 42857 } } peers { permanent_uuid: "c78d5dc9a56f4ccc8ad8a9486ef2d9ad" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 36553 } }
I20260808 15:48:23.327324 20627 raft_consensus.cc:348] T f365863d71464a848c252fd33c13b2b6 P 96fb011dd9fc4003a2b40f1eb3edc082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e22d982027c4100a7f92e6d24f45e55" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 37143 } } peers { permanent_uuid: "96fb011dd9fc4003a2b40f1eb3edc082" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 42857 } } peers { permanent_uuid: "c78d5dc9a56f4ccc8ad8a9486ef2d9ad" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 36553 } }
I20260808 15:48:23.327747 20627 raft_consensus.cc:374] T f365863d71464a848c252fd33c13b2b6 P 96fb011dd9fc4003a2b40f1eb3edc082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:48:23.327884 20627 raft_consensus.cc:729] T f365863d71464a848c252fd33c13b2b6 P 96fb011dd9fc4003a2b40f1eb3edc082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96fb011dd9fc4003a2b40f1eb3edc082, State: Initialized, Role: FOLLOWER
I20260808 15:48:23.327812 20628 raft_consensus.cc:374] T f365863d71464a848c252fd33c13b2b6 P c78d5dc9a56f4ccc8ad8a9486ef2d9ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:48:23.327958 20628 raft_consensus.cc:729] T f365863d71464a848c252fd33c13b2b6 P c78d5dc9a56f4ccc8ad8a9486ef2d9ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c78d5dc9a56f4ccc8ad8a9486ef2d9ad, State: Initialized, Role: FOLLOWER
I20260808 15:48:23.328717 20627 consensus_queue.cc:260] T f365863d71464a848c252fd33c13b2b6 P 96fb011dd9fc4003a2b40f1eb3edc082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e22d982027c4100a7f92e6d24f45e55" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 37143 } } peers { permanent_uuid: "96fb011dd9fc4003a2b40f1eb3edc082" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 42857 } } peers { permanent_uuid: "c78d5dc9a56f4ccc8ad8a9486ef2d9ad" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 36553 } }
I20260808 15:48:23.329977 20628 consensus_queue.cc:260] T f365863d71464a848c252fd33c13b2b6 P c78d5dc9a56f4ccc8ad8a9486ef2d9ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e22d982027c4100a7f92e6d24f45e55" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 37143 } } peers { permanent_uuid: "96fb011dd9fc4003a2b40f1eb3edc082" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 42857 } } peers { permanent_uuid: "c78d5dc9a56f4ccc8ad8a9486ef2d9ad" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 36553 } }
I20260808 15:48:23.331200 20628 ts_tablet_manager.cc:1428] T f365863d71464a848c252fd33c13b2b6 P c78d5dc9a56f4ccc8ad8a9486ef2d9ad: Time spent starting tablet: real 0.011s user 0.002s sys 0.004s
I20260808 15:48:23.333890 20629 tablet_bootstrap.cc:492] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55: No bootstrap required, opened a new log
I20260808 15:48:23.334216 20629 ts_tablet_manager.cc:1397] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55: Time spent bootstrapping tablet: real 0.039s user 0.007s sys 0.000s
I20260808 15:48:23.335011 20627 ts_tablet_manager.cc:1428] T f365863d71464a848c252fd33c13b2b6 P 96fb011dd9fc4003a2b40f1eb3edc082: Time spent starting tablet: real 0.024s user 0.008s sys 0.000s
I20260808 15:48:23.335472 20607 heartbeater.cc:503] Master 127.8.39.126:44083 was elected leader, sending a full tablet report...
I20260808 15:48:23.342664 20629 raft_consensus.cc:348] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e22d982027c4100a7f92e6d24f45e55" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 37143 } } peers { permanent_uuid: "96fb011dd9fc4003a2b40f1eb3edc082" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 42857 } } peers { permanent_uuid: "c78d5dc9a56f4ccc8ad8a9486ef2d9ad" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 36553 } }
I20260808 15:48:23.343046 20629 raft_consensus.cc:374] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:48:23.343120 20629 raft_consensus.cc:729] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e22d982027c4100a7f92e6d24f45e55, State: Initialized, Role: FOLLOWER
I20260808 15:48:23.343669 20629 consensus_queue.cc:260] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e22d982027c4100a7f92e6d24f45e55" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 37143 } } peers { permanent_uuid: "96fb011dd9fc4003a2b40f1eb3edc082" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 42857 } } peers { permanent_uuid: "c78d5dc9a56f4ccc8ad8a9486ef2d9ad" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 36553 } }
I20260808 15:48:23.344841 20469 heartbeater.cc:503] Master 127.8.39.126:44083 was elected leader, sending a full tablet report...
I20260808 15:48:23.344952 20629 ts_tablet_manager.cc:1428] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55: Time spent starting tablet: real 0.011s user 0.008s sys 0.000s
Aug 08 15:48:23 dist-test-slave-8tdl krb5kdc[19610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204102, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for HTTP/127.8.39.84@KRBTEST.COM
W20260808 15:48:23.438414 20470 tablet.cc:2369] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:48:23.538726 20635 raft_consensus.cc:482] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:48:23.539000 20635 raft_consensus.cc:504] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e22d982027c4100a7f92e6d24f45e55" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 37143 } } peers { permanent_uuid: "96fb011dd9fc4003a2b40f1eb3edc082" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 42857 } } peers { permanent_uuid: "c78d5dc9a56f4ccc8ad8a9486ef2d9ad" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 36553 } }
W20260808 15:48:23.540344 20331 tablet.cc:2369] T f365863d71464a848c252fd33c13b2b6 P c78d5dc9a56f4ccc8ad8a9486ef2d9ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:48:23.540453 20635 leader_election.cc:288] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96fb011dd9fc4003a2b40f1eb3edc082 (127.8.39.67:42857), c78d5dc9a56f4ccc8ad8a9486ef2d9ad (127.8.39.65:36553)
I20260808 15:48:23.546741 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:48:23.541346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:52931 (local address 127.8.39.67:42857)
0808 15:48:23.541505 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 15:48:23.541510 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:48:23.542171 (+ 661us) server_negotiation.cc:407] Connection header received
0808 15:48:23.542389 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:48:23.542393 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:48:23.542447 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:48:23.542500 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:48:23.542997 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.543778 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.545377 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.545966 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.546077 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:48:23.546146 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 15:48:23.546492 (+ 346us) server_negotiation.cc:299] Negotiation successful
0808 15:48:23.546573 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 15:48:23.547362 20638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:48:23.540854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:42857 (local address 127.8.39.66:52931)
0808 15:48:23.542073 (+ 1219us) negotiation.cc:107] Waiting for socket to connect
0808 15:48:23.542090 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:48:23.542258 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:48:23.542655 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:48:23.542658 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:48:23.542700 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:48:23.542843 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:48:23.542850 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.543946 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.543950 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:48:23.545224 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:48:23.545235 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.546243 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.546246 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:48:23.546347 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:48:23.546370 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 15:48:23.547086 (+ 716us) client_negotiation.cc:240] Negotiation successful
0808 15:48:23.547254 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1138,"thread_start_us":148,"threads_started":1}
I20260808 15:48:23.548027 20559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f365863d71464a848c252fd33c13b2b6" candidate_uuid: "5e22d982027c4100a7f92e6d24f45e55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96fb011dd9fc4003a2b40f1eb3edc082" is_pre_election: true
I20260808 15:48:23.548362 20559 raft_consensus.cc:2454] T f365863d71464a848c252fd33c13b2b6 P 96fb011dd9fc4003a2b40f1eb3edc082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e22d982027c4100a7f92e6d24f45e55 in term 0.
I20260808 15:48:23.548915 20354 leader_election.cc:302] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e22d982027c4100a7f92e6d24f45e55, 96fb011dd9fc4003a2b40f1eb3edc082; no voters:
I20260808 15:48:23.549232 20635 raft_consensus.cc:2781] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:48:23.549310 20635 raft_consensus.cc:482] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:48:23.549356 20635 raft_consensus.cc:3037] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:48:23.551214 20635 raft_consensus.cc:504] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e22d982027c4100a7f92e6d24f45e55" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 37143 } } peers { permanent_uuid: "96fb011dd9fc4003a2b40f1eb3edc082" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 42857 } } peers { permanent_uuid: "c78d5dc9a56f4ccc8ad8a9486ef2d9ad" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 36553 } }
I20260808 15:48:23.551636 20635 leader_election.cc:288] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55 [CANDIDATE]: Term 1 election: Requested vote from peers 96fb011dd9fc4003a2b40f1eb3edc082 (127.8.39.67:42857), c78d5dc9a56f4ccc8ad8a9486ef2d9ad (127.8.39.65:36553)
I20260808 15:48:23.552434 20559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f365863d71464a848c252fd33c13b2b6" candidate_uuid: "5e22d982027c4100a7f92e6d24f45e55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96fb011dd9fc4003a2b40f1eb3edc082"
I20260808 15:48:23.552592 20559 raft_consensus.cc:3037] T f365863d71464a848c252fd33c13b2b6 P 96fb011dd9fc4003a2b40f1eb3edc082 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:48:23.552755 20626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:48:23.541778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:39683 (local address 127.8.39.65:36553)
0808 15:48:23.541890 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 15:48:23.541894 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:48:23.547458 (+ 5564us) server_negotiation.cc:407] Connection header received
0808 15:48:23.547621 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:48:23.547625 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:48:23.547682 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:48:23.547737 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:48:23.548216 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.549069 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.551186 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.551900 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.551992 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:48:23.552088 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 15:48:23.552530 (+ 442us) server_negotiation.cc:299] Negotiation successful
0808 15:48:23.552622 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 15:48:23.553205 20639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:48:23.541433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:36553 (local address 127.8.39.66:39683)
0808 15:48:23.547313 (+ 5880us) negotiation.cc:107] Waiting for socket to connect
0808 15:48:23.547332 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 15:48:23.547465 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:48:23.547908 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:48:23.547911 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:48:23.547931 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:48:23.548078 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:48:23.548085 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.549272 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.549275 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:48:23.551001 (+ 1726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:48:23.551014 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.552240 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.552244 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:48:23.552361 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:48:23.552388 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 15:48:23.552973 (+ 585us) client_negotiation.cc:240] Negotiation successful
0808 15:48:23.553055 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5800,"thread_start_us":94,"threads_started":1}
I20260808 15:48:23.553956 20559 raft_consensus.cc:2454] T f365863d71464a848c252fd33c13b2b6 P 96fb011dd9fc4003a2b40f1eb3edc082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e22d982027c4100a7f92e6d24f45e55 in term 1.
I20260808 15:48:23.554394 20354 leader_election.cc:302] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e22d982027c4100a7f92e6d24f45e55, 96fb011dd9fc4003a2b40f1eb3edc082; no voters:
I20260808 15:48:23.554980 20279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f365863d71464a848c252fd33c13b2b6" candidate_uuid: "5e22d982027c4100a7f92e6d24f45e55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c78d5dc9a56f4ccc8ad8a9486ef2d9ad"
I20260808 15:48:23.555212 20279 raft_consensus.cc:3037] T f365863d71464a848c252fd33c13b2b6 P c78d5dc9a56f4ccc8ad8a9486ef2d9ad [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:48:23.557010 20279 raft_consensus.cc:2454] T f365863d71464a848c252fd33c13b2b6 P c78d5dc9a56f4ccc8ad8a9486ef2d9ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e22d982027c4100a7f92e6d24f45e55 in term 1.
I20260808 15:48:23.557387 20280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f365863d71464a848c252fd33c13b2b6" candidate_uuid: "5e22d982027c4100a7f92e6d24f45e55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c78d5dc9a56f4ccc8ad8a9486ef2d9ad" is_pre_election: true
I20260808 15:48:23.557525 20280 raft_consensus.cc:2362] T f365863d71464a848c252fd33c13b2b6 P c78d5dc9a56f4ccc8ad8a9486ef2d9ad [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5e22d982027c4100a7f92e6d24f45e55 in term 1. Re-sending same reply.
I20260808 15:48:23.558493 20635 raft_consensus.cc:2781] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:48:23.558823 20635 raft_consensus.cc:686] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55 [term 1 LEADER]: Becoming Leader. State: Replica: 5e22d982027c4100a7f92e6d24f45e55, State: Running, Role: LEADER
I20260808 15:48:23.559190 20635 consensus_queue.cc:237] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e22d982027c4100a7f92e6d24f45e55" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 37143 } } peers { permanent_uuid: "96fb011dd9fc4003a2b40f1eb3edc082" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 42857 } } peers { permanent_uuid: "c78d5dc9a56f4ccc8ad8a9486ef2d9ad" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 36553 } }
I20260808 15:48:23.563095 20110 catalog_manager.cc:5495] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e22d982027c4100a7f92e6d24f45e55 (127.8.39.66). New cstate: current_term: 1 leader_uuid: "5e22d982027c4100a7f92e6d24f45e55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e22d982027c4100a7f92e6d24f45e55" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 37143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96fb011dd9fc4003a2b40f1eb3edc082" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 42857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c78d5dc9a56f4ccc8ad8a9486ef2d9ad" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 36553 } health_report { overall_health: UNKNOWN } } }
W20260808 15:48:23.576062 20608 tablet.cc:2369] T f365863d71464a848c252fd33c13b2b6 P 96fb011dd9fc4003a2b40f1eb3edc082: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:48:23.653838 20622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:48:23.649914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57830 (local address 127.8.39.66:37143)
0808 15:48:23.650084 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 15:48:23.650089 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:48:23.650103 (+ 14us) server_negotiation.cc:407] Connection header received
0808 15:48:23.650191 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:48:23.650194 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:48:23.650268 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:48:23.650387 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:48:23.650897 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.651410 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.652308 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:48:23.652537 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:48:23.652650 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:48:23.652998 (+ 348us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:48:23.653436 (+ 438us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:48:23.653574 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 15:48:23.653619 (+ 45us) server_negotiation.cc:299] Negotiation successful
0808 15:48:23.653678 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 15:48:23.660058 20559 raft_consensus.cc:1261] T f365863d71464a848c252fd33c13b2b6 P 96fb011dd9fc4003a2b40f1eb3edc082 [term 1 FOLLOWER]: Refusing update from remote peer 5e22d982027c4100a7f92e6d24f45e55: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:48:23.660125 20280 raft_consensus.cc:1261] T f365863d71464a848c252fd33c13b2b6 P c78d5dc9a56f4ccc8ad8a9486ef2d9ad [term 1 FOLLOWER]: Refusing update from remote peer 5e22d982027c4100a7f92e6d24f45e55: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:48:23.660916 20640 consensus_queue.cc:1035] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c78d5dc9a56f4ccc8ad8a9486ef2d9ad" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:48:23.661154 20635 consensus_queue.cc:1035] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96fb011dd9fc4003a2b40f1eb3edc082" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 42857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:48:23.671751 20652 mvcc.cc:205] Tried to move back new op lower bound from 7316292008583766016 to 7316292008181624832. Current Snapshot: MvccSnapshot[applied={T|T < 7316292008583766016}]
I20260808 15:48:23.673377 20651 mvcc.cc:205] Tried to move back new op lower bound from 7316292008583766016 to 7316292008181624832. Current Snapshot: MvccSnapshot[applied={T|T < 7316292008583766016 or (T in {7316292008583766016})}]
I20260808 15:48:23.680862 20110 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43334:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:48:23.681069 20110 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43334:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:48:23.683661 20110 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3b79d01c44ab49de9dc9c54a22fd333e: Sending DeleteTablet for 3 replicas of tablet f365863d71464a848c252fd33c13b2b6
I20260808 15:48:23.684571 20382 tablet_service.cc:1514] Processing DeleteTablet for tablet f365863d71464a848c252fd33c13b2b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:48:23 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:57816
I20260808 15:48:23.684633 20247 tablet_service.cc:1514] Processing DeleteTablet for tablet f365863d71464a848c252fd33c13b2b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:48:23 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:57374
I20260808 15:48:23.685117 20663 tablet_replica.cc:330] T f365863d71464a848c252fd33c13b2b6 P c78d5dc9a56f4ccc8ad8a9486ef2d9ad: stopping tablet replica
I20260808 15:48:23.685160 20538 tablet_service.cc:1514] Processing DeleteTablet for tablet f365863d71464a848c252fd33c13b2b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:48:23 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:51322
I20260808 15:48:23.685470 20663 raft_consensus.cc:2229] T f365863d71464a848c252fd33c13b2b6 P c78d5dc9a56f4ccc8ad8a9486ef2d9ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:48:23.685935 20663 raft_consensus.cc:2258] T f365863d71464a848c252fd33c13b2b6 P c78d5dc9a56f4ccc8ad8a9486ef2d9ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:48:23.686424 20662 tablet_replica.cc:330] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55: stopping tablet replica
I20260808 15:48:23.686458 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 20194
I20260808 15:48:23.686815 20662 raft_consensus.cc:2229] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:48:23.687773 20662 raft_consensus.cc:2258] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:48:23.692500 20664 tablet_replica.cc:330] T f365863d71464a848c252fd33c13b2b6 P 96fb011dd9fc4003a2b40f1eb3edc082: stopping tablet replica
I20260808 15:48:23.692894 20664 raft_consensus.cc:2229] T f365863d71464a848c252fd33c13b2b6 P 96fb011dd9fc4003a2b40f1eb3edc082 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:48:23.693261 20664 raft_consensus.cc:2258] T f365863d71464a848c252fd33c13b2b6 P 96fb011dd9fc4003a2b40f1eb3edc082 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:48:23.695165 20664 ts_tablet_manager.cc:1905] T f365863d71464a848c252fd33c13b2b6 P 96fb011dd9fc4003a2b40f1eb3edc082: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:48:23.698563 20664 ts_tablet_manager.cc:1918] T f365863d71464a848c252fd33c13b2b6 P 96fb011dd9fc4003a2b40f1eb3edc082: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:48:23.698757 20664 log.cc:1196] T f365863d71464a848c252fd33c13b2b6 P 96fb011dd9fc4003a2b40f1eb3edc082: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/f365863d71464a848c252fd33c13b2b6
I20260808 15:48:23.699219 20664 ts_tablet_manager.cc:1939] T f365863d71464a848c252fd33c13b2b6 P 96fb011dd9fc4003a2b40f1eb3edc082: Deleting consensus metadata
I20260808 15:48:23.699956 20662 ts_tablet_manager.cc:1905] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:48:23.700770 20097 catalog_manager.cc:4841] TS 96fb011dd9fc4003a2b40f1eb3edc082 (127.8.39.67:42857): tablet f365863d71464a848c252fd33c13b2b6 (table test-table [id=31fbe7bb4b674cc4acefc54b2b2c8cdf]) successfully deleted
I20260808 15:48:23.709733 20662 ts_tablet_manager.cc:1918] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:48:23.709874 20662 log.cc:1196] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786203987027663-8349-0/minicluster-data/ts-1/wal/wals/f365863d71464a848c252fd33c13b2b6
I20260808 15:48:23.710179 20662 ts_tablet_manager.cc:1939] T f365863d71464a848c252fd33c13b2b6 P 5e22d982027c4100a7f92e6d24f45e55: Deleting consensus metadata
W20260808 15:48:23.710996 20099 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.39.65:36553 (error 108)
I20260808 15:48:23.711520 20097 catalog_manager.cc:4841] TS 5e22d982027c4100a7f92e6d24f45e55 (127.8.39.66:37143): tablet f365863d71464a848c252fd33c13b2b6 (table test-table [id=31fbe7bb4b674cc4acefc54b2b2c8cdf]) successfully deleted
I20260808 15:48:23.712066 20621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:48:23.711774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:36553 (local address 127.0.0.1:57382)
0808 15:48:23.711898 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 15:48:23.711968 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.65:36553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 15:48:23.712263 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 20336
W20260808 15:48:23.712260 20099 catalog_manager.cc:4584] TS c78d5dc9a56f4ccc8ad8a9486ef2d9ad (127.8.39.65:36553): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f365863d71464a848c252fd33c13b2b6: Network error: Client connection negotiation failed: client connection to 127.8.39.65:36553: connect: Connection refused (error 111)
I20260808 15:48:23.726337 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 20474
I20260808 15:48:23.735148 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 20079
I20260808 15:48:23.743198 8349 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 15:48:24.088671 8349 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 15:48:24.088816 8349 mini_ranger.cc:66] Stopping Ranger...
I20260808 15:48:24.444955 8349 mini_ranger.cc:68] Stopped Ranger
2026-08-08 15:48:24.445 UTC [19641] LOG: received smart shutdown request
2026-08-08 15:48:24.449 UTC [19641] LOG: background worker "logical replication launcher" (PID 19650) exited with exit code 1
2026-08-08 15:48:24.449 UTC [19645] LOG: shutting down
2026-08-08 15:48:24.634 UTC [19641] LOG: database system is shut down
2026-08-08T15:48:24Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (51199 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:48:24 dist-test-slave-8tdl krb5kdc[20674](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:48:24 dist-test-slave-8tdl krb5kdc[20674](info): set up 2 sockets
Aug 08 15:48:24 dist-test-slave-8tdl krb5kdc[20674](info): commencing operation
krb5kdc: starting...
W20260808 15:48:25.908257 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:48:25 dist-test-slave-8tdl krb5kdc[20674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204105, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:48:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:48:26Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.8.39.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.8.39.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.8.39.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/rangeradmin_127.8.39.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.8.39.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/rangeradmin_127.8.39.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.8.39.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.8.39.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.8.39.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/rangerlookup_127.8.39.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.8.39.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/rangerlookup_127.8.39.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.8.39.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.8.39.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.8.39.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/HTTP_127.8.39.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.8.39.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/HTTP_127.8.39.84@KRBTEST.COM.keytab.
I20260808 15:48:26.094368 8349 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskCGl7YH/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/postgres -l logfile start
2026-08-08 15:48:28.764 UTC [20706] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 15:48:28.764 UTC [20706] LOG: listening on IPv4 address "127.8.39.84", port 48221
2026-08-08 15:48:28.768 UTC [20706] LOG: listening on Unix socket "/tmp/.s.PGSQL.48221"
2026-08-08 15:48:28.791 UTC [20709] LOG: database system was shut down at 2026-08-08 15:48:27 UTC
2026-08-08 15:48:28.795 UTC [20706] LOG: database system is ready to accept connections
I20260808 15:48:29.784878 8349 mini_postgres.cc:96] Postgres bound to 48221
2026-08-08 15:48:29.792 UTC [20717] FATAL: database "slave" does not exist
127.8.39.84:48221 - accepting connections
I20260808 15:48:29.793011 8349 mini_ranger.cc:161] Starting Ranger...
I20260808 15:48:29.809118 8349 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 15:48:30.318289 8349 mini_ranger.cc:87] Created ranger Postgres database
I20260808 15:48:30.318362 8349 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ranger-admin
2026-08-08 15:48:30,600 [I] DB FLAVOR :POSTGRES
2026-08-08 15:48:30,600 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 15:48:30,601 [I] Checking connection..
2026-08-08 15:48:30,601 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:48221/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 15:48:30,878 [I] Checking connection passed.
2026-08-08 15:48:30,879 [I] --------- Verifying version history table ---------
2026-08-08 15:48:30,879 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:48221/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 15:48:31,166 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 15:48:31,166 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:48221/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 15:48:31,423 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 15:48:31,423 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 15:48:31,423 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:48221/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 15:48:31.688 UTC [20783] WARNING: there is no transaction in progress
2026-08-08 15:48:31,697 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 15:48:31,697 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:48221/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 15:48:31,942 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 15:48:31,943 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 15:48:31,943 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:48221/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 15:48:32,207 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:48221/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 15:48:32,483 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:48221/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-8tdl.c.gcp-upstream.internal','N') ;"
2026-08-08 15:48:32,750 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:48221/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 15:48:33,043 [I] Table x_portal_user does not exist in database ranger
2026-08-08 15:48:33,044 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:48221/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 15:48:33,318 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 15:48:33,318 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:48221/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 15:48:33,576 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:48221/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 15:48:33,849 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 15:48:33,850 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:48221/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 15:48:34.863 UTC [20894] WARNING: there is no transaction in progress
2026-08-08 15:48:34.881 UTC [20894] WARNING: there is no transaction in progress
2026-08-08 15:48:34.897 UTC [20894] WARNING: there is no transaction in progress
2026-08-08 15:48:34.913 UTC [20894] WARNING: there is no transaction in progress
2026-08-08 15:48:34.930 UTC [20894] WARNING: there is no transaction in progress
2026-08-08 15:48:34.950 UTC [20894] WARNING: there is no transaction in progress
2026-08-08 15:48:35.011 UTC [20894] WARNING: there is no transaction in progress
2026-08-08 15:48:35.019 UTC [20894] WARNING: there is no transaction in progress
2026-08-08 15:48:35.034 UTC [20894] WARNING: there is no transaction in progress
2026-08-08 15:48:35.045 UTC [20894] WARNING: there is no transaction in progress
2026-08-08 15:48:35.055 UTC [20894] WARNING: there is no transaction in progress
2026-08-08 15:48:35.070 UTC [20894] WARNING: there is no transaction in progress
2026-08-08 15:48:35.079 UTC [20894] WARNING: there is no transaction in progress
2026-08-08 15:48:35.086 UTC [20894] WARNING: there is no transaction in progress
2026-08-08 15:48:35.093 UTC [20894] WARNING: there is no transaction in progress
2026-08-08 15:48:35.100 UTC [20894] WARNING: there is no transaction in progress
2026-08-08 15:48:35,764 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 15:48:35,764 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:48221/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 15:48:36,009 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 15:48:36,009 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:48221/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 15:48:36,274 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 15:48:36,274 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:48221/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 15:48:36,538 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 15:48:36,538 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:48221/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 15:48:36,776 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:48221/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 15:48:37,045 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:48221/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-8tdl.c.gcp-upstream.internal';"
2026-08-08 15:48:37,275 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 15:48:37,275 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:48221/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 15:48:37,544 [I] DB_PATCHES have already been applied
I20260808 15:48:37.550530 8349 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ranger-admin:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskCGl7YH/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 15:48:37.550593 8349 mini_ranger.cc:193] Using host: 127.8.39.84
I20260808 15:48:37.554970 8349 mini_ranger.cc:227] Ranger admin URL: http://127.8.39.84:34927
Aug 08, 2026 3:48:37 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 3:48:37 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 3:48:38 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 3:48:38 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 3:48:38 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 3:48:38 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 3:48:38 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 15:48:38.720132 8349 mini_ranger.cc:160] Time spent starting Ranger: real 8.927s user 0.004s sys 0.008s
Aug 08, 2026 3:49:00 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 3:49:00 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 3:49:00 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 3:49:00 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 3:49:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 3:49:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 3:49:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 3:49:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 3:49:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 3:49:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 3:49:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 3:49:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 3:49:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 3:49:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 3:49:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 3:49:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 3:49:00 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 3:49:01 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 15:49:02.148509 8349 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.8.39.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.8.39.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.8.39.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/rangerkms_127.8.39.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.8.39.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/rangerkms_127.8.39.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.8.39.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.8.39.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.8.39.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/HTTP_127.8.39.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.8.39.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/HTTP_127.8.39.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 15:49:02 dist-test-slave-8tdl krb5kdc[20674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204142, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 15:49:02.243808 8349 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 15:49:02.255107 8349 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 15:49:03.149664 8349 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 15:49:03.149744 8349 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ranger-kms
I20260808 15:49:03.149757 8349 mini_ranger_kms.cc:227] Using postgres at 127.8.39.84:48221
2026-08-08 15:49:03,329 [I] DB FLAVOR :POSTGRES
2026-08-08 15:49:03,329 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 15:49:03,329 [I] Checking connection
2026-08-08 15:49:03,329 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:48221/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 15:49:03,587 [I] connection success
2026-08-08 15:49:03,587 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 15:49:03,587 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 15:49:03,587 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:48221/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 15:49:03,862 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 15:49:03,863 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 15:49:03,863 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 15:49:03,863 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.39.84:48221/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 15:49:04,130 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 15:49:04.678821 8349 mini_ranger_kms.cc:310] Created kms service
I20260808 15:49:04.886075 8349 mini_ranger_kms.cc:326] Created kudu user
I20260808 15:49:04.935570 8349 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 15:49:04 dist-test-slave-8tdl krb5kdc[20674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204142, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.8.39.84@KRBTEST.COM
I20260808 15:49:05.394550 8349 mini_ranger_kms.cc:384] Added ranger policy
I20260808 15:49:05.394866 8349 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ranger-kms:/tmp/dist-test-taskCGl7YH/build/debug/bin/postgresql.jar:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskCGl7YH/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 15:49:05.394907 8349 mini_ranger_kms.cc:240] Using host: 127.8.39.84
I20260808 15:49:05.400409 8349 mini_ranger_kms.cc:276] Ranger KMS PID: 21083
I20260808 15:49:05.400507 8349 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.8.39.84:36997
Aug 08, 2026 3:49:06 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 3:49:06 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 3:49:06 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 3:49:06 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 3:49:06 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 3:49:06 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 15:49:07 dist-test-slave-8tdl krb5kdc[20674](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786204147, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.39.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:07.850533 8349 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.607s user 0.015s sys 0.147s
I20260808 15:49:07.850661 8349 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 15:49:07.850759 8349 mini_ranger_kms.cc:401] 127.8.39.84:36997/kms/v1/keys
Aug 08 15:49:08 dist-test-slave-8tdl krb5kdc[20674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204147, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.39.84@KRBTEST.COM for HTTP/127.8.39.84@KRBTEST.COM
Aug 08 15:49:08 dist-test-slave-8tdl krb5kdc[20674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204147, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.39.84@KRBTEST.COM for HTTP/127.8.39.84@KRBTEST.COM
Aug 08 15:49:10 dist-test-slave-8tdl krb5kdc[20674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204150, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:49:10.778649 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:46239
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:39863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:46239
--ranger_config_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.39.84:36997/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:49:10.900729 21134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:10.901091 21134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:10.901183 21134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:10.905609 21134 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:49:10.905730 21134 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:10.905771 21134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:10.905830 21134 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:49:10.905858 21134 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:49:10.912248 21134 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:39863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/wal
--ranger_kms_url=127.8.39.84:36997/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:46239
--ranger_config_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:46239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21134
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:10.913493 21134 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:10.914558 21134 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:49:10.924628 21142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:10.924660 21139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:10.925007 21140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:10.925227 21134 server_base.cc:1034] running on GCE node
I20260808 15:49:10.925823 21134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:10.927163 21134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:10.928352 21134 hybrid_clock.cc:648] HybridClock initialized: now 1786204150928328 us; error 43 us; skew 500 ppm
Aug 08 15:49:10 dist-test-slave-8tdl krb5kdc[20674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204150, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:10.931568 21134 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:49:10.932752 21134 webserver.cc:460] Webserver started at http://127.8.39.126:34179/ using document root <none> and password file <none>
I20260808 15:49:10.933458 21134 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:10.933540 21134 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:49:10.933768 21134 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 15:49:10 dist-test-slave-8tdl krb5kdc[20674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204150, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for HTTP/127.8.39.84@KRBTEST.COM
I20260808 15:49:10.992501 21134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "c9d2d2f0d4bf4b658ef8c3292ab79e67"
format_stamp: "Formatted at 2026-08-08 15:49:10 on dist-test-slave-8tdl"
server_key: "917cd318232de4ee3f40e882a9637c22"
server_key_iv: "4bb620e0d3707b2c8c9e11d2f19a3102"
server_key_version: "kuduclusterkey@0"
I20260808 15:49:10.993309 21134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "c9d2d2f0d4bf4b658ef8c3292ab79e67"
format_stamp: "Formatted at 2026-08-08 15:49:10 on dist-test-slave-8tdl"
server_key: "917cd318232de4ee3f40e882a9637c22"
server_key_iv: "4bb620e0d3707b2c8c9e11d2f19a3102"
server_key_version: "kuduclusterkey@0"
I20260808 15:49:10.998437 21134 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 15:49:11.019239 21149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:11.021121 21134 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 15:49:11.021276 21134 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "c9d2d2f0d4bf4b658ef8c3292ab79e67"
format_stamp: "Formatted at 2026-08-08 15:49:10 on dist-test-slave-8tdl"
server_key: "917cd318232de4ee3f40e882a9637c22"
server_key_iv: "4bb620e0d3707b2c8c9e11d2f19a3102"
server_key_version: "kuduclusterkey@0"
I20260808 15:49:11.021433 21134 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:11.045583 21134 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:11.049654 21134 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:11.049891 21134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:11.059403 21134 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:46239
I20260808 15:49:11.059446 21203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:46239 every 8 connection(s)
I20260808 15:49:11.060801 21134 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:49:11.064010 21204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:49:11.069125 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 21134
I20260808 15:49:11.069288 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:49:11.069662 8349 external_mini_cluster.cc:1428] Setting key bb56f9320907cec4156ac2a883495608
I20260808 15:49:11.070389 21204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67: Bootstrap starting.
I20260808 15:49:11.072959 21204 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67: Neither blocks nor log segments found. Creating new log.
I20260808 15:49:11.073843 21204 log.cc:824] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67: Log is configured to *not* fsync() on all Append() calls
I20260808 15:49:11.076436 21204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67: No bootstrap required, opened a new log
Aug 08 15:49:11 dist-test-slave-8tdl krb5kdc[20674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204150, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:49:11.081061 21204 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d2d2f0d4bf4b658ef8c3292ab79e67" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 46239 } }
I20260808 15:49:11.081382 21204 raft_consensus.cc:374] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:49:11.081439 21204 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2d2f0d4bf4b658ef8c3292ab79e67, State: Initialized, Role: FOLLOWER
I20260808 15:49:11.081976 21204 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d2d2f0d4bf4b658ef8c3292ab79e67" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 46239 } }
I20260808 15:49:11.082170 21204 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:49:11.082250 21204 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:49:11.082363 21204 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:49:11.083781 21204 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d2d2f0d4bf4b658ef8c3292ab79e67" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 46239 } }
I20260808 15:49:11.084152 21204 leader_election.cc:302] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9d2d2f0d4bf4b658ef8c3292ab79e67; no voters:
I20260808 15:49:11.084561 21204 leader_election.cc:288] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:49:11.084692 21209 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:49:11.085031 21209 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [term 1 LEADER]: Becoming Leader. State: Replica: c9d2d2f0d4bf4b658ef8c3292ab79e67, State: Running, Role: LEADER
I20260808 15:49:11.085409 21209 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d2d2f0d4bf4b658ef8c3292ab79e67" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 46239 } }
I20260808 15:49:11.086023 21204 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:49:11.087280 21211 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9d2d2f0d4bf4b658ef8c3292ab79e67. Latest consensus state: current_term: 1 leader_uuid: "c9d2d2f0d4bf4b658ef8c3292ab79e67" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d2d2f0d4bf4b658ef8c3292ab79e67" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 46239 } } }
I20260808 15:49:11.087343 21207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:11.071269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51232 (local address 127.8.39.126:46239)
0808 15:49:11.071783 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:11.071803 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:11.071848 (+ 45us) server_negotiation.cc:407] Connection header received
0808 15:49:11.072771 (+ 923us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:11.072797 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:11.073245 (+ 448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:11.073625 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:11.074589 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:11.076069 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:11.077359 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:11.078133 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:11.078350 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:11.081244 (+ 2894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:11.081250 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:11.081267 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:11.081302 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:11.083636 (+ 2334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:11.084253 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:11.084261 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:11.084268 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:11.084404 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:11.084864 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:11.084867 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:11.084869 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:11.085391 (+ 522us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:11.085598 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:11.085910 (+ 312us) server_negotiation.cc:299] Negotiation successful
0808 15:49:11.086223 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":152,"threads_started":1}
I20260808 15:49:11.087426 21211 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [sys.catalog]: This master's current role is: LEADER
I20260808 15:49:11.087752 21210 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9d2d2f0d4bf4b658ef8c3292ab79e67" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d2d2f0d4bf4b658ef8c3292ab79e67" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 46239 } } }
I20260808 15:49:11.087832 21210 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [sys.catalog]: This master's current role is: LEADER
I20260808 15:49:11.088372 21204 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 15:49:11.089612 21218 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:49:11.096135 21218 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:49:11.103696 21218 catalog_manager.cc:1347] Generated new cluster ID: 227f14b0f9684a739250ba956daab71c
I20260808 15:49:11.103822 21218 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:49:11.115243 21218 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:49:11.116276 21218 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:49:11.122706 21218 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67: Generated new TSK 0
I20260808 15:49:11.123540 21218 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.39.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
I20260808 15:49:11.878162 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.39.84:36997/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:0
--local_ip_for_outbound_sockets=127.8.39.65
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:46239
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:39863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:49:12.023545 21253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:12.023940 21253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:12.024024 21253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:12.028882 21253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:12.028978 21253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:12.029086 21253 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:49:12.034577 21253 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:39863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.8.39.84:36997/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:46239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21253
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:12.035825 21253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:12.036993 21253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:49:12.046897 21260 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:12.046921 21263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:12.047000 21261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:12.047722 21253 server_base.cc:1034] running on GCE node
I20260808 15:49:12.048182 21253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:12.048964 21253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:12.050149 21253 hybrid_clock.cc:648] HybridClock initialized: now 1786204152050119 us; error 48 us; skew 500 ppm
Aug 08 15:49:12 dist-test-slave-8tdl krb5kdc[20674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204152, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:12.053308 21253 init.cc:377] Logged in from keytab as kudu/127.8.39.65@KRBTEST.COM (short username kudu)
I20260808 15:49:12.054560 21253 webserver.cc:460] Webserver started at http://127.8.39.65:43721/ using document root <none> and password file <none>
I20260808 15:49:12.055423 21253 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:12.055576 21253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:49:12.055888 21253 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 15:49:12 dist-test-slave-8tdl krb5kdc[20674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204152, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for HTTP/127.8.39.84@KRBTEST.COM
I20260808 15:49:12.077299 21253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/data/instance:
uuid: "b445e96e0fe04a4486165f451697ff9b"
format_stamp: "Formatted at 2026-08-08 15:49:12 on dist-test-slave-8tdl"
server_key: "f4065ee1750042e0487d5c5ed498091c"
server_key_iv: "81163844866074fbfeaccd6f8d023ccd"
server_key_version: "kuduclusterkey@0"
I20260808 15:49:12.078205 21253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance:
uuid: "b445e96e0fe04a4486165f451697ff9b"
format_stamp: "Formatted at 2026-08-08 15:49:12 on dist-test-slave-8tdl"
server_key: "f4065ee1750042e0487d5c5ed498091c"
server_key_iv: "81163844866074fbfeaccd6f8d023ccd"
server_key_version: "kuduclusterkey@0"
I20260808 15:49:12.083587 21253 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 15:49:12.112356 21272 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:12.113977 21253 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 15:49:12.114147 21253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "b445e96e0fe04a4486165f451697ff9b"
format_stamp: "Formatted at 2026-08-08 15:49:12 on dist-test-slave-8tdl"
server_key: "f4065ee1750042e0487d5c5ed498091c"
server_key_iv: "81163844866074fbfeaccd6f8d023ccd"
server_key_version: "kuduclusterkey@0"
I20260808 15:49:12.114331 21253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:12.153282 21253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:12.157387 21253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:12.157608 21253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:12.158421 21253 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:49:12.159623 21253 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:49:12.159698 21253 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:12.159758 21253 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:49:12.159842 21253 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260808 15:49:12.172004 21253 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:41869
I20260808 15:49:12.172068 21391 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:41869 every 8 connection(s)
I20260808 15:49:12.173395 21253 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:49:12.179459 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 21253
I20260808 15:49:12.179634 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance
I20260808 15:49:12.179997 8349 external_mini_cluster.cc:1428] Setting key de2c74cb5f2a68ca62577674feb22336
Aug 08 15:49:12 dist-test-slave-8tdl krb5kdc[20674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204152, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.39.66@KRBTEST.COM; defaulting to no policy
I20260808 15:49:12.197257 21394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:12.176292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:46239 (local address 127.8.39.65:58615)
0808 15:49:12.176928 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:12.176991 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:12.178100 (+ 1109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:12.178782 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:12.178792 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:12.180452 (+ 1660us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:12.181183 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:12.181205 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:12.185136 (+ 3931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:12.185140 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:12.186668 (+ 1528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:12.186702 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:12.187820 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:12.187824 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:12.188072 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:12.188834 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:12.188860 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:12.190902 (+ 2042us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:12.193507 (+ 2605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:12.193514 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:12.193534 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:12.193932 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:12.194298 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:12.194302 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:12.194304 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:12.194500 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:12.195093 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:12.195100 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:12.195478 (+ 378us) client_negotiation.cc:769] Sending connection context
0808 15:49:12.195700 (+ 222us) client_negotiation.cc:240] Negotiation successful
0808 15:49:12.196082 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":165,"threads_started":1}
I20260808 15:49:12.198470 21395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:12.177562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:58615 (local address 127.8.39.126:46239)
0808 15:49:12.177816 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:12.177821 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:12.177838 (+ 17us) server_negotiation.cc:407] Connection header received
0808 15:49:12.178356 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:12.178360 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:12.178421 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:12.178534 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:12.181380 (+ 2846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:12.184940 (+ 3560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:12.187222 (+ 2282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:12.187601 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:12.188467 (+ 866us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:12.191131 (+ 2664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:12.191135 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:12.191138 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:12.191168 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:12.193344 (+ 2176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:12.194080 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:12.194084 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:12.194086 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:12.194183 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:12.194629 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:12.194633 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:12.194635 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:12.194945 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:12.198026 (+ 3081us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:12.198124 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 15:49:12.198276 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":90,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.66@KRBTEST.COM" created.
I20260808 15:49:12.200539 21392 heartbeater.cc:347] Connected to a master server at 127.8.39.126:46239
I20260808 15:49:12.200809 21392 heartbeater.cc:464] Registering TS with master...
I20260808 15:49:12.201406 21392 heartbeater.cc:511] Master 127.8.39.126:46239 requested a full tablet report, sending...
I20260808 15:49:12.203410 21165 ts_manager.cc:194] Registered new tserver with Master: b445e96e0fe04a4486165f451697ff9b (127.8.39.65:41869)
I20260808 15:49:12.204617 21165 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.65@KRBTEST.COM'} at 127.8.39.65:58615
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
Aug 08 15:49:12 dist-test-slave-8tdl krb5kdc[20674](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786204152, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:12.220994 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.39.84:36997/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:0
--local_ip_for_outbound_sockets=127.8.39.66
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:46239
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:39863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:49:12.371537 21399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:12.371845 21399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:12.371932 21399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:12.376645 21399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:12.376763 21399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:12.376888 21399 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:49:12.384333 21399 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:39863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.8.39.84:36997/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:46239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21399
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:12.385733 21399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:12.387356 21399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:49:12.399426 21408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:12.399536 21405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:12.399400 21406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:12.401073 21399 server_base.cc:1034] running on GCE node
I20260808 15:49:12.401630 21399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:12.402422 21399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:12.404891 21399 hybrid_clock.cc:648] HybridClock initialized: now 1786204152404863 us; error 77 us; skew 500 ppm
Aug 08 15:49:12 dist-test-slave-8tdl krb5kdc[20674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204152, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:12.408349 21399 init.cc:377] Logged in from keytab as kudu/127.8.39.66@KRBTEST.COM (short username kudu)
I20260808 15:49:12.409360 21399 webserver.cc:460] Webserver started at http://127.8.39.66:36891/ using document root <none> and password file <none>
I20260808 15:49:12.410029 21399 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:12.410136 21399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:49:12.410369 21399 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 15:49:12 dist-test-slave-8tdl krb5kdc[20674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204152, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for HTTP/127.8.39.84@KRBTEST.COM
I20260808 15:49:12.441598 21399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/data/instance:
uuid: "206d2c63287243fc99e788367bcee971"
format_stamp: "Formatted at 2026-08-08 15:49:12 on dist-test-slave-8tdl"
server_key: "8490fc8b03342778e0b71bb9b379f643"
server_key_iv: "146805d2b86164a9193dc8317cc71cca"
server_key_version: "kuduclusterkey@0"
I20260808 15:49:12.442536 21399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance:
uuid: "206d2c63287243fc99e788367bcee971"
format_stamp: "Formatted at 2026-08-08 15:49:12 on dist-test-slave-8tdl"
server_key: "8490fc8b03342778e0b71bb9b379f643"
server_key_iv: "146805d2b86164a9193dc8317cc71cca"
server_key_version: "kuduclusterkey@0"
I20260808 15:49:12.451642 21399 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 15:49:12.471369 21415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:12.473472 21399 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260808 15:49:12.473639 21399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "206d2c63287243fc99e788367bcee971"
format_stamp: "Formatted at 2026-08-08 15:49:12 on dist-test-slave-8tdl"
server_key: "8490fc8b03342778e0b71bb9b379f643"
server_key_iv: "146805d2b86164a9193dc8317cc71cca"
server_key_version: "kuduclusterkey@0"
I20260808 15:49:12.473816 21399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:12.513921 21399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:12.517915 21399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:12.518146 21399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:12.519025 21399 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:49:12.520458 21399 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:49:12.520553 21399 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:12.520633 21399 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:49:12.520663 21399 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:12.537132 21399 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:45413
I20260808 15:49:12.538460 21399 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:49:12.545975 21534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:45413 every 8 connection(s)
I20260808 15:49:12.546463 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 21399
I20260808 15:49:12.546593 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance
I20260808 15:49:12.546945 8349 external_mini_cluster.cc:1428] Setting key aebad6a1291e0d52ca9d31939953dc69
Aug 08 15:49:12 dist-test-slave-8tdl krb5kdc[20674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204152, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.39.67@KRBTEST.COM; defaulting to no policy
I20260808 15:49:12.562983 21395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:12.547790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:33397 (local address 127.8.39.126:46239)
0808 15:49:12.547936 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:12.547940 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:12.549263 (+ 1323us) server_negotiation.cc:407] Connection header received
0808 15:49:12.551181 (+ 1918us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:12.551185 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:12.551245 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:12.551345 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:12.553516 (+ 2171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:12.554443 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:12.556210 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:12.556449 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:12.556578 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:12.559111 (+ 2533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:12.559114 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:12.559116 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:12.559143 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:12.560652 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:12.561210 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:12.561214 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:12.561215 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:12.561291 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:12.561753 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:12.561755 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:12.561756 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:12.561942 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:12.562075 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:12.562629 (+ 554us) server_negotiation.cc:299] Negotiation successful
0808 15:49:12.562801 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 15:49:12.563830 21537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:12.548364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:46239 (local address 127.8.39.66:33397)
0808 15:49:12.549080 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:12.549150 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:12.550895 (+ 1745us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:12.551684 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:12.551694 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:12.552284 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:12.553313 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:12.553338 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:12.554621 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:12.554625 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:12.556074 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:12.556085 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:12.556625 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:12.556629 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:12.556807 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:12.557464 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:12.557482 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:12.558920 (+ 1438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:12.560783 (+ 1863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:12.560789 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:12.560806 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:12.561089 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:12.561388 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:12.561392 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:12.561394 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:12.561567 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:12.562076 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:12.562084 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:12.562375 (+ 291us) client_negotiation.cc:769] Sending connection context
0808 15:49:12.562574 (+ 199us) client_negotiation.cc:240] Negotiation successful
0808 15:49:12.562935 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":165,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.67@KRBTEST.COM" created.
I20260808 15:49:12.565092 21535 heartbeater.cc:347] Connected to a master server at 127.8.39.126:46239
I20260808 15:49:12.565338 21535 heartbeater.cc:464] Registering TS with master...
I20260808 15:49:12.565873 21535 heartbeater.cc:511] Master 127.8.39.126:46239 requested a full tablet report, sending...
I20260808 15:49:12.566956 21165 ts_manager.cc:194] Registered new tserver with Master: 206d2c63287243fc99e788367bcee971 (127.8.39.66:45413)
I20260808 15:49:12.567768 21165 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.66@KRBTEST.COM'} at 127.8.39.66:33397
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
I20260808 15:49:12.587123 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.39.84:36997/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:0
--local_ip_for_outbound_sockets=127.8.39.67
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:46239
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:39863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 15:49:12 dist-test-slave-8tdl krb5kdc[20674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204152, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for HTTP/127.8.39.84@KRBTEST.COM
W20260808 15:49:12.785238 21540 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:12.785676 21540 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:12.785753 21540 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:12.793284 21540 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:12.793385 21540 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:12.793483 21540 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:49:12.802500 21540 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:39863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.8.39.84:36997/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:46239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21540
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:12.804281 21540 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:12.805995 21540 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:49:12.819111 21547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:12.819535 21549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:12.820925 21540 server_base.cc:1034] running on GCE node
W20260808 15:49:12.822885 21545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:12.823578 21540 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:12.824488 21540 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:12.840130 21540 hybrid_clock.cc:648] HybridClock initialized: now 1786204152840003 us; error 149 us; skew 500 ppm
Aug 08 15:49:12 dist-test-slave-8tdl krb5kdc[20674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204152, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:12.845134 21540 init.cc:377] Logged in from keytab as kudu/127.8.39.67@KRBTEST.COM (short username kudu)
I20260808 15:49:12.846645 21540 webserver.cc:460] Webserver started at http://127.8.39.67:43569/ using document root <none> and password file <none>
I20260808 15:49:12.847540 21540 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:12.847728 21540 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:49:12.848098 21540 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 15:49:12 dist-test-slave-8tdl krb5kdc[20674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204152, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for HTTP/127.8.39.84@KRBTEST.COM
I20260808 15:49:12.884541 21540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/data/instance:
uuid: "d4d4fbb938f249e3944300e431550389"
format_stamp: "Formatted at 2026-08-08 15:49:12 on dist-test-slave-8tdl"
server_key: "bb5affbdf605444ef0fb0b1a3e78a2bd"
server_key_iv: "afcb0cb6277fd8ef0ecea4ac38554709"
server_key_version: "kuduclusterkey@0"
I20260808 15:49:12.885341 21540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance:
uuid: "d4d4fbb938f249e3944300e431550389"
format_stamp: "Formatted at 2026-08-08 15:49:12 on dist-test-slave-8tdl"
server_key: "bb5affbdf605444ef0fb0b1a3e78a2bd"
server_key_iv: "afcb0cb6277fd8ef0ecea4ac38554709"
server_key_version: "kuduclusterkey@0"
I20260808 15:49:12.890509 21540 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260808 15:49:12.909467 21556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:12.911433 21540 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260808 15:49:12.911615 21540 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "d4d4fbb938f249e3944300e431550389"
format_stamp: "Formatted at 2026-08-08 15:49:12 on dist-test-slave-8tdl"
server_key: "bb5affbdf605444ef0fb0b1a3e78a2bd"
server_key_iv: "afcb0cb6277fd8ef0ecea4ac38554709"
server_key_version: "kuduclusterkey@0"
I20260808 15:49:12.911772 21540 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:12.929512 21540 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:12.933840 21540 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:12.934154 21540 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:12.935228 21540 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:49:12.936653 21540 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:49:12.936733 21540 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:12.936916 21540 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:49:12.936980 21540 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:12.954149 21540 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:35541
I20260808 15:49:12.954507 21675 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:35541 every 8 connection(s)
I20260808 15:49:12.955641 21540 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:49:12.957414 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 21540
I20260808 15:49:12.957556 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance
I20260808 15:49:12.957896 8349 external_mini_cluster.cc:1428] Setting key 9170d597dc2f6e64dad1213014528897
Aug 08 15:49:12 dist-test-slave-8tdl krb5kdc[20674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204152, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:49:12.976213 21395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:12.958014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:34557 (local address 127.8.39.126:46239)
0808 15:49:12.958162 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:12.958166 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:12.960930 (+ 2764us) server_negotiation.cc:407] Connection header received
0808 15:49:12.962528 (+ 1598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:12.962533 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:12.962591 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:12.962641 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:12.964381 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:12.965253 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:12.967153 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:12.967494 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:12.967584 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:12.971655 (+ 4071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:12.971659 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:12.971662 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:12.971694 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:12.973465 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:12.974269 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:12.974272 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:12.974274 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:12.974365 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:12.974872 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:12.974876 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:12.974878 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:12.975126 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:12.975220 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:12.975926 (+ 706us) server_negotiation.cc:299] Negotiation successful
0808 15:49:12.976052 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 15:49:12.977451 21678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:12.958534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:46239 (local address 127.8.39.67:34557)
0808 15:49:12.960755 (+ 2221us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:12.960818 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:12.962255 (+ 1437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:12.963107 (+ 852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:12.963117 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:12.963502 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:12.964203 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:12.964224 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:12.965446 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:12.965449 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:12.967004 (+ 1555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:12.967016 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:12.967829 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:12.967834 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:12.968333 (+ 499us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:12.969285 (+ 952us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:12.969309 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:12.971438 (+ 2129us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:12.973605 (+ 2167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:12.973612 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:12.973631 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:12.974144 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:12.974470 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:12.974473 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:12.974475 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:12.974735 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:12.975251 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:12.975257 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:12.975624 (+ 367us) client_negotiation.cc:769] Sending connection context
0808 15:49:12.975863 (+ 239us) client_negotiation.cc:240] Negotiation successful
0808 15:49:12.976222 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1959,"thread_start_us":158,"threads_started":1}
I20260808 15:49:12.978982 21676 heartbeater.cc:347] Connected to a master server at 127.8.39.126:46239
I20260808 15:49:12.979243 21676 heartbeater.cc:464] Registering TS with master...
I20260808 15:49:12.979920 21676 heartbeater.cc:511] Master 127.8.39.126:46239 requested a full tablet report, sending...
I20260808 15:49:12.981142 21165 ts_manager.cc:194] Registered new tserver with Master: d4d4fbb938f249e3944300e431550389 (127.8.39.67:35541)
I20260808 15:49:12.981907 21165 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.67@KRBTEST.COM'} at 127.8.39.67:34557
I20260808 15:49:12.984004 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:49:12.984897 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 21253
I20260808 15:49:12.999320 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 21399
I20260808 15:49:13.010214 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 21540
I20260808 15:49:13.019780 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 21134
I20260808 15:49:13.027771 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:46239
--webserver_interface=127.8.39.126
--webserver_port=34179
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:39863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:46239
--ranger_config_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.39.84:36997/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.8.39.84:36997/kms with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:49:13.142601 21679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:13.142933 21679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:13.142975 21679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:13.147099 21679 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:49:13.147167 21679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:13.147186 21679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:13.147203 21679 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:49:13.147218 21679 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:49:13.152802 21679 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:39863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.8.39.84:36997/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:46239
--ranger_config_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:46239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=34179
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21679
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:13.153842 21679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:13.155119 21679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:49:13.163688 21687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:13.163733 21684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:13.163704 21685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:13.163957 21679 server_base.cc:1034] running on GCE node
I20260808 15:49:13.164549 21679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:13.165597 21679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:13.166787 21679 hybrid_clock.cc:648] HybridClock initialized: now 1786204153166756 us; error 33 us; skew 500 ppm
Aug 08 15:49:13 dist-test-slave-8tdl krb5kdc[20674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204153, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:13.169885 21679 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:49:13.171018 21679 webserver.cc:460] Webserver started at http://127.8.39.126:34179/ using document root <none> and password file <none>
I20260808 15:49:13.171622 21679 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:13.171725 21679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 15:49:13 dist-test-slave-8tdl krb5kdc[20674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204153, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for HTTP/127.8.39.84@KRBTEST.COM
I20260808 15:49:13.253334 21679 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:49:13.255925 21696 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:13.257404 21679 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:49:13.257571 21679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "c9d2d2f0d4bf4b658ef8c3292ab79e67"
format_stamp: "Formatted at 2026-08-08 15:49:10 on dist-test-slave-8tdl"
server_key: "917cd318232de4ee3f40e882a9637c22"
server_key_iv: "4bb620e0d3707b2c8c9e11d2f19a3102"
server_key_version: "kuduclusterkey@0"
I20260808 15:49:13.258249 21679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:13.292922 21679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:13.296008 21679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:13.296280 21679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:13.304402 21679 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:46239
I20260808 15:49:13.304425 21749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:46239 every 8 connection(s)
I20260808 15:49:13.305665 21679 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:49:13.307047 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 21679
I20260808 15:49:13.307545 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.39.84:36997/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:41869
--local_ip_for_outbound_sockets=127.8.39.65
--tserver_master_addrs=127.8.39.126:46239
--webserver_port=43721
--webserver_interface=127.8.39.65
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:39863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.8.39.84:36997/kms with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:49:13.310343 21750 sys_catalog.cc:263] Verifying existing consensus state
I20260808 15:49:13.312110 21750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67: Bootstrap starting.
I20260808 15:49:13.328979 21750 log.cc:824] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67: Log is configured to *not* fsync() on all Append() calls
I20260808 15:49:13.335774 21750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 15:49:13.336217 21750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67: Bootstrap complete.
I20260808 15:49:13.340565 21750 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d2d2f0d4bf4b658ef8c3292ab79e67" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 46239 } }
I20260808 15:49:13.340988 21750 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2d2f0d4bf4b658ef8c3292ab79e67, State: Initialized, Role: FOLLOWER
I20260808 15:49:13.341480 21750 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d2d2f0d4bf4b658ef8c3292ab79e67" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 46239 } }
I20260808 15:49:13.341629 21750 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:49:13.341719 21750 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:49:13.341840 21750 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [term 1 FOLLOWER]: Advancing to term 2
I20260808 15:49:13.343914 21750 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d2d2f0d4bf4b658ef8c3292ab79e67" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 46239 } }
I20260808 15:49:13.344249 21750 leader_election.cc:302] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9d2d2f0d4bf4b658ef8c3292ab79e67; no voters:
I20260808 15:49:13.344592 21750 leader_election.cc:288] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 15:49:13.344772 21754 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 15:49:13.345041 21754 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [term 2 LEADER]: Becoming Leader. State: Replica: c9d2d2f0d4bf4b658ef8c3292ab79e67, State: Running, Role: LEADER
I20260808 15:49:13.345386 21754 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d2d2f0d4bf4b658ef8c3292ab79e67" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 46239 } }
I20260808 15:49:13.345840 21750 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:49:13.346860 21755 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c9d2d2f0d4bf4b658ef8c3292ab79e67" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d2d2f0d4bf4b658ef8c3292ab79e67" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 46239 } } }
I20260808 15:49:13.346998 21755 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [sys.catalog]: This master's current role is: LEADER
I20260808 15:49:13.347364 21756 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9d2d2f0d4bf4b658ef8c3292ab79e67. Latest consensus state: current_term: 2 leader_uuid: "c9d2d2f0d4bf4b658ef8c3292ab79e67" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d2d2f0d4bf4b658ef8c3292ab79e67" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 46239 } } }
I20260808 15:49:13.347527 21756 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67 [sys.catalog]: This master's current role is: LEADER
I20260808 15:49:13.347865 21763 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:49:13.348374 21750 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 15:49:13.354574 21763 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:49:13.355402 21763 catalog_manager.cc:1259] Loaded cluster ID: 227f14b0f9684a739250ba956daab71c
I20260808 15:49:13.355495 21763 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:49:13.358624 21763 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:49:13.359597 21763 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67: Loaded TSK: 0
I20260808 15:49:13.360958 21763 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 15:49:13.463774 21752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:13.464187 21752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:13.464254 21752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:13.471046 21752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:13.471139 21752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:13.471239 21752 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:49:13.480057 21752 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:39863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.8.39.84:36997/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:41869
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=43721
--tserver_master_addrs=127.8.39.126:46239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21752
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:13.481526 21752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:13.482960 21752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:49:13.495931 21789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:13.496207 21788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:13.496447 21752 server_base.cc:1034] running on GCE node
W20260808 15:49:13.496666 21791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:13.497184 21752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:13.498034 21752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:13.501331 21752 hybrid_clock.cc:648] HybridClock initialized: now 1786204153501251 us; error 92 us; skew 500 ppm
Aug 08 15:49:13 dist-test-slave-8tdl krb5kdc[20674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204153, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:13.505558 21752 init.cc:377] Logged in from keytab as kudu/127.8.39.65@KRBTEST.COM (short username kudu)
I20260808 15:49:13.506830 21752 webserver.cc:460] Webserver started at http://127.8.39.65:43721/ using document root <none> and password file <none>
I20260808 15:49:13.507606 21752 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:13.507732 21752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 15:49:13 dist-test-slave-8tdl krb5kdc[20674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204153, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for HTTP/127.8.39.84@KRBTEST.COM
I20260808 15:49:13.544646 21752 fs_manager.cc:709] Time spent opening directory manager: real 0.015s user 0.002s sys 0.000s
I20260808 15:49:13.560469 21799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:13.562448 21752 fs_manager.cc:725] Time spent opening block manager: real 0.016s user 0.004s sys 0.000s
I20260808 15:49:13.562618 21752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "b445e96e0fe04a4486165f451697ff9b"
format_stamp: "Formatted at 2026-08-08 15:49:12 on dist-test-slave-8tdl"
server_key: "f4065ee1750042e0487d5c5ed498091c"
server_key_iv: "81163844866074fbfeaccd6f8d023ccd"
server_key_version: "kuduclusterkey@0"
I20260808 15:49:13.563455 21752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:13.595854 21752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:13.600001 21752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:13.600231 21752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:13.601002 21752 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:49:13.602087 21752 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:49:13.602141 21752 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:13.602198 21752 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:49:13.602223 21752 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:13.615573 21752 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:41869
I20260808 15:49:13.615954 21919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:41869 every 8 connection(s)
I20260808 15:49:13.617111 21752 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:49:13.625635 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 21752
I20260808 15:49:13.626227 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.39.84:36997/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:45413
--local_ip_for_outbound_sockets=127.8.39.66
--tserver_master_addrs=127.8.39.126:46239
--webserver_port=36891
--webserver_interface=127.8.39.66
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:39863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.8.39.84:36997/kms with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 15:49:13 dist-test-slave-8tdl krb5kdc[20674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204153, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:49:13.657617 21922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:13.624227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:46239 (local address 127.8.39.65:60825)
0808 15:49:13.630380 (+ 6153us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:13.630454 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:13.631682 (+ 1228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:13.634778 (+ 3096us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:13.634788 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:13.635217 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:13.635937 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:13.635962 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:13.641321 (+ 5359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:13.641327 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:13.643080 (+ 1753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:13.643102 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:13.644747 (+ 1645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:13.644755 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:13.645028 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:13.645889 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:13.645921 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:13.650286 (+ 4365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:13.653486 (+ 3200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:13.653497 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:13.653517 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:13.653931 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:13.654386 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:13.654389 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:13.654391 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:13.654571 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:13.655479 (+ 908us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:13.655488 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:13.655846 (+ 358us) client_negotiation.cc:769] Sending connection context
0808 15:49:13.656058 (+ 212us) client_negotiation.cc:240] Negotiation successful
0808 15:49:13.656448 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5865,"thread_start_us":181,"threads_started":1}
I20260808 15:49:13.660712 21924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:13.629191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:60825 (local address 127.8.39.126:46239)
0808 15:49:13.632850 (+ 3659us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:13.632878 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:13.632934 (+ 56us) server_negotiation.cc:407] Connection header received
0808 15:49:13.633266 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:13.633282 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:13.633773 (+ 491us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:13.634186 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:13.639217 (+ 5031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:13.641090 (+ 1873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:13.643300 (+ 2210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:13.644238 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:13.644448 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:13.650622 (+ 6174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:13.650632 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:13.650656 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:13.650734 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:13.653304 (+ 2570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:13.654095 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:13.654102 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:13.654108 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:13.654266 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:13.654738 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:13.654741 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:13.654744 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:13.655320 (+ 576us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:13.658999 (+ 3679us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:13.659219 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 15:49:13.659593 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3470,"thread_start_us":155,"threads_started":1}
I20260808 15:49:13.664188 21920 heartbeater.cc:347] Connected to a master server at 127.8.39.126:46239
I20260808 15:49:13.664500 21920 heartbeater.cc:464] Registering TS with master...
I20260808 15:49:13.665109 21920 heartbeater.cc:511] Master 127.8.39.126:46239 requested a full tablet report, sending...
W20260808 15:49:13.667737 21920 heartbeater.cc:644] Failed to heartbeat to 127.8.39.126:46239 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 15:49:13.667896 21920 heartbeater.cc:464] Registering TS with master...
I20260808 15:49:13.668160 21920 heartbeater.cc:511] Master 127.8.39.126:46239 requested a full tablet report, sending...
I20260808 15:49:13.669376 21920 heartbeater.cc:464] Registering TS with master...
I20260808 15:49:13.669600 21920 heartbeater.cc:511] Master 127.8.39.126:46239 requested a full tablet report, sending...
W20260808 15:49:13.670624 21920 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 15:49:13.824926 21923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:13.825383 21923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:13.825484 21923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:13.832774 21923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:13.832882 21923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:13.832999 21923 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:49:13.842517 21923 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:39863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.8.39.84:36997/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:45413
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=36891
--tserver_master_addrs=127.8.39.126:46239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:13.844157 21923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:13.845727 21923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:49:13.861452 21933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:13.861622 21931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:13.862005 21930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:13.862578 21923 server_base.cc:1034] running on GCE node
I20260808 15:49:13.863497 21923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:13.864456 21923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:13.865717 21923 hybrid_clock.cc:648] HybridClock initialized: now 1786204153865631 us; error 102 us; skew 500 ppm
Aug 08 15:49:13 dist-test-slave-8tdl krb5kdc[20674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204153, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:13.870074 21923 init.cc:377] Logged in from keytab as kudu/127.8.39.66@KRBTEST.COM (short username kudu)
I20260808 15:49:13.871313 21923 webserver.cc:460] Webserver started at http://127.8.39.66:36891/ using document root <none> and password file <none>
I20260808 15:49:13.872136 21923 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:13.872265 21923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 15:49:13 dist-test-slave-8tdl krb5kdc[20674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204153, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for HTTP/127.8.39.84@KRBTEST.COM
I20260808 15:49:13.891839 21923 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:49:13.894956 21941 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:13.896529 21923 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:49:13.896685 21923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "206d2c63287243fc99e788367bcee971"
format_stamp: "Formatted at 2026-08-08 15:49:12 on dist-test-slave-8tdl"
server_key: "8490fc8b03342778e0b71bb9b379f643"
server_key_iv: "146805d2b86164a9193dc8317cc71cca"
server_key_version: "kuduclusterkey@0"
I20260808 15:49:13.897302 21923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:13.918929 21923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:13.923157 21923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:13.923389 21923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:13.924227 21923 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:49:13.925345 21923 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:49:13.925426 21923 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:13.925480 21923 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:49:13.925510 21923 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:13.937098 21923 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:45413
I20260808 15:49:13.937134 22060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:45413 every 8 connection(s)
I20260808 15:49:13.938428 21923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:49:13.945154 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 21923
I20260808 15:49:13.945698 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.39.84:36997/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:35541
--local_ip_for_outbound_sockets=127.8.39.67
--tserver_master_addrs=127.8.39.126:46239
--webserver_port=43569
--webserver_interface=127.8.39.67
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:39863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.8.39.84:36997/kms with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 15:49:13 dist-test-slave-8tdl krb5kdc[20674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204153, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:49:13.959124 21924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:13.941560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:37053 (local address 127.8.39.126:46239)
0808 15:49:13.941713 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:13.941717 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:13.942911 (+ 1194us) server_negotiation.cc:407] Connection header received
0808 15:49:13.944312 (+ 1401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:13.944316 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:13.944384 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:13.944484 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:13.946515 (+ 2031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:13.947510 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:13.949436 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:13.949811 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:13.949923 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:13.953198 (+ 3275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:13.953202 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:13.953205 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:13.953240 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:13.955193 (+ 1953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:13.955878 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:13.955882 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:13.955884 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:13.955976 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:13.956424 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:13.956428 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:13.956430 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:13.956664 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:13.956757 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:13.958804 (+ 2047us) server_negotiation.cc:299] Negotiation successful
0808 15:49:13.958950 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 15:49:13.959824 22063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:13.942022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:46239 (local address 127.8.39.66:37053)
0808 15:49:13.942719 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:13.942785 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:13.944021 (+ 1236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:13.944711 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:13.944721 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:13.945167 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:13.946278 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:13.946302 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:13.947728 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:13.947732 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:13.949276 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:13.949289 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:13.950123 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:13.950127 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:13.950358 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:13.951126 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:13.951146 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:13.952965 (+ 1819us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:13.955347 (+ 2382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:13.955354 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:13.955374 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:13.955747 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:13.956104 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:13.956108 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:13.956110 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:13.956308 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:13.956813 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:13.956820 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:13.957179 (+ 359us) client_negotiation.cc:769] Sending connection context
0808 15:49:13.957392 (+ 213us) client_negotiation.cc:240] Negotiation successful
0808 15:49:13.957749 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":166,"threads_started":1}
I20260808 15:49:13.961585 22061 heartbeater.cc:347] Connected to a master server at 127.8.39.126:46239
I20260808 15:49:13.961840 22061 heartbeater.cc:464] Registering TS with master...
I20260808 15:49:13.962492 22061 heartbeater.cc:511] Master 127.8.39.126:46239 requested a full tablet report, sending...
W20260808 15:49:13.964337 22061 heartbeater.cc:644] Failed to heartbeat to 127.8.39.126:46239 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 15:49:13.964463 22061 heartbeater.cc:464] Registering TS with master...
I20260808 15:49:13.964646 22061 heartbeater.cc:511] Master 127.8.39.126:46239 requested a full tablet report, sending...
I20260808 15:49:13.965555 22061 heartbeater.cc:464] Registering TS with master...
I20260808 15:49:13.965737 22061 heartbeater.cc:511] Master 127.8.39.126:46239 requested a full tablet report, sending...
W20260808 15:49:13.966526 22061 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 15:49:14.134501 22065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:14.135043 22065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:14.135150 22065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:14.142174 22065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:14.142282 22065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:14.142402 22065 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:49:14.151665 22065 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:39863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.8.39.84:36997/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:35541
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=43569
--tserver_master_addrs=127.8.39.126:46239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:14.153251 22065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:14.154753 22065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:49:14.166855 22071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:14.167042 22065 server_base.cc:1034] running on GCE node
W20260808 15:49:14.166903 22070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:14.166855 22073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:14.167900 22065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:14.168591 22065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:14.169783 22065 hybrid_clock.cc:648] HybridClock initialized: now 1786204154169756 us; error 45 us; skew 500 ppm
Aug 08 15:49:14 dist-test-slave-8tdl krb5kdc[20674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204154, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:14.173117 22065 init.cc:377] Logged in from keytab as kudu/127.8.39.67@KRBTEST.COM (short username kudu)
I20260808 15:49:14.174096 22065 webserver.cc:460] Webserver started at http://127.8.39.67:43569/ using document root <none> and password file <none>
I20260808 15:49:14.174810 22065 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:14.174953 22065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 15:49:14 dist-test-slave-8tdl krb5kdc[20674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204154, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for HTTP/127.8.39.84@KRBTEST.COM
I20260808 15:49:14.201099 22065 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.003s
I20260808 15:49:14.208616 22081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:14.210071 22065 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.003s sys 0.001s
I20260808 15:49:14.210219 22065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "d4d4fbb938f249e3944300e431550389"
format_stamp: "Formatted at 2026-08-08 15:49:12 on dist-test-slave-8tdl"
server_key: "bb5affbdf605444ef0fb0b1a3e78a2bd"
server_key_iv: "afcb0cb6277fd8ef0ecea4ac38554709"
server_key_version: "kuduclusterkey@0"
I20260808 15:49:14.210891 22065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:14.227247 22065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:14.230826 22065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:14.231046 22065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:14.231791 22065 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:49:14.232721 22065 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:49:14.232769 22065 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:14.232810 22065 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:49:14.232825 22065 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:14.244072 22065 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:35541
I20260808 15:49:14.244251 22202 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:35541 every 8 connection(s)
I20260808 15:49:14.245395 22065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:49:14.251159 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 22065
Aug 08 15:49:14 dist-test-slave-8tdl krb5kdc[20674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204154, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:49:14.262444 21924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:14.248176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:38993 (local address 127.8.39.126:46239)
0808 15:49:14.248345 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:14.248349 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:14.249461 (+ 1112us) server_negotiation.cc:407] Connection header received
0808 15:49:14.250418 (+ 957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:14.250422 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:14.250482 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:14.250596 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:14.251736 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:14.252461 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:14.254131 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:14.254357 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:14.254472 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:14.257490 (+ 3018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:14.257494 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:14.257497 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:14.257526 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:14.259457 (+ 1931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:14.260204 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:14.260208 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:14.260210 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:14.260354 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:14.260819 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:14.260822 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:14.260824 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:14.261050 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:14.261185 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:14.261960 (+ 775us) server_negotiation.cc:299] Negotiation successful
0808 15:49:14.262223 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 15:49:14.263628 22205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:14.248753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:46239 (local address 127.8.39.67:38993)
0808 15:49:14.249291 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:14.249334 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:14.250206 (+ 872us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:14.250793 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:14.250800 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:14.251088 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:14.251581 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:14.251595 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:14.252649 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:14.252653 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:14.253996 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:14.254010 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:14.254520 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:14.254524 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:14.254777 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:14.255661 (+ 884us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:14.255683 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:14.257266 (+ 1583us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:14.259613 (+ 2347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:14.259621 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:14.259641 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:14.260062 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:14.260488 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:14.260492 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:14.260494 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:14.260713 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:14.261185 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:14.261195 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:14.261603 (+ 408us) client_negotiation.cc:769] Sending connection context
0808 15:49:14.261881 (+ 278us) client_negotiation.cc:240] Negotiation successful
0808 15:49:14.262358 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":153,"threads_started":1}
I20260808 15:49:14.264927 22203 heartbeater.cc:347] Connected to a master server at 127.8.39.126:46239
I20260808 15:49:14.265202 22203 heartbeater.cc:464] Registering TS with master...
I20260808 15:49:14.265826 22203 heartbeater.cc:511] Master 127.8.39.126:46239 requested a full tablet report, sending...
W20260808 15:49:14.267452 22203 heartbeater.cc:644] Failed to heartbeat to 127.8.39.126:46239 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 15:49:14.267609 22203 heartbeater.cc:464] Registering TS with master...
I20260808 15:49:14.267793 22203 heartbeater.cc:511] Master 127.8.39.126:46239 requested a full tablet report, sending...
I20260808 15:49:14.268644 22203 heartbeater.cc:464] Registering TS with master...
I20260808 15:49:14.268831 22203 heartbeater.cc:511] Master 127.8.39.126:46239 requested a full tablet report, sending...
W20260808 15:49:14.269582 22203 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 15:49:14.274073 22206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:14.251944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51234 (local address 127.8.39.126:46239)
0808 15:49:14.252194 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:14.252198 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:14.261058 (+ 8860us) server_negotiation.cc:407] Connection header received
0808 15:49:14.261110 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:14.261113 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:14.261167 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:14.261257 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:14.265513 (+ 4256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:14.266287 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:14.268057 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:14.268363 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:14.268473 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:14.270507 (+ 2034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:14.270510 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:14.270512 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:14.270534 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:14.272169 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:14.272740 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:14.272743 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:14.272744 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:14.272817 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:14.273145 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:14.273147 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:14.273148 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:14.273319 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:14.273462 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:14.273746 (+ 284us) server_negotiation.cc:299] Negotiation successful
0808 15:49:14.273852 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":100,"threads_started":1}
Aug 08 15:49:14 dist-test-slave-8tdl krb5kdc[20674](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786204154, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:14.670943 21920 heartbeater.cc:464] Registering TS with master...
I20260808 15:49:14.671309 21920 heartbeater.cc:511] Master 127.8.39.126:46239 requested a full tablet report, sending...
I20260808 15:49:14.672674 21713 ts_manager.cc:194] Registered new tserver with Master: b445e96e0fe04a4486165f451697ff9b (127.8.39.65:41869)
I20260808 15:49:14.674389 21713 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.65@KRBTEST.COM'} at 127.8.39.65:60825
I20260808 15:49:14.966828 22061 heartbeater.cc:464] Registering TS with master...
I20260808 15:49:14.967166 22061 heartbeater.cc:511] Master 127.8.39.126:46239 requested a full tablet report, sending...
I20260808 15:49:14.968230 21713 ts_manager.cc:194] Registered new tserver with Master: 206d2c63287243fc99e788367bcee971 (127.8.39.66:45413)
I20260808 15:49:14.969080 21713 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.66@KRBTEST.COM'} at 127.8.39.66:37053
Aug 08 15:49:15 dist-test-slave-8tdl krb5kdc[20674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204154, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for HTTP/127.8.39.84@KRBTEST.COM
I20260808 15:49:15.269825 22203 heartbeater.cc:464] Registering TS with master...
I20260808 15:49:15.270156 22203 heartbeater.cc:511] Master 127.8.39.126:46239 requested a full tablet report, sending...
I20260808 15:49:15.271050 21713 ts_manager.cc:194] Registered new tserver with Master: d4d4fbb938f249e3944300e431550389 (127.8.39.67:35541)
I20260808 15:49:15.271842 21713 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.67@KRBTEST.COM'} at 127.8.39.67:38993
I20260808 15:49:15.278919 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:49:15.295639 22224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:15.280754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40844 (local address 127.8.39.126:46239)
0808 15:49:15.282028 (+ 1274us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:15.282033 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:15.282049 (+ 16us) server_negotiation.cc:407] Connection header received
0808 15:49:15.282088 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:15.282091 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:15.282139 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:15.282216 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:15.283212 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:15.284046 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:15.285217 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:15.285557 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:15.285643 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:15.291453 (+ 5810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:15.291457 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:15.291460 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:15.291495 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:15.293436 (+ 1941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:15.293995 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:15.293999 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:15.294001 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:15.294094 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:15.294454 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:15.294458 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:15.294459 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:15.294732 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:15.294884 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:15.295194 (+ 310us) server_negotiation.cc:299] Negotiation successful
0808 15:49:15.295369 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":81,"threads_started":1}
I20260808 15:49:15.300100 21713 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40844:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:49:15.307173 21713 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
Aug 08 15:49:15 dist-test-slave-8tdl krb5kdc[20674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204154, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for HTTP/127.8.39.84@KRBTEST.COM
I20260808 15:49:15.338356 22233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:15.325197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39886 (local address 127.8.39.66:45413)
0808 15:49:15.325487 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:15.325494 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:15.332037 (+ 6543us) server_negotiation.cc:407] Connection header received
0808 15:49:15.332346 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:15.332354 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:15.332623 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:15.332764 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:49:15.333509 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:15.334667 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:15.336425 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:15.337340 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:15.337442 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:15.337600 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:15.338045 (+ 445us) server_negotiation.cc:299] Negotiation successful
0808 15:49:15.338155 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":84,"threads_started":1}
I20260808 15:49:15.338477 22234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:15.324838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:35541 (local address 127.0.0.1:33070)
0808 15:49:15.325828 (+ 990us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:15.325880 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:15.326024 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:15.333300 (+ 7276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:15.333303 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:15.333322 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:49:15.333417 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:15.333423 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:15.335154 (+ 1731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:15.335158 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:15.336381 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:15.336397 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:15.338042 (+ 1645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:15.338045 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:15.338136 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:15.338159 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 15:49:15.338204 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 15:49:15.338328 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":774,"thread_start_us":1383,"threads_started":1}
I20260808 15:49:15.338846 22236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:15.324861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:45413 (local address 127.0.0.1:39886)
0808 15:49:15.331897 (+ 7036us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:15.331913 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:15.332128 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:15.333057 (+ 929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:15.333068 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:15.333096 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:49:15.333338 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:15.333348 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:15.334845 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:15.334848 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:15.336253 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:15.336264 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:15.337708 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:15.337712 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:15.337824 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:15.337861 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 15:49:15.338595 (+ 734us) client_negotiation.cc:240] Negotiation successful
0808 15:49:15.338697 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6964,"thread_start_us":671,"threads_started":1}
I20260808 15:49:15.339301 22232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:15.324956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33070 (local address 127.8.39.67:35541)
0808 15:49:15.332845 (+ 7889us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:15.332852 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:15.332876 (+ 24us) server_negotiation.cc:407] Connection header received
0808 15:49:15.332948 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:15.332953 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:15.333137 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:15.333574 (+ 437us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:49:15.333793 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:15.335015 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:15.336578 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:15.337499 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:15.338859 (+ 1360us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:15.339007 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:15.339053 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 15:49:15.339136 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7775,"thread_start_us":90,"threads_started":1}
I20260808 15:49:15.342307 22115 tablet_service.cc:1467] Processing CreateTablet for tablet 2b2ba7360178454b9d390e1fb559cd6b (DEFAULT_TABLE table=test-table [id=cc9ce18d13ca447cb310e6b21f30f9c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:49:15.342286 21986 tablet_service.cc:1467] Processing CreateTablet for tablet 2b2ba7360178454b9d390e1fb559cd6b (DEFAULT_TABLE table=test-table [id=cc9ce18d13ca447cb310e6b21f30f9c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:49:15.343482 22115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b2ba7360178454b9d390e1fb559cd6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:49:15.343531 21986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b2ba7360178454b9d390e1fb559cd6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:49:15.353760 22239 tablet_bootstrap.cc:492] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971: Bootstrap starting.
I20260808 15:49:15.355057 22238 tablet_bootstrap.cc:492] T 2b2ba7360178454b9d390e1fb559cd6b P d4d4fbb938f249e3944300e431550389: Bootstrap starting.
I20260808 15:49:15.356564 22239 tablet_bootstrap.cc:654] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971: Neither blocks nor log segments found. Creating new log.
I20260808 15:49:15.357522 22238 tablet_bootstrap.cc:654] T 2b2ba7360178454b9d390e1fb559cd6b P d4d4fbb938f249e3944300e431550389: Neither blocks nor log segments found. Creating new log.
I20260808 15:49:15.357537 22239 log.cc:824] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971: Log is configured to *not* fsync() on all Append() calls
I20260808 15:49:15.358608 22238 log.cc:824] T 2b2ba7360178454b9d390e1fb559cd6b P d4d4fbb938f249e3944300e431550389: Log is configured to *not* fsync() on all Append() calls
I20260808 15:49:15.360447 22239 tablet_bootstrap.cc:492] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971: No bootstrap required, opened a new log
I20260808 15:49:15.360662 22239 ts_tablet_manager.cc:1397] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.004s
I20260808 15:49:15.365530 22238 tablet_bootstrap.cc:492] T 2b2ba7360178454b9d390e1fb559cd6b P d4d4fbb938f249e3944300e431550389: No bootstrap required, opened a new log
I20260808 15:49:15.365824 22238 ts_tablet_manager.cc:1397] T 2b2ba7360178454b9d390e1fb559cd6b P d4d4fbb938f249e3944300e431550389: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260808 15:49:15.366384 22239 raft_consensus.cc:348] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4d4fbb938f249e3944300e431550389" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35541 } } peers { permanent_uuid: "206d2c63287243fc99e788367bcee971" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 45413 } } peers { permanent_uuid: "b445e96e0fe04a4486165f451697ff9b" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 41869 } }
I20260808 15:49:15.366770 22239 raft_consensus.cc:374] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:49:15.366849 22239 raft_consensus.cc:729] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 206d2c63287243fc99e788367bcee971, State: Initialized, Role: FOLLOWER
I20260808 15:49:15.367393 22239 consensus_queue.cc:260] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4d4fbb938f249e3944300e431550389" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35541 } } peers { permanent_uuid: "206d2c63287243fc99e788367bcee971" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 45413 } } peers { permanent_uuid: "b445e96e0fe04a4486165f451697ff9b" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 41869 } }
I20260808 15:49:15.370833 22238 raft_consensus.cc:348] T 2b2ba7360178454b9d390e1fb559cd6b P d4d4fbb938f249e3944300e431550389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4d4fbb938f249e3944300e431550389" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35541 } } peers { permanent_uuid: "206d2c63287243fc99e788367bcee971" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 45413 } } peers { permanent_uuid: "b445e96e0fe04a4486165f451697ff9b" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 41869 } }
I20260808 15:49:15.371214 22238 raft_consensus.cc:374] T 2b2ba7360178454b9d390e1fb559cd6b P d4d4fbb938f249e3944300e431550389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:49:15.371302 22238 raft_consensus.cc:729] T 2b2ba7360178454b9d390e1fb559cd6b P d4d4fbb938f249e3944300e431550389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4d4fbb938f249e3944300e431550389, State: Initialized, Role: FOLLOWER
I20260808 15:49:15.371634 22239 ts_tablet_manager.cc:1428] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971: Time spent starting tablet: real 0.011s user 0.009s sys 0.000s
I20260808 15:49:15.371894 22238 consensus_queue.cc:260] T 2b2ba7360178454b9d390e1fb559cd6b P d4d4fbb938f249e3944300e431550389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4d4fbb938f249e3944300e431550389" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35541 } } peers { permanent_uuid: "206d2c63287243fc99e788367bcee971" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 45413 } } peers { permanent_uuid: "b445e96e0fe04a4486165f451697ff9b" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 41869 } }
I20260808 15:49:15.372071 22061 heartbeater.cc:503] Master 127.8.39.126:46239 was elected leader, sending a full tablet report...
I20260808 15:49:15.373587 22238 ts_tablet_manager.cc:1428] T 2b2ba7360178454b9d390e1fb559cd6b P d4d4fbb938f249e3944300e431550389: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260808 15:49:15.373962 22203 heartbeater.cc:503] Master 127.8.39.126:46239 was elected leader, sending a full tablet report...
I20260808 15:49:15.376811 22235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:15.326929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:41869 (local address 127.0.0.1:53066)
0808 15:49:15.337765 (+ 10836us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:15.337780 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:15.337899 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:15.369393 (+ 31494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:15.369397 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:15.369425 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:49:15.369558 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:15.369578 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:15.373793 (+ 4215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:15.373798 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:15.375064 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:15.375077 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:15.376339 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:15.376343 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:15.376445 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:15.376476 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 15:49:15.376565 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 15:49:15.376655 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10765,"thread_start_us":96,"threads_started":1}
I20260808 15:49:15.377599 22237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:15.327350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53066 (local address 127.8.39.65:41869)
0808 15:49:15.327719 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:15.327726 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:15.368283 (+ 40557us) server_negotiation.cc:407] Connection header received
0808 15:49:15.368397 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:15.368403 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:15.368656 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:15.369748 (+ 1092us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:49:15.369934 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:15.371211 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:15.375268 (+ 4057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:15.376183 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:15.376317 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:15.376496 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:15.377319 (+ 823us) server_negotiation.cc:299] Negotiation successful
0808 15:49:15.377428 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":196,"threads_started":1}
I20260808 15:49:15.381191 21851 tablet_service.cc:1467] Processing CreateTablet for tablet 2b2ba7360178454b9d390e1fb559cd6b (DEFAULT_TABLE table=test-table [id=cc9ce18d13ca447cb310e6b21f30f9c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:49:15.382428 21851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b2ba7360178454b9d390e1fb559cd6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:49:15.401943 22245 tablet_bootstrap.cc:492] T 2b2ba7360178454b9d390e1fb559cd6b P b445e96e0fe04a4486165f451697ff9b: Bootstrap starting.
I20260808 15:49:15.406972 22245 tablet_bootstrap.cc:654] T 2b2ba7360178454b9d390e1fb559cd6b P b445e96e0fe04a4486165f451697ff9b: Neither blocks nor log segments found. Creating new log.
I20260808 15:49:15.408129 22245 log.cc:824] T 2b2ba7360178454b9d390e1fb559cd6b P b445e96e0fe04a4486165f451697ff9b: Log is configured to *not* fsync() on all Append() calls
I20260808 15:49:15.411438 22245 tablet_bootstrap.cc:492] T 2b2ba7360178454b9d390e1fb559cd6b P b445e96e0fe04a4486165f451697ff9b: No bootstrap required, opened a new log
I20260808 15:49:15.411653 22245 ts_tablet_manager.cc:1397] T 2b2ba7360178454b9d390e1fb559cd6b P b445e96e0fe04a4486165f451697ff9b: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.002s
I20260808 15:49:15.416702 22245 raft_consensus.cc:348] T 2b2ba7360178454b9d390e1fb559cd6b P b445e96e0fe04a4486165f451697ff9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4d4fbb938f249e3944300e431550389" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35541 } } peers { permanent_uuid: "206d2c63287243fc99e788367bcee971" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 45413 } } peers { permanent_uuid: "b445e96e0fe04a4486165f451697ff9b" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 41869 } }
I20260808 15:49:15.417040 22245 raft_consensus.cc:374] T 2b2ba7360178454b9d390e1fb559cd6b P b445e96e0fe04a4486165f451697ff9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:49:15.417116 22245 raft_consensus.cc:729] T 2b2ba7360178454b9d390e1fb559cd6b P b445e96e0fe04a4486165f451697ff9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b445e96e0fe04a4486165f451697ff9b, State: Initialized, Role: FOLLOWER
I20260808 15:49:15.417642 22245 consensus_queue.cc:260] T 2b2ba7360178454b9d390e1fb559cd6b P b445e96e0fe04a4486165f451697ff9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4d4fbb938f249e3944300e431550389" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35541 } } peers { permanent_uuid: "206d2c63287243fc99e788367bcee971" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 45413 } } peers { permanent_uuid: "b445e96e0fe04a4486165f451697ff9b" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 41869 } }
I20260808 15:49:15.418634 21920 heartbeater.cc:503] Master 127.8.39.126:46239 was elected leader, sending a full tablet report...
I20260808 15:49:15.418850 22245 ts_tablet_manager.cc:1428] T 2b2ba7360178454b9d390e1fb559cd6b P b445e96e0fe04a4486165f451697ff9b: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
W20260808 15:49:15.445992 22062 tablet.cc:2369] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:49:15.497826 22204 tablet.cc:2369] T 2b2ba7360178454b9d390e1fb559cd6b P d4d4fbb938f249e3944300e431550389: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:49:15.623390 21921 tablet.cc:2369] T 2b2ba7360178454b9d390e1fb559cd6b P b445e96e0fe04a4486165f451697ff9b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:49:15.697471 22242 raft_consensus.cc:482] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:49:15.697718 22242 raft_consensus.cc:504] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4d4fbb938f249e3944300e431550389" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35541 } } peers { permanent_uuid: "206d2c63287243fc99e788367bcee971" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 45413 } } peers { permanent_uuid: "b445e96e0fe04a4486165f451697ff9b" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 41869 } }
I20260808 15:49:15.699113 22242 leader_election.cc:288] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4d4fbb938f249e3944300e431550389 (127.8.39.67:35541), b445e96e0fe04a4486165f451697ff9b (127.8.39.65:41869)
I20260808 15:49:15.704260 22232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:15.699429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:57745 (local address 127.8.39.67:35541)
0808 15:49:15.699568 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:15.699575 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:15.699841 (+ 266us) server_negotiation.cc:407] Connection header received
0808 15:49:15.700106 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:15.700109 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:15.700158 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:15.700240 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:49:15.700550 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:15.701264 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:15.703045 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:15.703618 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:15.703733 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:15.703802 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:15.704088 (+ 286us) server_negotiation.cc:299] Negotiation successful
0808 15:49:15.704158 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 15:49:15.704327 22257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:15.699320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:35541 (local address 127.8.39.66:57745)
0808 15:49:15.699741 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:15.699756 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:15.699943 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:15.700264 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:15.700267 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:15.700286 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:49:15.700437 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:15.700442 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:15.701397 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:15.701400 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:15.702926 (+ 1526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:15.702938 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:15.703768 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:15.703772 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:15.703920 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:15.703948 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 15:49:15.704037 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 15:49:15.704117 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":129,"threads_started":1}
I20260808 15:49:15.704911 22258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:15.699405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:41869 (local address 127.8.39.66:35957)
0808 15:49:15.700014 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:15.700030 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:15.700192 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:15.700564 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:15.700567 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:15.700583 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:49:15.700846 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:15.700854 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:15.701797 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:15.701803 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:15.702830 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:15.702840 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:15.704510 (+ 1670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:15.704514 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:15.704606 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:15.704628 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 15:49:15.704709 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 15:49:15.704779 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":156,"threads_started":1}
I20260808 15:49:15.704962 22237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:15.699807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:35957 (local address 127.8.39.65:41869)
0808 15:49:15.699944 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:15.699948 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:15.700116 (+ 168us) server_negotiation.cc:407] Connection header received
0808 15:49:15.700312 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:15.700315 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:15.700380 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:15.700429 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:49:15.700981 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:15.701692 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:15.702962 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:15.703618 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:15.703740 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:15.703801 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:15.704749 (+ 948us) server_negotiation.cc:299] Negotiation successful
0808 15:49:15.704848 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 15:49:15.705343 22142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b2ba7360178454b9d390e1fb559cd6b" candidate_uuid: "206d2c63287243fc99e788367bcee971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4d4fbb938f249e3944300e431550389" is_pre_election: true
I20260808 15:49:15.705515 21861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b2ba7360178454b9d390e1fb559cd6b" candidate_uuid: "206d2c63287243fc99e788367bcee971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b445e96e0fe04a4486165f451697ff9b" is_pre_election: true
I20260808 15:49:15.705724 22142 raft_consensus.cc:2454] T 2b2ba7360178454b9d390e1fb559cd6b P d4d4fbb938f249e3944300e431550389 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 206d2c63287243fc99e788367bcee971 in term 0.
I20260808 15:49:15.705799 21861 raft_consensus.cc:2454] T 2b2ba7360178454b9d390e1fb559cd6b P b445e96e0fe04a4486165f451697ff9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 206d2c63287243fc99e788367bcee971 in term 0.
I20260808 15:49:15.706311 21943 leader_election.cc:302] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 206d2c63287243fc99e788367bcee971, d4d4fbb938f249e3944300e431550389; no voters:
I20260808 15:49:15.706633 22242 raft_consensus.cc:2781] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:49:15.706768 22242 raft_consensus.cc:482] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:49:15.706822 22242 raft_consensus.cc:3037] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:49:15.708122 22242 raft_consensus.cc:504] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4d4fbb938f249e3944300e431550389" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35541 } } peers { permanent_uuid: "206d2c63287243fc99e788367bcee971" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 45413 } } peers { permanent_uuid: "b445e96e0fe04a4486165f451697ff9b" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 41869 } }
I20260808 15:49:15.708452 22242 leader_election.cc:288] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971 [CANDIDATE]: Term 1 election: Requested vote from peers d4d4fbb938f249e3944300e431550389 (127.8.39.67:35541), b445e96e0fe04a4486165f451697ff9b (127.8.39.65:41869)
I20260808 15:49:15.708827 21861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b2ba7360178454b9d390e1fb559cd6b" candidate_uuid: "206d2c63287243fc99e788367bcee971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b445e96e0fe04a4486165f451697ff9b"
I20260808 15:49:15.709002 22142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b2ba7360178454b9d390e1fb559cd6b" candidate_uuid: "206d2c63287243fc99e788367bcee971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4d4fbb938f249e3944300e431550389"
I20260808 15:49:15.709008 21861 raft_consensus.cc:3037] T 2b2ba7360178454b9d390e1fb559cd6b P b445e96e0fe04a4486165f451697ff9b [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:49:15.709126 22142 raft_consensus.cc:3037] T 2b2ba7360178454b9d390e1fb559cd6b P d4d4fbb938f249e3944300e431550389 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:49:15.710281 21861 raft_consensus.cc:2454] T 2b2ba7360178454b9d390e1fb559cd6b P b445e96e0fe04a4486165f451697ff9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 206d2c63287243fc99e788367bcee971 in term 1.
I20260808 15:49:15.710281 22142 raft_consensus.cc:2454] T 2b2ba7360178454b9d390e1fb559cd6b P d4d4fbb938f249e3944300e431550389 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 206d2c63287243fc99e788367bcee971 in term 1.
I20260808 15:49:15.710630 21944 leader_election.cc:302] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 206d2c63287243fc99e788367bcee971, b445e96e0fe04a4486165f451697ff9b; no voters:
I20260808 15:49:15.710836 22242 raft_consensus.cc:2781] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:49:15.711130 22242 raft_consensus.cc:686] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971 [term 1 LEADER]: Becoming Leader. State: Replica: 206d2c63287243fc99e788367bcee971, State: Running, Role: LEADER
I20260808 15:49:15.711496 22242 consensus_queue.cc:237] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4d4fbb938f249e3944300e431550389" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35541 } } peers { permanent_uuid: "206d2c63287243fc99e788367bcee971" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 45413 } } peers { permanent_uuid: "b445e96e0fe04a4486165f451697ff9b" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 41869 } }
I20260808 15:49:15.715025 21713 catalog_manager.cc:5495] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971 reported cstate change: term changed from 0 to 1, leader changed from <none> to 206d2c63287243fc99e788367bcee971 (127.8.39.66). New cstate: current_term: 1 leader_uuid: "206d2c63287243fc99e788367bcee971" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4d4fbb938f249e3944300e431550389" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "206d2c63287243fc99e788367bcee971" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 45413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b445e96e0fe04a4486165f451697ff9b" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 41869 } health_report { overall_health: UNKNOWN } } }
I20260808 15:49:15.789763 22233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:15.785506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39888 (local address 127.8.39.66:45413)
0808 15:49:15.785665 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:15.785669 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:15.785688 (+ 19us) server_negotiation.cc:407] Connection header received
0808 15:49:15.785798 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:15.785801 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:15.785873 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:15.785992 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:49:15.786237 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:15.787021 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:15.787949 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:15.788282 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:15.788407 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:15.788732 (+ 325us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:49:15.789298 (+ 566us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:49:15.789437 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:15.789529 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 15:49:15.789593 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 15:49:15.796613 22142 raft_consensus.cc:1261] T 2b2ba7360178454b9d390e1fb559cd6b P d4d4fbb938f249e3944300e431550389 [term 1 FOLLOWER]: Refusing update from remote peer 206d2c63287243fc99e788367bcee971: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:49:15.796701 21861 raft_consensus.cc:1261] T 2b2ba7360178454b9d390e1fb559cd6b P b445e96e0fe04a4486165f451697ff9b [term 1 FOLLOWER]: Refusing update from remote peer 206d2c63287243fc99e788367bcee971: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:49:15.797338 22242 consensus_queue.cc:1035] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d4fbb938f249e3944300e431550389" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 35541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:49:15.797569 22259 consensus_queue.cc:1035] T 2b2ba7360178454b9d390e1fb559cd6b P 206d2c63287243fc99e788367bcee971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b445e96e0fe04a4486165f451697ff9b" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 41869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:49:15.804252 22262 mvcc.cc:205] Tried to move back new op lower bound from 7316292222135320576 to 7316292221796933632. Current Snapshot: MvccSnapshot[applied={T|T < 7316292222135320576}]
I20260808 15:49:15.807296 22263 mvcc.cc:205] Tried to move back new op lower bound from 7316292222135320576 to 7316292221796933632. Current Snapshot: MvccSnapshot[applied={T|T < 7316292222135320576}]
I20260808 15:49:15.810410 22264 mvcc.cc:205] Tried to move back new op lower bound from 7316292222135320576 to 7316292221796933632. Current Snapshot: MvccSnapshot[applied={T|T < 7316292222135320576}]
I20260808 15:49:15.816505 21712 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40844:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:49:15.816706 21712 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40844:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:49:15.819213 21712 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c9d2d2f0d4bf4b658ef8c3292ab79e67: Sending DeleteTablet for 3 replicas of tablet 2b2ba7360178454b9d390e1fb559cd6b
I20260808 15:49:15.820115 21986 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b2ba7360178454b9d390e1fb559cd6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:49:15 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:39886
I20260808 15:49:15.820289 21851 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b2ba7360178454b9d390e1fb559cd6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:49:15 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:53066
I20260808 15:49:15.820389 22115 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b2ba7360178454b9d390e1fb559cd6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:49:15 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:33070
I20260808 15:49:15.821038 22275 tablet_replica.cc:330] T 2b2ba7360178454b9d390e1fb559cd6b P d4d4fbb938f249e3944300e431550389: stopping tablet replica
I20260808 15:49:15.821413 22275 raft_consensus.cc:2229] T 2b2ba7360178454b9d390e1fb559cd6b P d4d4fbb938f249e3944300e431550389 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:49:15.821743 22275 raft_consensus.cc:2258] T 2b2ba7360178454b9d390e1fb559cd6b P d4d4fbb938f249e3944300e431550389 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:49:15.822134 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 21752
I20260808 15:49:15.827634 22275 ts_tablet_manager.cc:1905] T 2b2ba7360178454b9d390e1fb559cd6b P d4d4fbb938f249e3944300e431550389: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:49:15.831636 22275 ts_tablet_manager.cc:1918] T 2b2ba7360178454b9d390e1fb559cd6b P d4d4fbb938f249e3944300e431550389: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:49:15.831759 22275 log.cc:1196] T 2b2ba7360178454b9d390e1fb559cd6b P d4d4fbb938f249e3944300e431550389: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/2b2ba7360178454b9d390e1fb559cd6b
I20260808 15:49:15.832129 22275 ts_tablet_manager.cc:1939] T 2b2ba7360178454b9d390e1fb559cd6b P d4d4fbb938f249e3944300e431550389: Deleting consensus metadata
W20260808 15:49:15.833027 21699 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.39.65:41869 (error 108)
I20260808 15:49:15.833560 21698 catalog_manager.cc:4841] TS d4d4fbb938f249e3944300e431550389 (127.8.39.67:35541): tablet 2b2ba7360178454b9d390e1fb559cd6b (table test-table [id=cc9ce18d13ca447cb310e6b21f30f9c4]) successfully deleted
I20260808 15:49:15.834337 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 21923
I20260808 15:49:15.835131 22235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:15.834331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:41869 (local address 127.0.0.1:53070)
0808 15:49:15.834971 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:15.835046 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.65:41869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":531}
W20260808 15:49:15.835278 21699 catalog_manager.cc:4584] TS b445e96e0fe04a4486165f451697ff9b (127.8.39.65:41869): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2b2ba7360178454b9d390e1fb559cd6b: Network error: Client connection negotiation failed: client connection to 127.8.39.65:41869: connect: Connection refused (error 111)
I20260808 15:49:15.841917 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 22065
I20260808 15:49:15.843155 22235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:15.842172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:45413 (local address 127.0.0.1:39890)
0808 15:49:15.842969 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:15.843042 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.66:45413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":678}
I20260808 15:49:15.849790 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 21679
I20260808 15:49:15.860183 8349 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 15:49:16.205746 8349 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 15:49:16.205899 8349 mini_ranger.cc:66] Stopping Ranger...
I20260808 15:49:16.551564 8349 mini_ranger.cc:68] Stopped Ranger
2026-08-08 15:49:16.551 UTC [20706] LOG: received smart shutdown request
2026-08-08 15:49:16.555 UTC [20706] LOG: background worker "logical replication launcher" (PID 20715) exited with exit code 1
2026-08-08 15:49:16.556 UTC [20710] LOG: shutting down
2026-08-08 15:49:16.745 UTC [20706] LOG: database system is shut down
2026-08-08T15:49:16Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (52116 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:49:16 dist-test-slave-8tdl krb5kdc[22286](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:49:16 dist-test-slave-8tdl krb5kdc[22286](info): set up 2 sockets
Aug 08 15:49:16 dist-test-slave-8tdl krb5kdc[22286](info): commencing operation
krb5kdc: starting...
W20260808 15:49:17.968032 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.068s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:49:18 dist-test-slave-8tdl krb5kdc[22286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204158, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:49:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:49:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:49:18.102995 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:45421
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:34731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:45421,127.8.39.125:43307,127.8.39.124:36447
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:49:18.216276 22300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:18.216629 22300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:18.216714 22300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:18.220816 22300 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:49:18.220927 22300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:18.220963 22300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:18.221000 22300 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:49:18.221053 22300 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:49:18.226441 22300 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:34731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:45421,127.8.39.125:43307,127.8.39.124:36447
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:45421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22300
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:18.227631 22300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:18.228678 22300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:49:18.237196 22306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:18.237229 22308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:18.237390 22305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:18.237597 22300 server_base.cc:1034] running on GCE node
I20260808 15:49:18.238284 22300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:18.239564 22300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:18.240768 22300 hybrid_clock.cc:648] HybridClock initialized: now 1786204158240740 us; error 41 us; skew 500 ppm
Aug 08 15:49:18 dist-test-slave-8tdl krb5kdc[22286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204158, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:18.243757 22300 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:49:18.244632 22300 webserver.cc:460] Webserver started at http://127.8.39.126:42807/ using document root <none> and password file <none>
I20260808 15:49:18.245175 22300 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:18.245240 22300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:49:18.245411 22300 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:49:18.247634 22300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "3c28db1744c44d4dba5aa41c39d8fc45"
format_stamp: "Formatted at 2026-08-08 15:49:18 on dist-test-slave-8tdl"
server_key: "e204a3d5baa70ddc41cb893defb88cb0"
server_key_iv: "ce02a3e681ee18cce6f14e2977e52763"
server_key_version: "encryptionkey@0"
I20260808 15:49:18.248184 22300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "3c28db1744c44d4dba5aa41c39d8fc45"
format_stamp: "Formatted at 2026-08-08 15:49:18 on dist-test-slave-8tdl"
server_key: "e204a3d5baa70ddc41cb893defb88cb0"
server_key_iv: "ce02a3e681ee18cce6f14e2977e52763"
server_key_version: "encryptionkey@0"
I20260808 15:49:18.251925 22300 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 15:49:18.254374 22315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:18.255738 22300 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:49:18.255877 22300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "3c28db1744c44d4dba5aa41c39d8fc45"
format_stamp: "Formatted at 2026-08-08 15:49:18 on dist-test-slave-8tdl"
server_key: "e204a3d5baa70ddc41cb893defb88cb0"
server_key_iv: "ce02a3e681ee18cce6f14e2977e52763"
server_key_version: "encryptionkey@0"
I20260808 15:49:18.255990 22300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:18.278462 22300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:18.281877 22300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:18.282097 22300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:18.289194 22300 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:45421
I20260808 15:49:18.289327 22368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:45421 every 8 connection(s)
I20260808 15:49:18.290269 22300 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:49:18.293083 22369 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:49:18.296892 22369 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45421 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:49:18.300395 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 22300
I20260808 15:49:18.300545 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:49:18.300848 8349 external_mini_cluster.cc:1428] Setting key c82e89ff908d27f66be1a317c592a69a
Aug 08 15:49:18 dist-test-slave-8tdl krb5kdc[22286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204158, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.39.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.125@KRBTEST.COM" created.
I20260808 15:49:18.312878 22372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.299343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45421 (local address 127.0.0.1:59856)
0808 15:49:18.299856 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.299894 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:18.300995 (+ 1101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:18.301709 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:18.301718 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:18.302240 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:18.302651 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:18.302708 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.303840 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.303843 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:18.304611 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:18.304621 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.305279 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.305283 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:18.305412 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:18.306022 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:18.306038 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:18.307943 (+ 1905us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:18.310043 (+ 2100us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:18.310052 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:18.310060 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:18.310286 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:18.310608 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:18.310611 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:18.310612 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:18.310793 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:18.311412 (+ 619us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:18.311418 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:18.311551 (+ 133us) client_negotiation.cc:769] Sending connection context
0808 15:49:18.311687 (+ 136us) client_negotiation.cc:240] Negotiation successful
0808 15:49:18.311957 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"spinlock_wait_cycles":35584,"thread_start_us":180,"threads_started":1}
I20260808 15:49:18.312891 22371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.299343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59856 (local address 127.8.39.126:45421)
0808 15:49:18.299771 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:18.299789 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:18.300000 (+ 211us) server_negotiation.cc:407] Connection header received
0808 15:49:18.301304 (+ 1304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:18.301309 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:18.301502 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:18.301652 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:18.302843 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.303707 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.304730 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.305119 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.305288 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:18.308149 (+ 2861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:18.308154 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:18.308170 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:18.308192 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:18.309923 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.310396 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.310400 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.310402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.310522 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.310905 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.310909 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.310911 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.311309 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:18.311415 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:18.311831 (+ 416us) server_negotiation.cc:299] Negotiation successful
0808 15:49:18.312037 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":293,"thread_start_us":122,"threads_started":1}
I20260808 15:49:18.315460 22369 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.125" port: 43307 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:49:18.316380 22372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.316019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:43307 (local address 127.0.0.1:58840)
0808 15:49:18.316182 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.316286 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.125:43307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260808 15:49:18.316597 22317 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.39.125:43307: connect: Connection refused (error 111)
I20260808 15:49:18.317585 22372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.317296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:43307 (local address 127.0.0.1:58850)
0808 15:49:18.317434 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.317505 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.125:43307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 15:49:18.317742 22369 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.125:43307: Network error: Client connection negotiation failed: client connection to 127.8.39.125:43307: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.125.keytab.
Entry for principal kudu/127.8.39.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.125.keytab.
I20260808 15:49:18.330119 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.125:43307
--webserver_interface=127.8.39.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.125.keytab
--principal=kudu/127.8.39.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:34731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:45421,127.8.39.125:43307,127.8.39.124:36447
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:49:18.367030 22369 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.125" port: 43307 } attempt: 1
I20260808 15:49:18.367976 22372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.367668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:43307 (local address 127.0.0.1:58852)
0808 15:49:18.367830 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.367896 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.125:43307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260808 15:49:18.368762 22372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.368538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:43307 (local address 127.0.0.1:58868)
0808 15:49:18.368649 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.368703 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.125:43307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 15:49:18.368894 22369 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.125:43307: Network error: Client connection negotiation failed: client connection to 127.8.39.125:43307: connect: Connection refused (error 111)
I20260808 15:49:18.437072 22369 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.125" port: 43307 } attempt: 2
I20260808 15:49:18.438073 22372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.437767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:43307 (local address 127.0.0.1:58870)
0808 15:49:18.437930 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.437994 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.125:43307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260808 15:49:18.438862 22372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.438608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:43307 (local address 127.0.0.1:58880)
0808 15:49:18.438748 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.438803 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.125:43307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 15:49:18.438999 22369 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.125:43307: Network error: Client connection negotiation failed: client connection to 127.8.39.125:43307: connect: Connection refused (error 111)
W20260808 15:49:18.448164 22376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:18.448488 22376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:18.448594 22376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:18.452752 22376 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:49:18.452834 22376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:18.452873 22376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:18.452944 22376 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:49:18.452981 22376 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:49:18.458542 22376 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:34731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:45421,127.8.39.125:43307,127.8.39.124:36447
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.125.keytab
--principal=kudu/127.8.39.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.125:43307
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.39.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:18.459717 22376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:18.460813 22376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:49:18.469909 22384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:18.470026 22376 server_base.cc:1034] running on GCE node
W20260808 15:49:18.469940 22382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:18.469940 22381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:18.471175 22376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:18.472460 22376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:18.473646 22376 hybrid_clock.cc:648] HybridClock initialized: now 1786204158473617 us; error 51 us; skew 500 ppm
Aug 08 15:49:18 dist-test-slave-8tdl krb5kdc[22286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204158, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:18.476969 22376 init.cc:377] Logged in from keytab as kudu/127.8.39.125@KRBTEST.COM (short username kudu)
I20260808 15:49:18.477999 22376 webserver.cc:460] Webserver started at http://127.8.39.125:46581/ using document root <none> and password file <none>
I20260808 15:49:18.478744 22376 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:18.478857 22376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:49:18.479126 22376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:49:18.481463 22376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-1/data/instance:
uuid: "b32383caa59140afae7f9eb26783ddd8"
format_stamp: "Formatted at 2026-08-08 15:49:18 on dist-test-slave-8tdl"
server_key: "69d705bc648cb1c74d68d9dfb39746b7"
server_key_iv: "3deb0e7bab8980a341419f7304881297"
server_key_version: "encryptionkey@0"
I20260808 15:49:18.482095 22376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-1/wal/instance:
uuid: "b32383caa59140afae7f9eb26783ddd8"
format_stamp: "Formatted at 2026-08-08 15:49:18 on dist-test-slave-8tdl"
server_key: "69d705bc648cb1c74d68d9dfb39746b7"
server_key_iv: "3deb0e7bab8980a341419f7304881297"
server_key_version: "encryptionkey@0"
I20260808 15:49:18.486299 22376 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 15:49:18.489033 22391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:18.490326 22376 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:49:18.490509 22376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-1/wal
uuid: "b32383caa59140afae7f9eb26783ddd8"
format_stamp: "Formatted at 2026-08-08 15:49:18 on dist-test-slave-8tdl"
server_key: "69d705bc648cb1c74d68d9dfb39746b7"
server_key_iv: "3deb0e7bab8980a341419f7304881297"
server_key_version: "encryptionkey@0"
I20260808 15:49:18.490643 22376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:18.514958 22376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:18.518188 22376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:18.518420 22376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:18.526158 22376 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.125:43307
I20260808 15:49:18.526189 22447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.125:43307 every 8 connection(s)
I20260808 15:49:18.527249 22376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-1/data/info.pb
I20260808 15:49:18.527937 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 22376
I20260808 15:49:18.528100 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-1/wal/instance
I20260808 15:49:18.528486 8349 external_mini_cluster.cc:1428] Setting key 43fd2f964ea69bed6742f3f599bd6c9d
I20260808 15:49:18.530200 22369 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.125" port: 43307 } attempt: 3
I20260808 15:49:18.531136 22448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:49:18.536288 22448 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45421 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.8.39.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.124@KRBTEST.COM" created.
Aug 08 15:49:18 dist-test-slave-8tdl krb5kdc[22286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204158, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for kudu/127.8.39.125@KRBTEST.COM
Aug 08 15:49:18 dist-test-slave-8tdl krb5kdc[22286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204158, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.125@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:49:18.547590 22372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.531175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:43307 (local address 127.0.0.1:58892)
0808 15:49:18.531356 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.531376 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:18.531491 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:18.534319 (+ 2828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:18.534323 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:18.534576 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:18.534770 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:18.534781 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.536828 (+ 2047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.536832 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:18.537754 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:18.537768 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.538870 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.538876 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:18.539027 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:18.539704 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:18.539715 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:18.542444 (+ 2729us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:18.544945 (+ 2501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:18.544950 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:18.544952 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:18.545225 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:18.545662 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:18.545668 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:18.545673 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:18.545786 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:18.546617 (+ 831us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:18.546622 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:18.546782 (+ 160us) client_negotiation.cc:769] Sending connection context
0808 15:49:18.546925 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 15:49:18.547394 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 15:49:18.548849 22451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.531734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58892 (local address 127.8.39.125:43307)
0808 15:49:18.532265 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:18.532287 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:18.532333 (+ 46us) server_negotiation.cc:407] Connection header received
0808 15:49:18.533464 (+ 1131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:18.533490 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:18.533947 (+ 457us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:18.534361 (+ 414us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:18.534956 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.536678 (+ 1722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.537908 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.538710 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.539365 (+ 655us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:18.542655 (+ 3290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:18.542664 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:18.542699 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:18.542736 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:18.544822 (+ 2086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.545355 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.545362 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.545369 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.545536 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.545906 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.545912 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.545917 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.546467 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:18.546642 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:18.547288 (+ 646us) server_negotiation.cc:299] Negotiation successful
0808 15:49:18.547635 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":161,"threads_started":1}
I20260808 15:49:18.550865 22371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.538451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59868 (local address 127.8.39.126:45421)
0808 15:49:18.538607 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:18.538614 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:18.539072 (+ 458us) server_negotiation.cc:407] Connection header received
0808 15:49:18.539206 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:18.539212 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:18.539271 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:18.539354 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:18.540288 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.541191 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.542672 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.542982 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.543120 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:18.546419 (+ 3299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:18.546423 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:18.546426 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:18.546461 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:18.548528 (+ 2067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.549277 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.549281 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.549283 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.549381 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.549721 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.549724 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.549726 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.549972 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:18.550057 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:18.550550 (+ 493us) server_negotiation.cc:299] Negotiation successful
0808 15:49:18.550671 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 15:49:18.550901 22452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.538444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45421 (local address 127.0.0.1:59868)
0808 15:49:18.538921 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.538975 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:18.539107 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:18.539444 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:18.539451 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:18.539987 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:18.540167 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:18.540177 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.541346 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.541348 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:18.542536 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:18.542550 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.543263 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.543268 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:18.543457 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:18.544219 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:18.544241 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:18.546233 (+ 1992us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:18.548779 (+ 2546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:18.548788 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:18.548793 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:18.549136 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:18.549507 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:18.549510 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:18.549513 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:18.549607 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:18.550149 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:18.550165 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:18.550298 (+ 133us) client_negotiation.cc:769] Sending connection context
0808 15:49:18.550471 (+ 173us) client_negotiation.cc:240] Negotiation successful
0808 15:49:18.550671 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":180,"threads_started":1}
I20260808 15:49:18.551436 22369 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:49:18.552145 22448 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.125" port: 43307 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:49:18.552363 22372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.551944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36447 (local address 127.0.0.1:37190)
0808 15:49:18.552136 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.552184 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
I20260808 15:49:18.553238 22372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.552924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36447 (local address 127.0.0.1:37200)
0808 15:49:18.553104 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.553171 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
W20260808 15:49:18.553396 22369 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.124:36447: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36447: connect: Connection refused (error 111)
Aug 08 15:49:18 dist-test-slave-8tdl krb5kdc[22286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204158, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.125@KRBTEST.COM for kudu/127.8.39.125@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.124.keytab.
Entry for principal kudu/127.8.39.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.124.keytab.
I20260808 15:49:18.561723 22451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.552820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58900 (local address 127.8.39.125:43307)
0808 15:49:18.553018 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:18.553024 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:18.553038 (+ 14us) server_negotiation.cc:407] Connection header received
0808 15:49:18.553071 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:18.553074 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:18.553116 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:18.553186 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:18.553835 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.554517 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.555717 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.556013 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.556188 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:18.558336 (+ 2148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:18.558339 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:18.558342 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:18.558367 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:18.559980 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.560431 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.560436 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.560438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.560510 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.560775 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.560780 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.560782 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.560997 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:18.561109 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:18.561475 (+ 366us) server_negotiation.cc:299] Negotiation successful
0808 15:49:18.561589 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260808 15:49:18.561726 22452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.552665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:43307 (local address 127.0.0.1:58900)
0808 15:49:18.552781 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.552799 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:18.552921 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:18.553421 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:18.553424 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:18.553612 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:18.553711 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:18.553716 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.554654 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.554658 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:18.555581 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:18.555593 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.556187 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.556190 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:18.556274 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:18.556820 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:18.556832 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:18.558203 (+ 1371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:18.560145 (+ 1942us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:18.560148 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:18.560150 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:18.560336 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:18.560597 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:18.560602 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:18.560604 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:18.560682 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:18.561107 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:18.561110 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:18.561226 (+ 116us) client_negotiation.cc:769] Sending connection context
0808 15:49:18.561347 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 15:49:18.561493 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 15:49:18.561939 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.124:36447
--webserver_interface=127.8.39.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.124.keytab
--principal=kudu/127.8.39.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:34731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:45421,127.8.39.125:43307,127.8.39.124:36447
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:49:18.563561 22448 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:49:18.564545 22452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.564133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36447 (local address 127.0.0.1:37208)
0808 15:49:18.564316 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.564448 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260808 15:49:18.564822 22395 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36447: connect: Connection refused (error 111)
I20260808 15:49:18.566231 22452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.565824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36447 (local address 127.0.0.1:37216)
0808 15:49:18.566064 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.566137 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132}
W20260808 15:49:18.566469 22448 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.124:36447: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36447: connect: Connection refused (error 111)
I20260808 15:49:18.584590 22369 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } attempt: 1
I20260808 15:49:18.585602 22372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.585252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36447 (local address 127.0.0.1:37230)
0808 15:49:18.585446 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.585512 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260808 15:49:18.586370 22372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.586143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36447 (local address 127.0.0.1:37238)
0808 15:49:18.586258 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.586313 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260808 15:49:18.586509 22369 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.124:36447: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36447: connect: Connection refused (error 111)
I20260808 15:49:18.615772 22448 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } attempt: 1
I20260808 15:49:18.616720 22452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.616348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36447 (local address 127.0.0.1:37240)
0808 15:49:18.616543 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.616625 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260808 15:49:18.617507 22452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.617270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36447 (local address 127.0.0.1:37244)
0808 15:49:18.617382 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.617438 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 15:49:18.617668 22448 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.124:36447: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36447: connect: Connection refused (error 111)
I20260808 15:49:18.661669 22369 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } attempt: 2
I20260808 15:49:18.662627 22372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.662267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36447 (local address 127.0.0.1:37256)
0808 15:49:18.662465 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.662538 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260808 15:49:18.663547 22372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.663301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36447 (local address 127.0.0.1:37272)
0808 15:49:18.663423 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.663485 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 15:49:18.663686 22369 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.124:36447: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36447: connect: Connection refused (error 111)
W20260808 15:49:18.684715 22454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:18.685071 22454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:18.685163 22454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 15:49:18.685863 22448 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } attempt: 2
I20260808 15:49:18.686805 22452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.686433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36447 (local address 127.0.0.1:37284)
0808 15:49:18.686618 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.686714 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260808 15:49:18.687556 22452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.687330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36447 (local address 127.0.0.1:37290)
0808 15:49:18.687438 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.687489 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 15:49:18.687707 22448 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.124:36447: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36447: connect: Connection refused (error 111)
W20260808 15:49:18.690127 22454 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:49:18.690192 22454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:18.690213 22454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:18.690269 22454 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:49:18.690302 22454 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:49:18.697085 22454 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:34731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:45421,127.8.39.125:43307,127.8.39.124:36447
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.124.keytab
--principal=kudu/127.8.39.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.124:36447
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.39.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:18.698477 22454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:18.699774 22454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:49:18.709478 22461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:18.709478 22464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:18.709550 22462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:18.709896 22454 server_base.cc:1034] running on GCE node
I20260808 15:49:18.710543 22454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:18.711854 22454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:18.713148 22454 hybrid_clock.cc:648] HybridClock initialized: now 1786204158713136 us; error 31 us; skew 500 ppm
Aug 08 15:49:18 dist-test-slave-8tdl krb5kdc[22286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204158, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:18.716480 22454 init.cc:377] Logged in from keytab as kudu/127.8.39.124@KRBTEST.COM (short username kudu)
I20260808 15:49:18.717571 22454 webserver.cc:460] Webserver started at http://127.8.39.124:44143/ using document root <none> and password file <none>
I20260808 15:49:18.718235 22454 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:18.718343 22454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:49:18.718614 22454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:49:18.721052 22454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-2/data/instance:
uuid: "c72ba0afd6bc4adda77c215307547a94"
format_stamp: "Formatted at 2026-08-08 15:49:18 on dist-test-slave-8tdl"
server_key: "f730d3c0cb9ad1e4998f1a5e8c050c7d"
server_key_iv: "3a6d36c45eb75d9bcc2d01327abc4ea9"
server_key_version: "encryptionkey@0"
I20260808 15:49:18.721728 22454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-2/wal/instance:
uuid: "c72ba0afd6bc4adda77c215307547a94"
format_stamp: "Formatted at 2026-08-08 15:49:18 on dist-test-slave-8tdl"
server_key: "f730d3c0cb9ad1e4998f1a5e8c050c7d"
server_key_iv: "3a6d36c45eb75d9bcc2d01327abc4ea9"
server_key_version: "encryptionkey@0"
I20260808 15:49:18.726209 22454 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260808 15:49:18.729212 22472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:18.730556 22454 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:49:18.730765 22454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-2/wal
uuid: "c72ba0afd6bc4adda77c215307547a94"
format_stamp: "Formatted at 2026-08-08 15:49:18 on dist-test-slave-8tdl"
server_key: "f730d3c0cb9ad1e4998f1a5e8c050c7d"
server_key_iv: "3a6d36c45eb75d9bcc2d01327abc4ea9"
server_key_version: "encryptionkey@0"
I20260808 15:49:18.730919 22454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:18.750792 22454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:18.754544 22454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:18.754844 22454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:18.762840 22369 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } attempt: 3
I20260808 15:49:18.763545 22454 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.124:36447
I20260808 15:49:18.763563 22527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.124:36447 every 8 connection(s)
I20260808 15:49:18.763851 22372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.763481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36447 (local address 127.0.0.1:37292)
0808 15:49:18.763677 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.763753 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260808 15:49:18.764883 22454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-2/data/info.pb
I20260808 15:49:18.767946 22529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:49:18.771209 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 22454
I20260808 15:49:18.771359 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786203987027663-8349-0/minicluster-data/master-2/wal/instance
I20260808 15:49:18.771700 8349 external_mini_cluster.cc:1428] Setting key dd1af9eae1b0fbceb3a53074a62f2657
Aug 08 15:49:18 dist-test-slave-8tdl krb5kdc[22286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204158, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for kudu/127.8.39.124@KRBTEST.COM
I20260808 15:49:18.773176 22529 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45421 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:49:18.778870 22448 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } attempt: 3
I20260808 15:49:18.779471 22372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.764431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36447 (local address 127.0.0.1:37304)
0808 15:49:18.764572 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.764590 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:18.764697 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:18.767173 (+ 2476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:18.767177 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:18.767383 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:18.767513 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:18.767520 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.769107 (+ 1587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.769110 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:18.770042 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:18.770056 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.770914 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.770918 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:18.771016 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:18.771642 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:18.771660 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:18.773280 (+ 1620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:18.776959 (+ 3679us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:18.776963 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:18.776965 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:18.777269 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:18.777726 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:18.777730 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:18.777732 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:18.777837 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:18.778825 (+ 988us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:18.778828 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:18.778966 (+ 138us) client_negotiation.cc:769] Sending connection context
0808 15:49:18.779090 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 15:49:18.779297 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
Aug 08 15:49:18 dist-test-slave-8tdl krb5kdc[22286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204158, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.124@KRBTEST.COM
I20260808 15:49:18.782094 22532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.765201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37304 (local address 127.8.39.124:36447)
0808 15:49:18.765647 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:18.765664 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:18.765702 (+ 38us) server_negotiation.cc:407] Connection header received
0808 15:49:18.766407 (+ 705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:18.766425 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:18.766867 (+ 442us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:18.767184 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:18.767666 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.768938 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.770191 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.770781 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.771040 (+ 259us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:18.773531 (+ 2491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:18.773539 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:18.773557 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:18.773590 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:18.776801 (+ 3211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.777415 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.777434 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.777441 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.777605 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.777965 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.777968 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.777971 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.778635 (+ 664us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:18.778847 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:18.780144 (+ 1297us) server_negotiation.cc:299] Negotiation successful
0808 15:49:18.780651 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":158,"threads_started":1}
Aug 08 15:49:18 dist-test-slave-8tdl krb5kdc[22286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204158, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.124@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
Aug 08 15:49:18 dist-test-slave-8tdl krb5kdc[22286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204158, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.125@KRBTEST.COM for kudu/127.8.39.124@KRBTEST.COM
I20260808 15:49:18.786363 22534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.772466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37318 (local address 127.8.39.124:36447)
0808 15:49:18.772876 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:18.772884 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:18.773199 (+ 315us) server_negotiation.cc:407] Connection header received
0808 15:49:18.773387 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:18.773390 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:18.773448 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:18.773541 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:18.774475 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.775639 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.777103 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.777521 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.777629 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:18.781364 (+ 3735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:18.781368 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:18.781370 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:18.781392 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:18.783644 (+ 2252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.784265 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.784269 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.784271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.784378 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.784758 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.784761 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.784763 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.785023 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:18.785196 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:18.785952 (+ 756us) server_negotiation.cc:299] Negotiation successful
0808 15:49:18.786107 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":170,"threads_started":1}
I20260808 15:49:18.789022 22369 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c28db1744c44d4dba5aa41c39d8fc45: Bootstrap starting.
I20260808 15:49:18.789963 22371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.776267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59882 (local address 127.8.39.126:45421)
0808 15:49:18.776509 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:18.776514 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:18.777221 (+ 707us) server_negotiation.cc:407] Connection header received
0808 15:49:18.777570 (+ 349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:18.777575 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:18.777664 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:18.777750 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:18.779249 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.779983 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.781260 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.781607 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.781699 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:18.785589 (+ 3890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:18.785594 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:18.785597 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:18.785629 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:18.787470 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.788355 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.788360 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.788362 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.788461 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.788795 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.788798 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.788800 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.789050 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:18.789175 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:18.789616 (+ 441us) server_negotiation.cc:299] Negotiation successful
0808 15:49:18.789761 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134}
I20260808 15:49:18.790807 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.775426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45421 (local address 127.0.0.1:59882)
0808 15:49:18.777046 (+ 1620us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.777127 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:18.777344 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:18.778015 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:18.778022 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:18.778597 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:18.778802 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:18.778812 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.780129 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.780132 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:18.781115 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:18.781125 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.781885 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.781890 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:18.782026 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:18.783237 (+ 1211us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:18.783261 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:18.785388 (+ 2127us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:18.787586 (+ 2198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:18.787600 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:18.787606 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:18.788228 (+ 622us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:18.788578 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:18.788581 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:18.788583 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:18.788682 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:18.789175 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:18.789189 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:18.789331 (+ 142us) client_negotiation.cc:769] Sending connection context
0808 15:49:18.790272 (+ 941us) client_negotiation.cc:240] Negotiation successful
0808 15:49:18.790517 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1243,"thread_start_us":103,"threads_started":1}
I20260808 15:49:18.791626 22452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.779406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36447 (local address 127.0.0.1:37332)
0808 15:49:18.780043 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.780060 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:18.780146 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:18.780894 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:18.780899 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:18.781113 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:18.781239 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:18.781250 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.782483 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.782488 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:18.783273 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:18.783284 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.783906 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.783909 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:18.784012 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:18.784511 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:18.784526 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:18.786331 (+ 1805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:18.789799 (+ 3468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:18.789803 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:18.789805 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:18.790091 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:18.790423 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:18.790426 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:18.790428 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:18.790523 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:18.791051 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:18.791054 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:18.791178 (+ 124us) client_negotiation.cc:769] Sending connection context
0808 15:49:18.791268 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 15:49:18.791434 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539}
I20260808 15:49:18.792213 22529 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.125" port: 43307 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:49:18.792496 22536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.779602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37332 (local address 127.8.39.124:36447)
0808 15:49:18.780589 (+ 987us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:18.780601 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:18.780617 (+ 16us) server_negotiation.cc:407] Connection header received
0808 15:49:18.780660 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:18.780664 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:18.780713 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:18.781360 (+ 647us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:18.781501 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.782362 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.783432 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.783752 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.786780 (+ 3028us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:18.786907 (+ 127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:18.786911 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:18.786913 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:18.786931 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:18.789656 (+ 2725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.790228 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.790232 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.790233 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.790316 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.790640 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.790643 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.790645 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.790923 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:18.792141 (+ 1218us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:18.792222 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 15:49:18.792339 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":852,"thread_start_us":136,"threads_started":1}
I20260808 15:49:18.796240 22448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8: Bootstrap starting.
Aug 08 15:49:18 dist-test-slave-8tdl krb5kdc[22286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204158, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
Aug 08 15:49:18 dist-test-slave-8tdl krb5kdc[22286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204158, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.124@KRBTEST.COM for kudu/127.8.39.125@KRBTEST.COM
I20260808 15:49:18.799185 22448 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8: Neither blocks nor log segments found. Creating new log.
I20260808 15:49:18.800271 22448 log.cc:824] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8: Log is configured to *not* fsync() on all Append() calls
I20260808 15:49:18.800525 22369 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c28db1744c44d4dba5aa41c39d8fc45: Neither blocks nor log segments found. Creating new log.
I20260808 15:49:18.801481 22369 log.cc:824] T 00000000000000000000000000000000 P 3c28db1744c44d4dba5aa41c39d8fc45: Log is configured to *not* fsync() on all Append() calls
I20260808 15:49:18.802855 22537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.789313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59892 (local address 127.8.39.126:45421)
0808 15:49:18.789693 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:18.789703 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:18.789720 (+ 17us) server_negotiation.cc:407] Connection header received
0808 15:49:18.789759 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:18.789761 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:18.789807 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:18.789897 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:18.791536 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.792389 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.793592 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.794016 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.794148 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:18.797245 (+ 3097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:18.797254 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:18.797256 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:18.797281 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:18.799240 (+ 1959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.799946 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.799949 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.799950 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.800038 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.800432 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.800436 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.800437 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.801537 (+ 1100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:18.801713 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:18.802480 (+ 767us) server_negotiation.cc:299] Negotiation successful
0808 15:49:18.802628 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":111,"threads_started":1}
I20260808 15:49:18.803370 22451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.793068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58906 (local address 127.8.39.125:43307)
0808 15:49:18.793188 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:18.793192 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:18.793370 (+ 178us) server_negotiation.cc:407] Connection header received
0808 15:49:18.793556 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:18.793559 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:18.793605 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:18.793692 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:18.794199 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.795005 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.796136 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.796439 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.796544 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:18.799374 (+ 2830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:18.799379 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:18.799382 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:18.799407 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:18.801167 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.801716 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.801720 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.801722 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.801820 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.802216 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.802220 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.802222 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.802508 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:18.802598 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:18.803087 (+ 489us) server_negotiation.cc:299] Negotiation successful
0808 15:49:18.803221 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 15:49:18.804183 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.792810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:43307 (local address 127.0.0.1:58906)
0808 15:49:18.793289 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.793303 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:18.793438 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:18.793731 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:18.793734 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:18.793925 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:18.794044 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:18.794056 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.795132 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.795139 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:18.796000 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:18.796012 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.796568 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.796572 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:18.796687 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:18.797600 (+ 913us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:18.797618 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:18.799166 (+ 1548us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:18.801297 (+ 2131us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:18.801300 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:18.801301 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:18.801545 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:18.801928 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:18.801931 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:18.801933 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:18.802083 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:18.802723 (+ 640us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:18.802726 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:18.802845 (+ 119us) client_negotiation.cc:769] Sending connection context
0808 15:49:18.803838 (+ 993us) client_negotiation.cc:240] Negotiation successful
0808 15:49:18.804017 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412}
I20260808 15:49:18.804498 22369 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c28db1744c44d4dba5aa41c39d8fc45: No bootstrap required, opened a new log
I20260808 15:49:18.804556 22448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8: No bootstrap required, opened a new log
I20260808 15:49:18.805292 22529 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:49:18.809175 22369 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c28db1744c44d4dba5aa41c39d8fc45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c28db1744c44d4dba5aa41c39d8fc45" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45421 } } peers { permanent_uuid: "b32383caa59140afae7f9eb26783ddd8" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 43307 } } peers { permanent_uuid: "c72ba0afd6bc4adda77c215307547a94" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } }
I20260808 15:49:18.809589 22369 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c28db1744c44d4dba5aa41c39d8fc45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:49:18.809705 22369 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c28db1744c44d4dba5aa41c39d8fc45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c28db1744c44d4dba5aa41c39d8fc45, State: Initialized, Role: FOLLOWER
I20260808 15:49:18.809590 22448 raft_consensus.cc:348] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c28db1744c44d4dba5aa41c39d8fc45" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45421 } } peers { permanent_uuid: "b32383caa59140afae7f9eb26783ddd8" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 43307 } } peers { permanent_uuid: "c72ba0afd6bc4adda77c215307547a94" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } }
I20260808 15:49:18.809811 22448 raft_consensus.cc:374] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:49:18.809859 22448 raft_consensus.cc:729] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b32383caa59140afae7f9eb26783ddd8, State: Initialized, Role: FOLLOWER
I20260808 15:49:18.810398 22369 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c28db1744c44d4dba5aa41c39d8fc45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c28db1744c44d4dba5aa41c39d8fc45" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45421 } } peers { permanent_uuid: "b32383caa59140afae7f9eb26783ddd8" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 43307 } } peers { permanent_uuid: "c72ba0afd6bc4adda77c215307547a94" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } }
I20260808 15:49:18.810400 22448 consensus_queue.cc:260] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c28db1744c44d4dba5aa41c39d8fc45" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45421 } } peers { permanent_uuid: "b32383caa59140afae7f9eb26783ddd8" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 43307 } } peers { permanent_uuid: "c72ba0afd6bc4adda77c215307547a94" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } }
Aug 08 15:49:18 dist-test-slave-8tdl krb5kdc[22286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204158, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.124@KRBTEST.COM for kudu/127.8.39.124@KRBTEST.COM
I20260808 15:49:18.811956 22448 sys_catalog.cc:564] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:49:18.811956 22369 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c28db1744c44d4dba5aa41c39d8fc45 [sys.catalog]: configured and running, proceeding with master startup.
Aug 08 15:49:18 dist-test-slave-8tdl krb5kdc[22286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204158, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.125@KRBTEST.COM
I20260808 15:49:18.817286 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.805854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36447 (local address 127.0.0.1:37340)
0808 15:49:18.805981 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:18.805997 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:18.806081 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:18.806436 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:18.806439 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:18.806626 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:18.806736 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:18.806744 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.807770 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.807773 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:18.808640 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:18.808651 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.809391 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.809398 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:18.809513 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:18.810079 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:18.810096 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:18.812453 (+ 2357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:18.815402 (+ 2949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:18.815405 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:18.815407 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:18.815680 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:18.816023 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:18.816026 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:18.816029 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:18.816120 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:18.816673 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:18.816679 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:18.816780 (+ 101us) client_negotiation.cc:769] Sending connection context
0808 15:49:18.816892 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 15:49:18.817082 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260808 15:49:18.817895 22451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.804577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58922 (local address 127.8.39.125:43307)
0808 15:49:18.804682 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:18.804686 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:18.805084 (+ 398us) server_negotiation.cc:407] Connection header received
0808 15:49:18.805267 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:18.805270 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:18.805313 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:18.805362 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:18.806281 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.807203 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.808390 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.808797 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.808872 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:18.813253 (+ 4381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:18.813260 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:18.813266 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:18.813298 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:18.815263 (+ 1965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.816203 (+ 940us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.816207 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.816210 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.816313 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.816702 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.816706 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.816707 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.816947 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:18.817130 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:18.817588 (+ 458us) server_negotiation.cc:299] Negotiation successful
0808 15:49:18.817729 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 15:49:18.818274 22536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.806036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37340 (local address 127.8.39.124:36447)
0808 15:49:18.806157 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:18.806163 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:18.806175 (+ 12us) server_negotiation.cc:407] Connection header received
0808 15:49:18.806210 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:18.806213 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:18.806260 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:18.806336 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:18.806856 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.807647 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.808760 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.809146 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.809225 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:18.812624 (+ 3399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:18.812628 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:18.812631 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:18.812657 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:18.815263 (+ 2606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.815797 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.815804 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.815808 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.815897 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.816245 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.816250 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.816255 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.816526 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:18.816629 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:18.817721 (+ 1092us) server_negotiation.cc:299] Negotiation successful
0808 15:49:18.817843 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 15:49:18.819519 22540 sys_catalog.cc:455] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c28db1744c44d4dba5aa41c39d8fc45" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45421 } } peers { permanent_uuid: "b32383caa59140afae7f9eb26783ddd8" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 43307 } } peers { permanent_uuid: "c72ba0afd6bc4adda77c215307547a94" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } } }
I20260808 15:49:18.820111 22541 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c28db1744c44d4dba5aa41c39d8fc45 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c28db1744c44d4dba5aa41c39d8fc45" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45421 } } peers { permanent_uuid: "b32383caa59140afae7f9eb26783ddd8" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 43307 } } peers { permanent_uuid: "c72ba0afd6bc4adda77c215307547a94" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } } }
I20260808 15:49:18.820336 22540 sys_catalog.cc:458] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 15:49:18.819823 22565 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:49:18.820539 22565 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:49:18.820693 22541 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c28db1744c44d4dba5aa41c39d8fc45 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:49:18.822103 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:49:18.822188 22529 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c72ba0afd6bc4adda77c215307547a94: Bootstrap starting.
I20260808 15:49:18.825269 22529 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c72ba0afd6bc4adda77c215307547a94: Neither blocks nor log segments found. Creating new log.
I20260808 15:49:18.826143 22529 log.cc:824] T 00000000000000000000000000000000 P c72ba0afd6bc4adda77c215307547a94: Log is configured to *not* fsync() on all Append() calls
I20260808 15:49:18.823505 22300 master_runner.cc:186] Error getting master registration for 127.8.39.124:36447: OK, instance_id { permanent_uuid: "c72ba0afd6bc4adda77c215307547a94" instance_seqno: 1786204158760968 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 15:49:18.824126 22376 master_runner.cc:186] Error getting master registration for 127.8.39.124:36447: OK, instance_id { permanent_uuid: "c72ba0afd6bc4adda77c215307547a94" instance_seqno: 1786204158760968 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 15:49:18.827721 22376 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 15:49:18.827723 22300 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 15:49:18.828420 22529 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c72ba0afd6bc4adda77c215307547a94: No bootstrap required, opened a new log
W20260808 15:49:18.831324 22564 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3c28db1744c44d4dba5aa41c39d8fc45: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:49:18.831676 22564 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:49:18.833103 22529 raft_consensus.cc:348] T 00000000000000000000000000000000 P c72ba0afd6bc4adda77c215307547a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c28db1744c44d4dba5aa41c39d8fc45" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45421 } } peers { permanent_uuid: "b32383caa59140afae7f9eb26783ddd8" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 43307 } } peers { permanent_uuid: "c72ba0afd6bc4adda77c215307547a94" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } }
I20260808 15:49:18.833380 22529 raft_consensus.cc:374] T 00000000000000000000000000000000 P c72ba0afd6bc4adda77c215307547a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:49:18.833498 22529 raft_consensus.cc:729] T 00000000000000000000000000000000 P c72ba0afd6bc4adda77c215307547a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72ba0afd6bc4adda77c215307547a94, State: Initialized, Role: FOLLOWER
I20260808 15:49:18.834043 22529 consensus_queue.cc:260] T 00000000000000000000000000000000 P c72ba0afd6bc4adda77c215307547a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c28db1744c44d4dba5aa41c39d8fc45" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45421 } } peers { permanent_uuid: "b32383caa59140afae7f9eb26783ddd8" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 43307 } } peers { permanent_uuid: "c72ba0afd6bc4adda77c215307547a94" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } }
I20260808 15:49:18.834663 22573 sys_catalog.cc:455] T 00000000000000000000000000000000 P c72ba0afd6bc4adda77c215307547a94 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c28db1744c44d4dba5aa41c39d8fc45" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45421 } } peers { permanent_uuid: "b32383caa59140afae7f9eb26783ddd8" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 43307 } } peers { permanent_uuid: "c72ba0afd6bc4adda77c215307547a94" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } } }
I20260808 15:49:18.835114 22573 sys_catalog.cc:458] T 00000000000000000000000000000000 P c72ba0afd6bc4adda77c215307547a94 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:49:18.835638 22529 sys_catalog.cc:564] T 00000000000000000000000000000000 P c72ba0afd6bc4adda77c215307547a94 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 15:49:18.841084 22586 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c72ba0afd6bc4adda77c215307547a94: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:49:18.841271 22586 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:49:18.843958 22454 master_runner.cc:263] No leader master found from master c72ba0afd6bc4adda77c215307547a94
I20260808 15:49:18.844045 22454 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 15:49:18.850960 22536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.839365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37348 (local address 127.8.39.124:36447)
0808 15:49:18.840607 (+ 1242us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:18.840612 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:18.840625 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:49:18.840662 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:18.840664 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:18.840710 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:18.840782 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:18.842279 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.843192 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.844435 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.844769 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.844852 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:18.846814 (+ 1962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:18.846817 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:18.846820 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:18.846847 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:18.848705 (+ 1858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.849287 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.849291 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.849293 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.849388 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.849758 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.849762 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.849763 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.850034 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:18.850153 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:18.850573 (+ 420us) server_negotiation.cc:299] Negotiation successful
0808 15:49:18.850738 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1158}
I20260808 15:49:18.853523 22540 raft_consensus.cc:482] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:49:18.853713 22540 raft_consensus.cc:504] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c28db1744c44d4dba5aa41c39d8fc45" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45421 } } peers { permanent_uuid: "b32383caa59140afae7f9eb26783ddd8" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 43307 } } peers { permanent_uuid: "c72ba0afd6bc4adda77c215307547a94" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } }
I20260808 15:49:18.854009 22451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.827053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58926 (local address 127.8.39.125:43307)
0808 15:49:18.827197 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:18.827202 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:18.843651 (+ 16449us) server_negotiation.cc:407] Connection header received
0808 15:49:18.843780 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:18.843783 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:18.843832 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:18.843914 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:18.844863 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.845950 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.847476 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.848153 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.848248 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:18.850048 (+ 1800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:18.850053 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:18.850058 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:18.850090 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:18.851935 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.852440 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.852444 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.852445 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.852538 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.852870 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.852873 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.852875 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.853103 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:18.853231 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:18.853680 (+ 449us) server_negotiation.cc:299] Negotiation successful
0808 15:49:18.853811 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 15:49:18.854995 22540 leader_election.cc:288] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c28db1744c44d4dba5aa41c39d8fc45 (127.8.39.126:45421), c72ba0afd6bc4adda77c215307547a94 (127.8.39.124:36447)
I20260808 15:49:18.855831 22343 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b32383caa59140afae7f9eb26783ddd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c28db1744c44d4dba5aa41c39d8fc45" is_pre_election: true
I20260808 15:49:18.855950 22502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b32383caa59140afae7f9eb26783ddd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72ba0afd6bc4adda77c215307547a94" is_pre_election: true
I20260808 15:49:18.856163 22343 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3c28db1744c44d4dba5aa41c39d8fc45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b32383caa59140afae7f9eb26783ddd8 in term 0.
I20260808 15:49:18.856268 22502 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c72ba0afd6bc4adda77c215307547a94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b32383caa59140afae7f9eb26783ddd8 in term 0.
I20260808 15:49:18.856704 22395 leader_election.cc:302] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b32383caa59140afae7f9eb26783ddd8, c72ba0afd6bc4adda77c215307547a94; no voters:
I20260808 15:49:18.857044 22540 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:49:18.857132 22540 raft_consensus.cc:482] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:49:18.857188 22540 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:49:18.858604 22540 raft_consensus.cc:504] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c28db1744c44d4dba5aa41c39d8fc45" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45421 } } peers { permanent_uuid: "b32383caa59140afae7f9eb26783ddd8" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 43307 } } peers { permanent_uuid: "c72ba0afd6bc4adda77c215307547a94" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } }
I20260808 15:49:18.859050 22540 leader_election.cc:288] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [CANDIDATE]: Term 1 election: Requested vote from peers 3c28db1744c44d4dba5aa41c39d8fc45 (127.8.39.126:45421), c72ba0afd6bc4adda77c215307547a94 (127.8.39.124:36447)
I20260808 15:49:18.859664 22343 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b32383caa59140afae7f9eb26783ddd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c28db1744c44d4dba5aa41c39d8fc45"
I20260808 15:49:18.859882 22502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b32383caa59140afae7f9eb26783ddd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72ba0afd6bc4adda77c215307547a94"
I20260808 15:49:18.860046 22502 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c72ba0afd6bc4adda77c215307547a94 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:49:18.860106 22343 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c28db1744c44d4dba5aa41c39d8fc45 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:49:18.861460 22343 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3c28db1744c44d4dba5aa41c39d8fc45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b32383caa59140afae7f9eb26783ddd8 in term 1.
I20260808 15:49:18.861460 22502 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c72ba0afd6bc4adda77c215307547a94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b32383caa59140afae7f9eb26783ddd8 in term 1.
I20260808 15:49:18.861893 22394 leader_election.cc:302] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c28db1744c44d4dba5aa41c39d8fc45, b32383caa59140afae7f9eb26783ddd8; no voters:
I20260808 15:49:18.862172 22540 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:49:18.862501 22540 raft_consensus.cc:686] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [term 1 LEADER]: Becoming Leader. State: Replica: b32383caa59140afae7f9eb26783ddd8, State: Running, Role: LEADER
I20260808 15:49:18.863003 22540 consensus_queue.cc:237] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c28db1744c44d4dba5aa41c39d8fc45" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45421 } } peers { permanent_uuid: "b32383caa59140afae7f9eb26783ddd8" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 43307 } } peers { permanent_uuid: "c72ba0afd6bc4adda77c215307547a94" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } }
I20260808 15:49:18.864933 22537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:18.838361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59898 (local address 127.8.39.126:45421)
0808 15:49:18.838509 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:18.838514 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:18.853198 (+ 14684us) server_negotiation.cc:407] Connection header received
0808 15:49:18.853415 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:18.853419 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:18.853478 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:18.853538 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:18.854397 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.855313 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.856383 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:18.856767 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:18.856852 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:18.858751 (+ 1899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:18.858755 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:18.858758 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:18.858791 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:18.862575 (+ 3784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.863369 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.863373 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.863375 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.863478 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:18.863824 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:18.863827 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:18.863829 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:18.864106 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:18.864217 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:18.864619 (+ 402us) server_negotiation.cc:299] Negotiation successful
0808 15:49:18.864766 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 15:49:18.865815 22540 sys_catalog.cc:455] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b32383caa59140afae7f9eb26783ddd8. Latest consensus state: current_term: 1 leader_uuid: "b32383caa59140afae7f9eb26783ddd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c28db1744c44d4dba5aa41c39d8fc45" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45421 } } peers { permanent_uuid: "b32383caa59140afae7f9eb26783ddd8" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 43307 } } peers { permanent_uuid: "c72ba0afd6bc4adda77c215307547a94" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } } }
I20260808 15:49:18.866012 22540 sys_catalog.cc:458] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [sys.catalog]: This master's current role is: LEADER
I20260808 15:49:18.867025 22593 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:49:18.868077 22593 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:49:18.877323 22502 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c72ba0afd6bc4adda77c215307547a94 [term 1 FOLLOWER]: Refusing update from remote peer b32383caa59140afae7f9eb26783ddd8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:49:18.878156 22540 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72ba0afd6bc4adda77c215307547a94" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:49:18.882970 22573 sys_catalog.cc:455] T 00000000000000000000000000000000 P c72ba0afd6bc4adda77c215307547a94 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b32383caa59140afae7f9eb26783ddd8. Latest consensus state: current_term: 1 leader_uuid: "b32383caa59140afae7f9eb26783ddd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c28db1744c44d4dba5aa41c39d8fc45" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45421 } } peers { permanent_uuid: "b32383caa59140afae7f9eb26783ddd8" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 43307 } } peers { permanent_uuid: "c72ba0afd6bc4adda77c215307547a94" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } } }
I20260808 15:49:18.883111 22573 sys_catalog.cc:458] T 00000000000000000000000000000000 P c72ba0afd6bc4adda77c215307547a94 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:49:18.884300 22343 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3c28db1744c44d4dba5aa41c39d8fc45 [term 1 FOLLOWER]: Refusing update from remote peer b32383caa59140afae7f9eb26783ddd8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:49:18.885062 22591 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c28db1744c44d4dba5aa41c39d8fc45" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:49:18.888978 22541 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c28db1744c44d4dba5aa41c39d8fc45 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b32383caa59140afae7f9eb26783ddd8. Latest consensus state: current_term: 1 leader_uuid: "b32383caa59140afae7f9eb26783ddd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c28db1744c44d4dba5aa41c39d8fc45" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45421 } } peers { permanent_uuid: "b32383caa59140afae7f9eb26783ddd8" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 43307 } } peers { permanent_uuid: "c72ba0afd6bc4adda77c215307547a94" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } } }
I20260808 15:49:18.889117 22541 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c28db1744c44d4dba5aa41c39d8fc45 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:49:18.890349 22591 sys_catalog.cc:455] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b32383caa59140afae7f9eb26783ddd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c28db1744c44d4dba5aa41c39d8fc45" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45421 } } peers { permanent_uuid: "b32383caa59140afae7f9eb26783ddd8" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 43307 } } peers { permanent_uuid: "c72ba0afd6bc4adda77c215307547a94" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } } }
I20260808 15:49:18.890501 22591 sys_catalog.cc:458] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [sys.catalog]: This master's current role is: LEADER
I20260808 15:49:18.891188 22573 sys_catalog.cc:455] T 00000000000000000000000000000000 P c72ba0afd6bc4adda77c215307547a94 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b32383caa59140afae7f9eb26783ddd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c28db1744c44d4dba5aa41c39d8fc45" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45421 } } peers { permanent_uuid: "b32383caa59140afae7f9eb26783ddd8" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 43307 } } peers { permanent_uuid: "c72ba0afd6bc4adda77c215307547a94" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } } }
I20260808 15:49:18.891311 22573 sys_catalog.cc:458] T 00000000000000000000000000000000 P c72ba0afd6bc4adda77c215307547a94 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:49:18.892014 22595 mvcc.cc:205] Tried to move back new op lower bound from 7316292234753654784 to 7316292234707144704. Current Snapshot: MvccSnapshot[applied={T|T < 7316292234753654784}]
I20260808 15:49:18.895763 22593 catalog_manager.cc:1347] Generated new cluster ID: 5025f71961a9417e998ec6a0e5cff192
I20260808 15:49:18.895838 22593 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:49:18.901280 22540 sys_catalog.cc:455] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b32383caa59140afae7f9eb26783ddd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c28db1744c44d4dba5aa41c39d8fc45" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45421 } } peers { permanent_uuid: "b32383caa59140afae7f9eb26783ddd8" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 43307 } } peers { permanent_uuid: "c72ba0afd6bc4adda77c215307547a94" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } } }
I20260808 15:49:18.901423 22540 sys_catalog.cc:458] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8 [sys.catalog]: This master's current role is: LEADER
I20260808 15:49:18.902618 22541 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c28db1744c44d4dba5aa41c39d8fc45 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b32383caa59140afae7f9eb26783ddd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c28db1744c44d4dba5aa41c39d8fc45" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45421 } } peers { permanent_uuid: "b32383caa59140afae7f9eb26783ddd8" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 43307 } } peers { permanent_uuid: "c72ba0afd6bc4adda77c215307547a94" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36447 } } }
I20260808 15:49:18.903735 22541 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c28db1744c44d4dba5aa41c39d8fc45 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:49:18.905508 22597 mvcc.cc:205] Tried to move back new op lower bound from 7316292234753654784 to 7316292234707144704. Current Snapshot: MvccSnapshot[applied={T|T < 7316292234753654784}]
I20260808 15:49:18.921579 22593 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:49:18.923108 22593 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:49:18.946573 22593 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b32383caa59140afae7f9eb26783ddd8: Generated new TSK 0
I20260808 15:49:18.947676 22593 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:49:19.833200 22564 catalog_manager.cc:1259] Loaded cluster ID: 5025f71961a9417e998ec6a0e5cff192
I20260808 15:49:19.833312 22564 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3c28db1744c44d4dba5aa41c39d8fc45: loading cluster ID for follower catalog manager: success
I20260808 15:49:19.835304 22564 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3c28db1744c44d4dba5aa41c39d8fc45: acquiring CA information for follower catalog manager: success
I20260808 15:49:19.836869 22564 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3c28db1744c44d4dba5aa41c39d8fc45: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 15:49:19.844631 22586 catalog_manager.cc:1259] Loaded cluster ID: 5025f71961a9417e998ec6a0e5cff192
I20260808 15:49:19.844723 22586 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c72ba0afd6bc4adda77c215307547a94: loading cluster ID for follower catalog manager: success
I20260808 15:49:19.846563 22586 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c72ba0afd6bc4adda77c215307547a94: acquiring CA information for follower catalog manager: success
I20260808 15:49:19.847846 22586 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c72ba0afd6bc4adda77c215307547a94: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 15:49:20.020112 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 22300
W20260808 15:49:20.028110 22394 connection.cc:535] client connection to 127.8.39.126:45421 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 15:49:20.028335 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 22376
I20260808 15:49:20.035620 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 22454
2026-08-08T15:49:20Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3160 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:49:20 dist-test-slave-8tdl krb5kdc[22613](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:49:20 dist-test-slave-8tdl krb5kdc[22613](info): set up 2 sockets
Aug 08 15:49:20 dist-test-slave-8tdl krb5kdc[22613](info): commencing operation
krb5kdc: starting...
W20260808 15:49:21.160220 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:49:21 dist-test-slave-8tdl krb5kdc[22613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204161, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:49:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:49:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:49:21.294767 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:37615
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:41109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:37615
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:49:21.430114 22627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:21.430611 22627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:21.430737 22627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:21.439670 22627 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:49:21.439782 22627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:21.439822 22627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:21.439869 22627 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:49:21.439915 22627 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:49:21.446568 22627 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:41109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:37615
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:37615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22627
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:21.447908 22627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:21.448951 22627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:49:21.457635 22633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:21.457839 22627 server_base.cc:1034] running on GCE node
W20260808 15:49:21.457650 22632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:21.457659 22635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:21.458642 22627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:21.459887 22627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:21.461078 22627 hybrid_clock.cc:648] HybridClock initialized: now 1786204161461061 us; error 32 us; skew 500 ppm
Aug 08 15:49:21 dist-test-slave-8tdl krb5kdc[22613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204161, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:21.463938 22627 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:49:21.464882 22627 webserver.cc:460] Webserver started at http://127.8.39.126:42187/ using document root <none> and password file <none>
I20260808 15:49:21.465452 22627 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:21.465545 22627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:49:21.465780 22627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:49:21.467962 22627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "a7e28534930d43e1adb9aa52f68152d1"
format_stamp: "Formatted at 2026-08-08 15:49:21 on dist-test-slave-8tdl"
server_key: "87eca4e00061fb83afa39f10c5c490ac"
server_key_iv: "b5f99ca2384b17ae2776266d5fb8db8f"
server_key_version: "encryptionkey@0"
I20260808 15:49:21.468585 22627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "a7e28534930d43e1adb9aa52f68152d1"
format_stamp: "Formatted at 2026-08-08 15:49:21 on dist-test-slave-8tdl"
server_key: "87eca4e00061fb83afa39f10c5c490ac"
server_key_iv: "b5f99ca2384b17ae2776266d5fb8db8f"
server_key_version: "encryptionkey@0"
I20260808 15:49:21.472635 22627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 15:49:21.475221 22643 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:21.476519 22627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:49:21.476675 22627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "a7e28534930d43e1adb9aa52f68152d1"
format_stamp: "Formatted at 2026-08-08 15:49:21 on dist-test-slave-8tdl"
server_key: "87eca4e00061fb83afa39f10c5c490ac"
server_key_iv: "b5f99ca2384b17ae2776266d5fb8db8f"
server_key_version: "encryptionkey@0"
I20260808 15:49:21.476796 22627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:21.491587 22627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:21.495007 22627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:21.495218 22627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:21.502707 22627 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:37615
I20260808 15:49:21.502708 22696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:37615 every 8 connection(s)
I20260808 15:49:21.503712 22627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:49:21.506628 22697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:49:21.512243 22697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7e28534930d43e1adb9aa52f68152d1: Bootstrap starting.
I20260808 15:49:21.513147 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 22627
I20260808 15:49:21.513289 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:49:21.513573 8349 external_mini_cluster.cc:1428] Setting key adc68eca2a4bd1a98589b53aefeeba86
I20260808 15:49:21.515105 22697 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a7e28534930d43e1adb9aa52f68152d1: Neither blocks nor log segments found. Creating new log.
I20260808 15:49:21.515885 22697 log.cc:824] T 00000000000000000000000000000000 P a7e28534930d43e1adb9aa52f68152d1: Log is configured to *not* fsync() on all Append() calls
I20260808 15:49:21.518076 22697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7e28534930d43e1adb9aa52f68152d1: No bootstrap required, opened a new log
I20260808 15:49:21.522228 22697 raft_consensus.cc:348] T 00000000000000000000000000000000 P a7e28534930d43e1adb9aa52f68152d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7e28534930d43e1adb9aa52f68152d1" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 37615 } }
I20260808 15:49:21.522478 22697 raft_consensus.cc:374] T 00000000000000000000000000000000 P a7e28534930d43e1adb9aa52f68152d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:49:21.522568 22697 raft_consensus.cc:729] T 00000000000000000000000000000000 P a7e28534930d43e1adb9aa52f68152d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e28534930d43e1adb9aa52f68152d1, State: Initialized, Role: FOLLOWER
Aug 08 15:49:21 dist-test-slave-8tdl krb5kdc[22613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204161, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:49:21.523100 22697 consensus_queue.cc:260] T 00000000000000000000000000000000 P a7e28534930d43e1adb9aa52f68152d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7e28534930d43e1adb9aa52f68152d1" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 37615 } }
I20260808 15:49:21.523288 22697 raft_consensus.cc:388] T 00000000000000000000000000000000 P a7e28534930d43e1adb9aa52f68152d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:49:21.523372 22697 raft_consensus.cc:482] T 00000000000000000000000000000000 P a7e28534930d43e1adb9aa52f68152d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:49:21.523471 22697 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a7e28534930d43e1adb9aa52f68152d1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:49:21.524739 22697 raft_consensus.cc:504] T 00000000000000000000000000000000 P a7e28534930d43e1adb9aa52f68152d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7e28534930d43e1adb9aa52f68152d1" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 37615 } }
I20260808 15:49:21.525137 22697 leader_election.cc:302] T 00000000000000000000000000000000 P a7e28534930d43e1adb9aa52f68152d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a7e28534930d43e1adb9aa52f68152d1; no voters:
I20260808 15:49:21.525528 22697 leader_election.cc:288] T 00000000000000000000000000000000 P a7e28534930d43e1adb9aa52f68152d1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:49:21.525682 22702 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a7e28534930d43e1adb9aa52f68152d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:49:21.525949 22702 raft_consensus.cc:686] T 00000000000000000000000000000000 P a7e28534930d43e1adb9aa52f68152d1 [term 1 LEADER]: Becoming Leader. State: Replica: a7e28534930d43e1adb9aa52f68152d1, State: Running, Role: LEADER
I20260808 15:49:21.526263 22702 consensus_queue.cc:237] T 00000000000000000000000000000000 P a7e28534930d43e1adb9aa52f68152d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7e28534930d43e1adb9aa52f68152d1" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 37615 } }
I20260808 15:49:21.526963 22697 sys_catalog.cc:564] T 00000000000000000000000000000000 P a7e28534930d43e1adb9aa52f68152d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:49:21.528333 22704 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7e28534930d43e1adb9aa52f68152d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a7e28534930d43e1adb9aa52f68152d1. Latest consensus state: current_term: 1 leader_uuid: "a7e28534930d43e1adb9aa52f68152d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7e28534930d43e1adb9aa52f68152d1" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 37615 } } }
I20260808 15:49:21.528457 22704 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7e28534930d43e1adb9aa52f68152d1 [sys.catalog]: This master's current role is: LEADER
I20260808 15:49:21.528693 22703 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7e28534930d43e1adb9aa52f68152d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a7e28534930d43e1adb9aa52f68152d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7e28534930d43e1adb9aa52f68152d1" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 37615 } } }
I20260808 15:49:21.528793 22703 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7e28534930d43e1adb9aa52f68152d1 [sys.catalog]: This master's current role is: LEADER
I20260808 15:49:21.530444 22700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:21.514654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39272 (local address 127.8.39.126:37615)
0808 15:49:21.515140 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:21.515168 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:21.515203 (+ 35us) server_negotiation.cc:407] Connection header received
0808 15:49:21.515880 (+ 677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:21.515897 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:21.516270 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:21.516556 (+ 286us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:21.517324 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:21.518791 (+ 1467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:21.519824 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:21.520546 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:21.520733 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:21.523875 (+ 3142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:21.523881 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:21.523898 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:21.523930 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:21.526177 (+ 2247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:21.526766 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:21.526772 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:21.526778 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:21.526916 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:21.527256 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:21.527259 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:21.527260 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:21.527810 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:21.528973 (+ 1163us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:21.529146 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 15:49:21.529469 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":156,"threads_started":1}
W20260808 15:49:21.532364 22720 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a7e28534930d43e1adb9aa52f68152d1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:49:21.532445 22720 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:49:21.532595 22713 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:49:21.533392 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:49:21.534349 22713 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:49:21.540347 22713 catalog_manager.cc:1347] Generated new cluster ID: 31d1f3d5c57a44d3b659d7eef32bff36
I20260808 15:49:21.540441 22713 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:49:21.548110 22713 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:49:21.549443 22713 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:49:21.560006 22713 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a7e28534930d43e1adb9aa52f68152d1: Generated new TSK 0
I20260808 15:49:21.560880 22713 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:49:21.589754 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 22627
2026-08-08T15:49:21Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1551 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:49:21 dist-test-slave-8tdl krb5kdc[22726](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:49:21 dist-test-slave-8tdl krb5kdc[22726](info): set up 2 sockets
Aug 08 15:49:21 dist-test-slave-8tdl krb5kdc[22726](info): commencing operation
krb5kdc: starting...
W20260808 15:49:22.668849 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.058s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:49:22 dist-test-slave-8tdl krb5kdc[22726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:49:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:49:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:49:22.818503 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:41885
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:42587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:41885
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:49:22.932749 22740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:22.933097 22740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:22.933171 22740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:22.937345 22740 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:49:22.937436 22740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:22.937471 22740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:22.937515 22740 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:49:22.937551 22740 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:49:22.943048 22740 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:42587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:41885
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:41885
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22740
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:22.944177 22740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:22.945225 22740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:49:22.953948 22746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:22.954106 22745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:22.953955 22748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:22.954316 22740 server_base.cc:1034] running on GCE node
I20260808 15:49:22.955030 22740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:22.956247 22740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:22.957485 22740 hybrid_clock.cc:648] HybridClock initialized: now 1786204162957460 us; error 36 us; skew 500 ppm
Aug 08 15:49:22 dist-test-slave-8tdl krb5kdc[22726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204162, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:22.960614 22740 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:49:22.961697 22740 webserver.cc:460] Webserver started at http://127.8.39.126:38411/ using document root <none> and password file <none>
I20260808 15:49:22.962304 22740 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:22.962374 22740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:49:22.962618 22740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:49:22.964922 22740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "c3ebb2e9d40a47beb462e80fd8298e3d"
format_stamp: "Formatted at 2026-08-08 15:49:22 on dist-test-slave-8tdl"
server_key: "b1835eddc3e096318828bd9405d2a8e9"
server_key_iv: "7a4c1ab63ea6089a9c34528fe7432767"
server_key_version: "encryptionkey@0"
I20260808 15:49:22.965576 22740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "c3ebb2e9d40a47beb462e80fd8298e3d"
format_stamp: "Formatted at 2026-08-08 15:49:22 on dist-test-slave-8tdl"
server_key: "b1835eddc3e096318828bd9405d2a8e9"
server_key_iv: "7a4c1ab63ea6089a9c34528fe7432767"
server_key_version: "encryptionkey@0"
I20260808 15:49:22.969772 22740 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 15:49:22.972537 22757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:22.973867 22740 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:49:22.974022 22740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "c3ebb2e9d40a47beb462e80fd8298e3d"
format_stamp: "Formatted at 2026-08-08 15:49:22 on dist-test-slave-8tdl"
server_key: "b1835eddc3e096318828bd9405d2a8e9"
server_key_iv: "7a4c1ab63ea6089a9c34528fe7432767"
server_key_version: "encryptionkey@0"
I20260808 15:49:22.974146 22740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:22.985548 22740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:22.988680 22740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:22.988921 22740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:22.996380 22740 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:41885
I20260808 15:49:22.996702 22809 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:41885 every 8 connection(s)
I20260808 15:49:22.997480 22740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:49:23.000315 22810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:49:23.006194 22810 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d: Bootstrap starting.
I20260808 15:49:23.006800 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 22740
I20260808 15:49:23.007037 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:49:23.007369 8349 external_mini_cluster.cc:1428] Setting key 9ba974f7e9cabc1ba20297be2ff882c3
I20260808 15:49:23.009284 22810 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d: Neither blocks nor log segments found. Creating new log.
I20260808 15:49:23.010090 22810 log.cc:824] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d: Log is configured to *not* fsync() on all Append() calls
I20260808 15:49:23.012581 22810 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d: No bootstrap required, opened a new log
I20260808 15:49:23.017105 22810 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ebb2e9d40a47beb462e80fd8298e3d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41885 } }
I20260808 15:49:23.017446 22810 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:49:23.017541 22810 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3ebb2e9d40a47beb462e80fd8298e3d, State: Initialized, Role: FOLLOWER
I20260808 15:49:23.017983 22810 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ebb2e9d40a47beb462e80fd8298e3d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41885 } }
Aug 08 15:49:23 dist-test-slave-8tdl krb5kdc[22726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:49:23.018144 22810 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:49:23.018227 22810 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:49:23.018334 22810 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:49:23.019421 22810 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ebb2e9d40a47beb462e80fd8298e3d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41885 } }
I20260808 15:49:23.019784 22810 leader_election.cc:302] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3ebb2e9d40a47beb462e80fd8298e3d; no voters:
I20260808 15:49:23.020121 22810 leader_election.cc:288] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:49:23.020275 22815 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:49:23.020547 22815 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [term 1 LEADER]: Becoming Leader. State: Replica: c3ebb2e9d40a47beb462e80fd8298e3d, State: Running, Role: LEADER
I20260808 15:49:23.020867 22815 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ebb2e9d40a47beb462e80fd8298e3d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41885 } }
I20260808 15:49:23.021571 22810 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:49:23.022094 22815 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3ebb2e9d40a47beb462e80fd8298e3d. Latest consensus state: current_term: 1 leader_uuid: "c3ebb2e9d40a47beb462e80fd8298e3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ebb2e9d40a47beb462e80fd8298e3d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41885 } } }
I20260808 15:49:23.022230 22815 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [sys.catalog]: This master's current role is: LEADER
I20260808 15:49:23.022773 22819 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:49:23.023940 22816 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3ebb2e9d40a47beb462e80fd8298e3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ebb2e9d40a47beb462e80fd8298e3d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41885 } } }
I20260808 15:49:23.024047 22816 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [sys.catalog]: This master's current role is: LEADER
I20260808 15:49:23.025512 22813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:23.008958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53778 (local address 127.8.39.126:41885)
0808 15:49:23.009489 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:23.009507 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:23.009546 (+ 39us) server_negotiation.cc:407] Connection header received
0808 15:49:23.010437 (+ 891us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:23.010461 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:23.010937 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:23.011246 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:23.012213 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.013514 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.014792 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.015364 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.015506 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:23.018909 (+ 3403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:23.018915 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:23.018929 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:23.018961 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:23.021147 (+ 2186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:23.021684 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:23.021690 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:23.021696 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:23.021862 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:23.022228 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:23.022230 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:23.022232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:23.022857 (+ 625us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:23.023911 (+ 1054us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:23.024260 (+ 349us) server_negotiation.cc:299] Negotiation successful
0808 15:49:23.024571 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":171,"threads_started":1}
I20260808 15:49:23.026314 22819 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:49:23.035524 22819 catalog_manager.cc:1347] Generated new cluster ID: 5de1381d3f8848128e50f785fbdf859b
I20260808 15:49:23.035612 22819 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:49:23.049767 22819 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:49:23.051141 22819 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:49:23.058736 22819 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d: Generated new TSK 0
I20260808 15:49:23.059568 22819 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.39.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
I20260808 15:49:23.103588 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:0
--local_ip_for_outbound_sockets=127.8.39.65
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41885
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:42587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:49:23.231983 22838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:23.232259 22838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:23.232304 22838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:23.236394 22838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:23.236464 22838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:23.236522 22838 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:49:23.242864 22838 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:42587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41885
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22838
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:23.243979 22838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:23.245031 22838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:49:23.255025 22846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:23.255026 22843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:23.255170 22844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:23.255338 22838 server_base.cc:1034] running on GCE node
I20260808 15:49:23.255805 22838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:23.256488 22838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:23.257685 22838 hybrid_clock.cc:648] HybridClock initialized: now 1786204163257643 us; error 59 us; skew 500 ppm
Aug 08 15:49:23 dist-test-slave-8tdl krb5kdc[22726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204163, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:23.260771 22838 init.cc:377] Logged in from keytab as kudu/127.8.39.65@KRBTEST.COM (short username kudu)
I20260808 15:49:23.261754 22838 webserver.cc:460] Webserver started at http://127.8.39.65:40123/ using document root <none> and password file <none>
I20260808 15:49:23.262379 22838 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:23.262478 22838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:49:23.262773 22838 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:49:23.264874 22838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/data/instance:
uuid: "afb49f4400ec4df29448214d18c565ec"
format_stamp: "Formatted at 2026-08-08 15:49:23 on dist-test-slave-8tdl"
server_key: "d0026081035ebcb1b92b3cf77a1b6baf"
server_key_iv: "e2ce5a934938cb0780971e99c1a91f2d"
server_key_version: "encryptionkey@0"
I20260808 15:49:23.265476 22838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance:
uuid: "afb49f4400ec4df29448214d18c565ec"
format_stamp: "Formatted at 2026-08-08 15:49:23 on dist-test-slave-8tdl"
server_key: "d0026081035ebcb1b92b3cf77a1b6baf"
server_key_iv: "e2ce5a934938cb0780971e99c1a91f2d"
server_key_version: "encryptionkey@0"
I20260808 15:49:23.269443 22838 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 15:49:23.272084 22855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:23.273409 22838 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:49:23.273556 22838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "afb49f4400ec4df29448214d18c565ec"
format_stamp: "Formatted at 2026-08-08 15:49:23 on dist-test-slave-8tdl"
server_key: "d0026081035ebcb1b92b3cf77a1b6baf"
server_key_iv: "e2ce5a934938cb0780971e99c1a91f2d"
server_key_version: "encryptionkey@0"
I20260808 15:49:23.273680 22838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:23.298463 22838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:23.302027 22838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:23.302255 22838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:23.302958 22838 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:49:23.303865 22838 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:49:23.303941 22838 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:23.304019 22838 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:49:23.304062 22838 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:23.313685 22838 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:44579
I20260808 15:49:23.313726 22974 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:44579 every 8 connection(s)
I20260808 15:49:23.314661 22838 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:49:23.322707 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 22838
I20260808 15:49:23.322862 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance
I20260808 15:49:23.323242 8349 external_mini_cluster.cc:1428] Setting key fa284aab2974969b930116dd50314185
Aug 08 15:49:23 dist-test-slave-8tdl krb5kdc[22726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204163, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:49:23.329507 22813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:23.316685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:53209 (local address 127.8.39.126:41885)
0808 15:49:23.316843 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:23.316847 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:23.317932 (+ 1085us) server_negotiation.cc:407] Connection header received
0808 15:49:23.318878 (+ 946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:23.318882 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:23.318943 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:23.319055 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:23.320251 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.320804 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.322125 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.322374 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.322472 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:23.325712 (+ 3240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:23.325715 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:23.325718 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:23.325746 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:23.327345 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:23.327902 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:23.327906 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:23.327908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:23.327991 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:23.328353 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:23.328357 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:23.328359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:23.328549 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:23.328660 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:23.329194 (+ 534us) server_negotiation.cc:299] Negotiation successful
0808 15:49:23.329333 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 15:49:23.330435 22978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:23.317090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.65:53209)
0808 15:49:23.317770 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:23.317815 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:23.318643 (+ 828us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:23.319226 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:23.319233 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:23.319603 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:23.320094 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:23.320108 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.320945 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.320949 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:23.321931 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:23.321941 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.322576 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.322582 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:23.322845 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:23.323617 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:23.323639 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:23.325526 (+ 1887us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:23.327477 (+ 1951us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:23.327484 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:23.327501 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:23.327786 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:23.328085 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:23.328088 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:23.328090 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:23.328253 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:23.328660 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:23.328669 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:23.328952 (+ 283us) client_negotiation.cc:769] Sending connection context
0808 15:49:23.329156 (+ 204us) client_negotiation.cc:240] Negotiation successful
0808 15:49:23.329535 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":118,"threads_started":1}
I20260808 15:49:23.331979 22976 heartbeater.cc:347] Connected to a master server at 127.8.39.126:41885
I20260808 15:49:23.332273 22976 heartbeater.cc:464] Registering TS with master...
I20260808 15:49:23.332818 22976 heartbeater.cc:511] Master 127.8.39.126:41885 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.8.39.66@KRBTEST.COM; defaulting to no policy
I20260808 15:49:23.334451 22774 ts_manager.cc:194] Registered new tserver with Master: afb49f4400ec4df29448214d18c565ec (127.8.39.65:44579)
I20260808 15:49:23.335708 22774 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.65@KRBTEST.COM'} at 127.8.39.65:53209
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
I20260808 15:49:23.354387 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:0
--local_ip_for_outbound_sockets=127.8.39.66
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41885
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:42587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:49:23.470978 22981 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:23.471316 22981 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:23.471447 22981 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:23.476094 22981 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:23.476193 22981 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:23.476291 22981 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:49:23.482645 22981 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:42587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41885
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22981
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:23.483978 22981 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:23.485113 22981 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:49:23.496134 22989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:23.496096 22987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:23.496101 22986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:23.496519 22981 server_base.cc:1034] running on GCE node
I20260808 15:49:23.496903 22981 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:23.497499 22981 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:23.498660 22981 hybrid_clock.cc:648] HybridClock initialized: now 1786204163498629 us; error 44 us; skew 500 ppm
Aug 08 15:49:23 dist-test-slave-8tdl krb5kdc[22726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204163, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:23.501507 22981 init.cc:377] Logged in from keytab as kudu/127.8.39.66@KRBTEST.COM (short username kudu)
I20260808 15:49:23.502390 22981 webserver.cc:460] Webserver started at http://127.8.39.66:45347/ using document root <none> and password file <none>
I20260808 15:49:23.502995 22981 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:23.503060 22981 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:49:23.503232 22981 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:49:23.505277 22981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/data/instance:
uuid: "ae59124ccaf9459d94da42e455cd38ec"
format_stamp: "Formatted at 2026-08-08 15:49:23 on dist-test-slave-8tdl"
server_key: "3626f5f4978c1f57c5694c9a37a5c159"
server_key_iv: "977888b8bc5722ebc2be48cacd5d94b0"
server_key_version: "encryptionkey@0"
I20260808 15:49:23.505820 22981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance:
uuid: "ae59124ccaf9459d94da42e455cd38ec"
format_stamp: "Formatted at 2026-08-08 15:49:23 on dist-test-slave-8tdl"
server_key: "3626f5f4978c1f57c5694c9a37a5c159"
server_key_iv: "977888b8bc5722ebc2be48cacd5d94b0"
server_key_version: "encryptionkey@0"
I20260808 15:49:23.509615 22981 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 15:49:23.512205 22997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:23.513530 22981 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:49:23.513628 22981 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "ae59124ccaf9459d94da42e455cd38ec"
format_stamp: "Formatted at 2026-08-08 15:49:23 on dist-test-slave-8tdl"
server_key: "3626f5f4978c1f57c5694c9a37a5c159"
server_key_iv: "977888b8bc5722ebc2be48cacd5d94b0"
server_key_version: "encryptionkey@0"
I20260808 15:49:23.513718 22981 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:23.527524 22981 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:23.530516 22981 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:23.530721 22981 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:23.531291 22981 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:49:23.532066 22981 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:49:23.532114 22981 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:23.532152 22981 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:49:23.532167 22981 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:23.541266 22981 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:39761
I20260808 15:49:23.541296 23114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:39761 every 8 connection(s)
I20260808 15:49:23.542156 22981 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
Aug 08 15:49:23 dist-test-slave-8tdl krb5kdc[22726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204163, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:49:23.552263 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 22981
I20260808 15:49:23.552394 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance
I20260808 15:49:23.552676 8349 external_mini_cluster.cc:1428] Setting key 1c0cdfdebda6357def4366b01d8feb73
I20260808 15:49:23.555720 22813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:23.544010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:51057 (local address 127.8.39.126:41885)
0808 15:49:23.544170 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:23.544173 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:23.545223 (+ 1050us) server_negotiation.cc:407] Connection header received
0808 15:49:23.546046 (+ 823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:23.546049 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:23.546096 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:23.546172 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:23.547469 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.548006 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.549107 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.549325 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.549428 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:23.551984 (+ 2556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:23.551988 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:23.551991 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:23.552017 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:23.553587 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:23.554102 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:23.554112 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:23.554114 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:23.554186 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:23.554527 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:23.554532 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:23.554534 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:23.554791 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:23.554906 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:23.555418 (+ 512us) server_negotiation.cc:299] Negotiation successful
0808 15:49:23.555552 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 15:49:23.556531 23117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:23.544385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.66:51057)
0808 15:49:23.545067 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:23.545110 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:23.545864 (+ 754us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:23.546333 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:23.546340 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:23.546768 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:23.547299 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:23.547312 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.548124 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.548126 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:23.548975 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:23.548984 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.549481 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.549484 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:23.549623 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:23.550246 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:23.550262 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:23.551821 (+ 1559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:23.553704 (+ 1883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:23.553710 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:23.553726 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:23.553992 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:23.554278 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:23.554282 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:23.554284 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:23.554425 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:23.554916 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:23.554924 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:23.555174 (+ 250us) client_negotiation.cc:769] Sending connection context
0808 15:49:23.555363 (+ 189us) client_negotiation.cc:240] Negotiation successful
0808 15:49:23.555689 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":106,"threads_started":1}
I20260808 15:49:23.557884 23115 heartbeater.cc:347] Connected to a master server at 127.8.39.126:41885
I20260808 15:49:23.558198 23115 heartbeater.cc:464] Registering TS with master...
I20260808 15:49:23.558766 23115 heartbeater.cc:511] Master 127.8.39.126:41885 requested a full tablet report, sending...
I20260808 15:49:23.559917 22774 ts_manager.cc:194] Registered new tserver with Master: ae59124ccaf9459d94da42e455cd38ec (127.8.39.66:39761)
I20260808 15:49:23.560613 22774 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.66@KRBTEST.COM'} at 127.8.39.66:51057
WARNING: no policy specified for kudu/127.8.39.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
I20260808 15:49:23.582578 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:0
--local_ip_for_outbound_sockets=127.8.39.67
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41885
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:42587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:49:23.701213 23121 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:23.701514 23121 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:23.701560 23121 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:23.705825 23121 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:23.705907 23121 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:23.705977 23121 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:49:23.711807 23121 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:42587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41885
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23121
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:23.712901 23121 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:23.713917 23121 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:49:23.723990 23127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:23.724072 23130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:23.724527 23126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:23.724786 23121 server_base.cc:1034] running on GCE node
I20260808 15:49:23.725219 23121 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:23.725960 23121 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:23.727151 23121 hybrid_clock.cc:648] HybridClock initialized: now 1786204163727122 us; error 47 us; skew 500 ppm
Aug 08 15:49:23 dist-test-slave-8tdl krb5kdc[22726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204163, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:23.730937 23121 init.cc:377] Logged in from keytab as kudu/127.8.39.67@KRBTEST.COM (short username kudu)
I20260808 15:49:23.732005 23121 webserver.cc:460] Webserver started at http://127.8.39.67:39633/ using document root <none> and password file <none>
I20260808 15:49:23.732582 23121 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:23.732645 23121 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:49:23.732878 23121 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:49:23.735112 23121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/data/instance:
uuid: "ff4a81c8e84b45c3a68de683ec63a17a"
format_stamp: "Formatted at 2026-08-08 15:49:23 on dist-test-slave-8tdl"
server_key: "41f60c49360a33508b41e632d3684a75"
server_key_iv: "6605378180b6b34e4c47668ed1504510"
server_key_version: "encryptionkey@0"
I20260808 15:49:23.735679 23121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance:
uuid: "ff4a81c8e84b45c3a68de683ec63a17a"
format_stamp: "Formatted at 2026-08-08 15:49:23 on dist-test-slave-8tdl"
server_key: "41f60c49360a33508b41e632d3684a75"
server_key_iv: "6605378180b6b34e4c47668ed1504510"
server_key_version: "encryptionkey@0"
I20260808 15:49:23.739629 23121 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 15:49:23.742209 23137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:23.743458 23121 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:49:23.743598 23121 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "ff4a81c8e84b45c3a68de683ec63a17a"
format_stamp: "Formatted at 2026-08-08 15:49:23 on dist-test-slave-8tdl"
server_key: "41f60c49360a33508b41e632d3684a75"
server_key_iv: "6605378180b6b34e4c47668ed1504510"
server_key_version: "encryptionkey@0"
I20260808 15:49:23.743716 23121 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:23.761922 23121 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:23.765102 23121 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:23.765318 23121 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:23.765939 23121 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:49:23.766896 23121 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:49:23.766964 23121 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:23.767066 23121 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:49:23.767117 23121 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:23.777050 23121 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:41487
I20260808 15:49:23.777067 23258 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:41487 every 8 connection(s)
I20260808 15:49:23.778226 23121 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:49:23.780718 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 23121
I20260808 15:49:23.780860 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance
I20260808 15:49:23.781172 8349 external_mini_cluster.cc:1428] Setting key 6bdc26631c20197aa16bcc18f942605f
Aug 08 15:49:23 dist-test-slave-8tdl krb5kdc[22726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204163, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:49:23.792711 22813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:23.780293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:55673 (local address 127.8.39.126:41885)
0808 15:49:23.780609 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:23.780615 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:23.781633 (+ 1018us) server_negotiation.cc:407] Connection header received
0808 15:49:23.782607 (+ 974us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:23.782611 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:23.782666 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:23.782776 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:23.783997 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.784544 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.785704 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.785933 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.786051 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:23.788688 (+ 2637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:23.788693 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:23.788697 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:23.788730 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:23.790131 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:23.790818 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:23.790822 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:23.790824 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:23.790919 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:23.791329 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:23.791334 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:23.791336 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:23.791563 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:23.791686 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:23.792377 (+ 691us) server_negotiation.cc:299] Negotiation successful
0808 15:49:23.792530 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170}
I20260808 15:49:23.793798 23261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:23.780697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.67:55673)
0808 15:49:23.781450 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:23.781508 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:23.782390 (+ 882us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:23.782945 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:23.782951 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:23.783319 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:23.783856 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:23.783870 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.784684 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.784687 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:23.785571 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:23.785581 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.786098 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.786103 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:23.786277 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:23.786993 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:23.787010 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:23.788508 (+ 1498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:23.790307 (+ 1799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:23.790314 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:23.790332 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:23.790653 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:23.791043 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:23.791046 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:23.791048 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:23.791210 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:23.791686 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:23.791695 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:23.792110 (+ 415us) client_negotiation.cc:769] Sending connection context
0808 15:49:23.792332 (+ 222us) client_negotiation.cc:240] Negotiation successful
0808 15:49:23.792712 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":157,"threads_started":1}
I20260808 15:49:23.795240 23259 heartbeater.cc:347] Connected to a master server at 127.8.39.126:41885
I20260808 15:49:23.795538 23259 heartbeater.cc:464] Registering TS with master...
I20260808 15:49:23.796053 23259 heartbeater.cc:511] Master 127.8.39.126:41885 requested a full tablet report, sending...
I20260808 15:49:23.797158 22773 ts_manager.cc:194] Registered new tserver with Master: ff4a81c8e84b45c3a68de683ec63a17a (127.8.39.67:41487)
I20260808 15:49:23.797916 22773 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.67@KRBTEST.COM'} at 127.8.39.67:55673
I20260808 15:49:23.807569 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:49:23.817658 22813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:23.809646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53790 (local address 127.8.39.126:41885)
0808 15:49:23.809819 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:23.809825 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:23.809979 (+ 154us) server_negotiation.cc:407] Connection header received
0808 15:49:23.810163 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:23.810171 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:23.810216 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:23.810300 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:23.811205 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.811758 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.812633 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.812859 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.812968 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:23.814484 (+ 1516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:23.814487 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:23.814490 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:23.814526 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:23.815912 (+ 1386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:23.816347 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:23.816351 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:23.816353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:23.816438 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:23.816726 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:23.816730 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:23.816732 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:23.816965 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:23.817120 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:23.817370 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 15:49:23.817486 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 15:49:23.820853 22773 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53790:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:49:23.824306 22773 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:49:23.839406 23274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:23.834207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44702 (local address 127.8.39.67:41487)
0808 15:49:23.834656 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:23.834668 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:23.834722 (+ 54us) server_negotiation.cc:407] Connection header received
0808 15:49:23.834800 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:23.834804 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:23.835028 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:23.835448 (+ 420us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:49:23.835591 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.836550 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.837799 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.838714 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.838832 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:23.838988 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:23.839153 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 15:49:23.839248 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":115,"threads_started":1}
I20260808 15:49:23.839396 23273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:23.834016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:41487 (local address 127.0.0.1:44702)
0808 15:49:23.834306 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:23.834323 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:23.834412 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:23.835183 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:23.835186 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:23.835204 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:49:23.835301 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:23.835307 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.836679 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.836684 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:23.837648 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:23.837663 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.838830 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.838834 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:23.838940 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:23.838987 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 15:49:23.839124 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 15:49:23.839248 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":36,"thread_start_us":115,"threads_started":1}
I20260808 15:49:23.839847 23271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:23.833242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:39761 (local address 127.0.0.1:59982)
0808 15:49:23.833699 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:23.833753 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:23.833934 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:23.834565 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:23.834570 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:23.834594 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:49:23.834787 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:23.834795 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.836260 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.836263 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:23.837716 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:23.837725 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.839100 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.839104 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:23.839196 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:23.839218 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 15:49:23.839290 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 15:49:23.839357 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"mutex_wait_us":46,"thread_start_us":85,"threads_started":1}
I20260808 15:49:23.839983 23272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:23.833427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59982 (local address 127.8.39.66:39761)
0808 15:49:23.833759 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:23.833773 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:23.833859 (+ 86us) server_negotiation.cc:407] Connection header received
0808 15:49:23.834169 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:23.834176 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:23.834394 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:23.834565 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:49:23.834942 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.836126 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.838090 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.838790 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.838894 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:23.839035 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:23.839470 (+ 435us) server_negotiation.cc:299] Negotiation successful
0808 15:49:23.839745 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":113,"threads_started":1}
I20260808 15:49:23.840433 23275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:23.834362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:44579 (local address 127.0.0.1:60936)
0808 15:49:23.835306 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:23.835320 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:23.835410 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:23.835907 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:23.835910 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:23.835929 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:49:23.836016 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:23.836024 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.837375 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.837378 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:23.838554 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:23.838565 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.839902 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.839906 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:23.840135 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:23.840160 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 15:49:23.840242 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 15:49:23.840313 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":881,"mutex_wait_us":30,"thread_start_us":96,"threads_started":1}
I20260808 15:49:23.840602 23276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:23.834959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60936 (local address 127.8.39.65:44579)
0808 15:49:23.835570 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:23.835576 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:23.835593 (+ 17us) server_negotiation.cc:407] Connection header received
0808 15:49:23.835651 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:23.835654 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:23.835781 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:23.835927 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:49:23.836112 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.837248 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.838719 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:23.839605 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:23.839714 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:23.839834 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:23.840276 (+ 442us) server_negotiation.cc:299] Negotiation successful
0808 15:49:23.840362 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":504,"thread_start_us":126,"threads_started":1}
I20260808 15:49:23.842514 23047 tablet_service.cc:1467] Processing CreateTablet for tablet de5ab707b3054cf5ba04dddc32a57f34 (DEFAULT_TABLE table=test-table [id=f9be5eeeac1044b9bf3814f2ad264394]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:49:23.843716 23047 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de5ab707b3054cf5ba04dddc32a57f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:49:23.844753 23189 tablet_service.cc:1467] Processing CreateTablet for tablet de5ab707b3054cf5ba04dddc32a57f34 (DEFAULT_TABLE table=test-table [id=f9be5eeeac1044b9bf3814f2ad264394]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:49:23.845116 22907 tablet_service.cc:1467] Processing CreateTablet for tablet de5ab707b3054cf5ba04dddc32a57f34 (DEFAULT_TABLE table=test-table [id=f9be5eeeac1044b9bf3814f2ad264394]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:49:23.845793 23189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de5ab707b3054cf5ba04dddc32a57f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:49:23.846020 22907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de5ab707b3054cf5ba04dddc32a57f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:49:23.852300 23278 tablet_bootstrap.cc:492] T de5ab707b3054cf5ba04dddc32a57f34 P ae59124ccaf9459d94da42e455cd38ec: Bootstrap starting.
I20260808 15:49:23.852488 23279 tablet_bootstrap.cc:492] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec: Bootstrap starting.
I20260808 15:49:23.853312 23280 tablet_bootstrap.cc:492] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a: Bootstrap starting.
I20260808 15:49:23.854985 23279 tablet_bootstrap.cc:654] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec: Neither blocks nor log segments found. Creating new log.
I20260808 15:49:23.855420 23278 tablet_bootstrap.cc:654] T de5ab707b3054cf5ba04dddc32a57f34 P ae59124ccaf9459d94da42e455cd38ec: Neither blocks nor log segments found. Creating new log.
I20260808 15:49:23.855546 23280 tablet_bootstrap.cc:654] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a: Neither blocks nor log segments found. Creating new log.
I20260808 15:49:23.855966 23279 log.cc:824] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec: Log is configured to *not* fsync() on all Append() calls
I20260808 15:49:23.856199 23278 log.cc:824] T de5ab707b3054cf5ba04dddc32a57f34 P ae59124ccaf9459d94da42e455cd38ec: Log is configured to *not* fsync() on all Append() calls
I20260808 15:49:23.856316 23280 log.cc:824] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a: Log is configured to *not* fsync() on all Append() calls
I20260808 15:49:23.858275 23280 tablet_bootstrap.cc:492] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a: No bootstrap required, opened a new log
I20260808 15:49:23.858471 23279 tablet_bootstrap.cc:492] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec: No bootstrap required, opened a new log
I20260808 15:49:23.858445 23278 tablet_bootstrap.cc:492] T de5ab707b3054cf5ba04dddc32a57f34 P ae59124ccaf9459d94da42e455cd38ec: No bootstrap required, opened a new log
I20260808 15:49:23.858496 23280 ts_tablet_manager.cc:1397] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 15:49:23.858647 23278 ts_tablet_manager.cc:1397] T de5ab707b3054cf5ba04dddc32a57f34 P ae59124ccaf9459d94da42e455cd38ec: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260808 15:49:23.858647 23279 ts_tablet_manager.cc:1397] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 15:49:23.861940 23280 raft_consensus.cc:348] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:23.862257 23280 raft_consensus.cc:374] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:49:23.862318 23280 raft_consensus.cc:729] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4a81c8e84b45c3a68de683ec63a17a, State: Initialized, Role: FOLLOWER
I20260808 15:49:23.862932 23280 consensus_queue.cc:260] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:23.862991 23278 raft_consensus.cc:348] T de5ab707b3054cf5ba04dddc32a57f34 P ae59124ccaf9459d94da42e455cd38ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:23.863287 23278 raft_consensus.cc:374] T de5ab707b3054cf5ba04dddc32a57f34 P ae59124ccaf9459d94da42e455cd38ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:49:23.863353 23278 raft_consensus.cc:729] T de5ab707b3054cf5ba04dddc32a57f34 P ae59124ccaf9459d94da42e455cd38ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae59124ccaf9459d94da42e455cd38ec, State: Initialized, Role: FOLLOWER
I20260808 15:49:23.863557 23279 raft_consensus.cc:348] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:23.863796 23279 raft_consensus.cc:374] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:49:23.863785 23259 heartbeater.cc:503] Master 127.8.39.126:41885 was elected leader, sending a full tablet report...
I20260808 15:49:23.863842 23279 raft_consensus.cc:729] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb49f4400ec4df29448214d18c565ec, State: Initialized, Role: FOLLOWER
I20260808 15:49:23.863783 23278 consensus_queue.cc:260] T de5ab707b3054cf5ba04dddc32a57f34 P ae59124ccaf9459d94da42e455cd38ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:23.864212 23280 ts_tablet_manager.cc:1428] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260808 15:49:23.864229 23279 consensus_queue.cc:260] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:23.864744 23278 ts_tablet_manager.cc:1428] T de5ab707b3054cf5ba04dddc32a57f34 P ae59124ccaf9459d94da42e455cd38ec: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 15:49:23.864919 22976 heartbeater.cc:503] Master 127.8.39.126:41885 was elected leader, sending a full tablet report...
I20260808 15:49:23.865101 23279 ts_tablet_manager.cc:1428] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 15:49:23.865978 23115 heartbeater.cc:503] Master 127.8.39.126:41885 was elected leader, sending a full tablet report...
W20260808 15:49:24.029359 23260 tablet.cc:2369] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:49:24.040621 23284 raft_consensus.cc:482] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:49:24.040899 23284 raft_consensus.cc:504] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:24.042150 23284 leader_election.cc:288] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae59124ccaf9459d94da42e455cd38ec (127.8.39.66:39761), afb49f4400ec4df29448214d18c565ec (127.8.39.65:44579)
W20260808 15:49:24.043372 23116 tablet.cc:2369] T de5ab707b3054cf5ba04dddc32a57f34 P ae59124ccaf9459d94da42e455cd38ec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:49:24.046875 23272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:24.042552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:58165 (local address 127.8.39.66:39761)
0808 15:49:24.042750 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:24.042755 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:24.042777 (+ 22us) server_negotiation.cc:407] Connection header received
0808 15:49:24.042910 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:24.042915 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:24.042976 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:24.043082 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:49:24.043493 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:24.044216 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:24.045616 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:24.046200 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:24.046277 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:24.046329 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:24.046628 (+ 299us) server_negotiation.cc:299] Negotiation successful
0808 15:49:24.046760 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 15:49:24.046887 23261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:24.042439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:39761 (local address 127.8.39.67:58165)
0808 15:49:24.042598 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:24.042617 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:24.042757 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:24.043184 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:24.043188 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:24.043212 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:49:24.043355 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:24.043366 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:24.044334 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:24.044338 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:24.045487 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:24.045497 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:24.046318 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:24.046322 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:24.046490 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:24.046519 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 15:49:24.046608 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 15:49:24.046734 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 15:49:24.047641 23287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:24.042787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:44579 (local address 127.8.39.67:44453)
0808 15:49:24.043254 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:24.043266 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:24.043394 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:24.043803 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:24.043806 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:24.043821 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:49:24.043936 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:24.043941 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:24.045068 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:24.045070 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:24.046006 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:24.046048 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:24.047198 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:24.047202 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:24.047328 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:24.047354 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 15:49:24.047439 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 15:49:24.047504 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":193,"threads_started":1}
I20260808 15:49:24.047662 23276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:24.042941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:44453 (local address 127.8.39.65:44579)
0808 15:49:24.043111 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:24.043116 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:24.043351 (+ 235us) server_negotiation.cc:407] Connection header received
0808 15:49:24.043556 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:24.043559 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:24.043613 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:24.043664 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:49:24.044073 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:24.044831 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:24.046192 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:24.046937 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:24.047076 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:24.047167 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:24.047496 (+ 329us) server_negotiation.cc:299] Negotiation successful
0808 15:49:24.047567 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 15:49:24.047647 23068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de5ab707b3054cf5ba04dddc32a57f34" candidate_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae59124ccaf9459d94da42e455cd38ec" is_pre_election: true
I20260808 15:49:24.048045 23068 raft_consensus.cc:2454] T de5ab707b3054cf5ba04dddc32a57f34 P ae59124ccaf9459d94da42e455cd38ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff4a81c8e84b45c3a68de683ec63a17a in term 0.
I20260808 15:49:24.048527 22927 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de5ab707b3054cf5ba04dddc32a57f34" candidate_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb49f4400ec4df29448214d18c565ec" is_pre_election: true
I20260808 15:49:24.048607 23141 leader_election.cc:302] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae59124ccaf9459d94da42e455cd38ec, ff4a81c8e84b45c3a68de683ec63a17a; no voters:
I20260808 15:49:24.048841 22927 raft_consensus.cc:2454] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff4a81c8e84b45c3a68de683ec63a17a in term 0.
I20260808 15:49:24.048935 23284 raft_consensus.cc:2781] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:49:24.049053 23284 raft_consensus.cc:482] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:49:24.049101 23284 raft_consensus.cc:3037] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:49:24.050242 23284 raft_consensus.cc:504] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:24.050558 23284 leader_election.cc:288] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a [CANDIDATE]: Term 1 election: Requested vote from peers ae59124ccaf9459d94da42e455cd38ec (127.8.39.66:39761), afb49f4400ec4df29448214d18c565ec (127.8.39.65:44579)
I20260808 15:49:24.051082 23068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de5ab707b3054cf5ba04dddc32a57f34" candidate_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae59124ccaf9459d94da42e455cd38ec"
I20260808 15:49:24.051115 22927 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de5ab707b3054cf5ba04dddc32a57f34" candidate_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afb49f4400ec4df29448214d18c565ec"
I20260808 15:49:24.051247 22927 raft_consensus.cc:3037] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:49:24.051247 23068 raft_consensus.cc:3037] T de5ab707b3054cf5ba04dddc32a57f34 P ae59124ccaf9459d94da42e455cd38ec [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:49:24.052798 22927 raft_consensus.cc:2454] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4a81c8e84b45c3a68de683ec63a17a in term 1.
I20260808 15:49:24.052798 23068 raft_consensus.cc:2454] T de5ab707b3054cf5ba04dddc32a57f34 P ae59124ccaf9459d94da42e455cd38ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff4a81c8e84b45c3a68de683ec63a17a in term 1.
I20260808 15:49:24.053202 23141 leader_election.cc:302] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afb49f4400ec4df29448214d18c565ec, ff4a81c8e84b45c3a68de683ec63a17a; no voters:
I20260808 15:49:24.053450 23284 raft_consensus.cc:2781] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:49:24.053704 23284 raft_consensus.cc:686] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a [term 1 LEADER]: Becoming Leader. State: Replica: ff4a81c8e84b45c3a68de683ec63a17a, State: Running, Role: LEADER
I20260808 15:49:24.054116 23284 consensus_queue.cc:237] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:24.057631 22772 catalog_manager.cc:5495] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a reported cstate change: term changed from 0 to 1, leader changed from <none> to ff4a81c8e84b45c3a68de683ec63a17a (127.8.39.67). New cstate: current_term: 1 leader_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } health_report { overall_health: UNKNOWN } } }
W20260808 15:49:24.066182 22977 tablet.cc:2369] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:49:24.080303 23274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:24.076162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44706 (local address 127.8.39.67:41487)
0808 15:49:24.076311 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:24.076314 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:24.076329 (+ 15us) server_negotiation.cc:407] Connection header received
0808 15:49:24.076446 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:24.076448 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:24.076506 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:24.076596 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:49:24.076861 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:24.077610 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:24.078614 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:24.078944 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:24.079031 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:24.079358 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:49:24.079797 (+ 439us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:49:24.079974 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:24.080047 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 15:49:24.080102 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 15:49:24.086776 22927 raft_consensus.cc:1261] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec [term 1 FOLLOWER]: Refusing update from remote peer ff4a81c8e84b45c3a68de683ec63a17a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:49:24.086776 23068 raft_consensus.cc:1261] T de5ab707b3054cf5ba04dddc32a57f34 P ae59124ccaf9459d94da42e455cd38ec [term 1 FOLLOWER]: Refusing update from remote peer ff4a81c8e84b45c3a68de683ec63a17a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:49:24.087637 23288 consensus_queue.cc:1035] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:49:24.087842 23284 consensus_queue.cc:1035] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:49:24.095683 23291 mvcc.cc:205] Tried to move back new op lower bound from 7316292256090570752 to 7316292255969013760. Current Snapshot: MvccSnapshot[applied={T|T < 7316292256090570752}]
I20260808 15:49:24.097087 23293 mvcc.cc:205] Tried to move back new op lower bound from 7316292256090570752 to 7316292255969013760. Current Snapshot: MvccSnapshot[applied={T|T < 7316292256090570752}]
I20260808 15:49:24.097397 23292 mvcc.cc:205] Tried to move back new op lower bound from 7316292256090570752 to 7316292255969013760. Current Snapshot: MvccSnapshot[applied={T|T < 7316292256090570752}]
I20260808 15:49:24.104768 22772 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53790:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:49:24.104962 22772 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53790:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:49:24.107596 22772 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d: Sending DeleteTablet for 3 replicas of tablet de5ab707b3054cf5ba04dddc32a57f34
I20260808 15:49:24.108418 23047 tablet_service.cc:1514] Processing DeleteTablet for tablet de5ab707b3054cf5ba04dddc32a57f34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:49:24 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:59982
I20260808 15:49:24.108498 23189 tablet_service.cc:1514] Processing DeleteTablet for tablet de5ab707b3054cf5ba04dddc32a57f34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:49:24 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:44702
I20260808 15:49:24.108676 22907 tablet_service.cc:1514] Processing DeleteTablet for tablet de5ab707b3054cf5ba04dddc32a57f34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:49:24 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:60936
I20260808 15:49:24.109017 23302 tablet_replica.cc:330] T de5ab707b3054cf5ba04dddc32a57f34 P ae59124ccaf9459d94da42e455cd38ec: stopping tablet replica
I20260808 15:49:24.109035 23303 tablet_replica.cc:330] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a: stopping tablet replica
I20260808 15:49:24.109220 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 22838
I20260808 15:49:24.113818 23302 raft_consensus.cc:2229] T de5ab707b3054cf5ba04dddc32a57f34 P ae59124ccaf9459d94da42e455cd38ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:49:24.113857 23303 raft_consensus.cc:2229] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:49:24.114253 23302 raft_consensus.cc:2258] T de5ab707b3054cf5ba04dddc32a57f34 P ae59124ccaf9459d94da42e455cd38ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:49:24.114522 23303 raft_consensus.cc:2258] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:49:24.116488 23303 ts_tablet_manager.cc:1905] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:49:24.116537 23302 ts_tablet_manager.cc:1905] T de5ab707b3054cf5ba04dddc32a57f34 P ae59124ccaf9459d94da42e455cd38ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:49:24.119813 23303 ts_tablet_manager.cc:1918] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:49:24.120031 23303 log.cc:1196] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/de5ab707b3054cf5ba04dddc32a57f34
I20260808 15:49:24.120503 23303 ts_tablet_manager.cc:1939] T de5ab707b3054cf5ba04dddc32a57f34 P ff4a81c8e84b45c3a68de683ec63a17a: Deleting consensus metadata
I20260808 15:49:24.120355 23302 ts_tablet_manager.cc:1918] T de5ab707b3054cf5ba04dddc32a57f34 P ae59124ccaf9459d94da42e455cd38ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:49:24.120769 23302 log.cc:1196] T de5ab707b3054cf5ba04dddc32a57f34 P ae59124ccaf9459d94da42e455cd38ec: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/wal/wals/de5ab707b3054cf5ba04dddc32a57f34
I20260808 15:49:24.121160 23302 ts_tablet_manager.cc:1939] T de5ab707b3054cf5ba04dddc32a57f34 P ae59124ccaf9459d94da42e455cd38ec: Deleting consensus metadata
I20260808 15:49:24.122259 22761 catalog_manager.cc:4841] TS ff4a81c8e84b45c3a68de683ec63a17a (127.8.39.67:41487): tablet de5ab707b3054cf5ba04dddc32a57f34 (table test-table [id=f9be5eeeac1044b9bf3814f2ad264394]) successfully deleted
I20260808 15:49:24.122536 22761 catalog_manager.cc:4841] TS ae59124ccaf9459d94da42e455cd38ec (127.8.39.66:39761): tablet de5ab707b3054cf5ba04dddc32a57f34 (table test-table [id=f9be5eeeac1044b9bf3814f2ad264394]) successfully deleted
W20260808 15:49:24.122964 22761 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.39.65:44579 (error 108)
I20260808 15:49:24.123232 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 22981
I20260808 15:49:24.126026 23275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:24.125566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:44579 (local address 127.0.0.1:60946)
0808 15:49:24.125807 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:24.125900 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.65:44579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131}
W20260808 15:49:24.126389 22761 catalog_manager.cc:4584] TS afb49f4400ec4df29448214d18c565ec (127.8.39.65:44579): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet de5ab707b3054cf5ba04dddc32a57f34: Network error: Client connection negotiation failed: client connection to 127.8.39.65:44579: connect: Connection refused (error 111)
I20260808 15:49:24.134366 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 23121
I20260808 15:49:24.141058 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 22740
I20260808 15:49:24.149966 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:41885
--webserver_interface=127.8.39.126
--webserver_port=38411
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:42587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:41885
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:49:24.266886 23307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:24.267179 23307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:24.267220 23307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:24.271416 23307 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:49:24.271493 23307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:24.271514 23307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:24.271531 23307 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:49:24.271548 23307 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:49:24.277464 23307 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:42587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:41885
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:41885
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=38411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23307
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:24.278760 23307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:24.279844 23307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:49:24.294550 23314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:24.294600 23307 server_base.cc:1034] running on GCE node
W20260808 15:49:24.294571 23316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:24.294550 23313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:24.295714 23307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:24.296941 23307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:24.298110 23307 hybrid_clock.cc:648] HybridClock initialized: now 1786204164298094 us; error 29 us; skew 500 ppm
Aug 08 15:49:24 dist-test-slave-8tdl krb5kdc[22726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204164, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:24.301025 23307 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:49:24.301977 23307 webserver.cc:460] Webserver started at http://127.8.39.126:38411/ using document root <none> and password file <none>
I20260808 15:49:24.302533 23307 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:24.302613 23307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:49:24.306646 23307 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:49:24.309392 23324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:24.310822 23307 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:49:24.310993 23307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "c3ebb2e9d40a47beb462e80fd8298e3d"
format_stamp: "Formatted at 2026-08-08 15:49:22 on dist-test-slave-8tdl"
server_key: "b1835eddc3e096318828bd9405d2a8e9"
server_key_iv: "7a4c1ab63ea6089a9c34528fe7432767"
server_key_version: "encryptionkey@0"
I20260808 15:49:24.311625 23307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:24.338321 23307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:24.341559 23307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:24.341753 23307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:24.350209 23307 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:41885
I20260808 15:49:24.350508 23379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:41885 every 8 connection(s)
I20260808 15:49:24.351512 23307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:49:24.356098 23380 sys_catalog.cc:263] Verifying existing consensus state
I20260808 15:49:24.357880 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 23307
I20260808 15:49:24.357884 23380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d: Bootstrap starting.
I20260808 15:49:24.358398 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:44579
--local_ip_for_outbound_sockets=127.8.39.65
--tserver_master_addrs=127.8.39.126:41885
--webserver_port=40123
--webserver_interface=127.8.39.65
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:42587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:49:24.377059 23380 log.cc:824] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d: Log is configured to *not* fsync() on all Append() calls
I20260808 15:49:24.386284 23380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 15:49:24.386781 23380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d: Bootstrap complete.
I20260808 15:49:24.391141 23380 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ebb2e9d40a47beb462e80fd8298e3d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41885 } }
I20260808 15:49:24.391609 23380 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3ebb2e9d40a47beb462e80fd8298e3d, State: Initialized, Role: FOLLOWER
I20260808 15:49:24.392163 23380 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ebb2e9d40a47beb462e80fd8298e3d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41885 } }
I20260808 15:49:24.392315 23380 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:49:24.392413 23380 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:49:24.392544 23380 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [term 1 FOLLOWER]: Advancing to term 2
I20260808 15:49:24.394899 23380 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ebb2e9d40a47beb462e80fd8298e3d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41885 } }
I20260808 15:49:24.395256 23380 leader_election.cc:302] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3ebb2e9d40a47beb462e80fd8298e3d; no voters:
I20260808 15:49:24.395650 23380 leader_election.cc:288] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 15:49:24.395749 23384 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [term 2 FOLLOWER]: Leader election won for term 2
I20260808 15:49:24.395937 23384 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [term 2 LEADER]: Becoming Leader. State: Replica: c3ebb2e9d40a47beb462e80fd8298e3d, State: Running, Role: LEADER
I20260808 15:49:24.396252 23384 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ebb2e9d40a47beb462e80fd8298e3d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41885 } }
I20260808 15:49:24.396992 23380 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:49:24.397269 23384 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3ebb2e9d40a47beb462e80fd8298e3d. Latest consensus state: current_term: 2 leader_uuid: "c3ebb2e9d40a47beb462e80fd8298e3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ebb2e9d40a47beb462e80fd8298e3d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41885 } } }
I20260808 15:49:24.397387 23384 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [sys.catalog]: This master's current role is: LEADER
I20260808 15:49:24.397749 23388 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:49:24.397864 23385 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c3ebb2e9d40a47beb462e80fd8298e3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ebb2e9d40a47beb462e80fd8298e3d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41885 } } }
I20260808 15:49:24.398057 23385 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [sys.catalog]: This master's current role is: LEADER
I20260808 15:49:24.402802 23388 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:49:24.403604 23388 catalog_manager.cc:1259] Loaded cluster ID: 5de1381d3f8848128e50f785fbdf859b
I20260808 15:49:24.403674 23388 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:49:24.405150 23388 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 15:49:24.410085 23388 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 15:49:24.417022 23388 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:49:24.417903 23388 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d: Loaded TSK: 0
I20260808 15:49:24.419253 23388 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 15:49:24.486140 23382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:24.486425 23382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:24.486472 23382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:24.490867 23382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:24.490931 23382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:24.491017 23382 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:49:24.496770 23382 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:42587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:44579
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=40123
--tserver_master_addrs=127.8.39.126:41885
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23382
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:24.497956 23382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:24.499207 23382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:49:24.509783 23410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:24.509783 23409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:24.510035 23382 server_base.cc:1034] running on GCE node
W20260808 15:49:24.509795 23413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:24.510656 23382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:24.511443 23382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:24.512673 23382 hybrid_clock.cc:648] HybridClock initialized: now 1786204164512646 us; error 47 us; skew 500 ppm
Aug 08 15:49:24 dist-test-slave-8tdl krb5kdc[22726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204164, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:24.515929 23382 init.cc:377] Logged in from keytab as kudu/127.8.39.65@KRBTEST.COM (short username kudu)
I20260808 15:49:24.516999 23382 webserver.cc:460] Webserver started at http://127.8.39.65:40123/ using document root <none> and password file <none>
I20260808 15:49:24.517584 23382 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:24.517697 23382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:49:24.521924 23382 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:49:24.524396 23420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:24.525749 23382 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:49:24.525854 23382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "afb49f4400ec4df29448214d18c565ec"
format_stamp: "Formatted at 2026-08-08 15:49:23 on dist-test-slave-8tdl"
server_key: "d0026081035ebcb1b92b3cf77a1b6baf"
server_key_iv: "e2ce5a934938cb0780971e99c1a91f2d"
server_key_version: "encryptionkey@0"
I20260808 15:49:24.526471 23382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:24.543788 23382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:24.547582 23382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:24.547822 23382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:24.548593 23382 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:49:24.549769 23427 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 15:49:24.554046 23382 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 15:49:24.554175 23382 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260808 15:49:24.554294 23382 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 15:49:24.556274 23382 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 15:49:24.556355 23382 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260808 15:49:24.556690 23427 tablet_bootstrap.cc:492] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec: Bootstrap starting.
I20260808 15:49:24.568216 23382 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:44579
I20260808 15:49:24.568320 23538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:44579 every 8 connection(s)
I20260808 15:49:24.569648 23382 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:49:24.576768 23427 log.cc:824] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec: Log is configured to *not* fsync() on all Append() calls
I20260808 15:49:24.577278 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 23382
I20260808 15:49:24.577839 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:39761
--local_ip_for_outbound_sockets=127.8.39.66
--tserver_master_addrs=127.8.39.126:41885
--webserver_port=45347
--webserver_interface=127.8.39.66
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:42587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 15:49:24 dist-test-slave-8tdl krb5kdc[22726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204164, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:49:24.586504 23427 tablet_bootstrap.cc:492] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 15:49:24.587033 23427 tablet_bootstrap.cc:492] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec: Bootstrap complete.
I20260808 15:49:24.587742 23542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:24.571942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.65:56645)
0808 15:49:24.572498 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:24.572567 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:24.573544 (+ 977us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:24.574756 (+ 1212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:24.574765 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:24.575246 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:24.575717 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:24.575733 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:24.577235 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:24.577239 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:24.578712 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:24.578729 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:24.579972 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:24.579977 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:24.580138 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:24.580867 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:24.580895 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:24.582467 (+ 1572us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:24.584770 (+ 2303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:24.584776 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:24.584789 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:24.585056 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:24.585422 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:24.585427 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:24.585429 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:24.585587 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:24.586179 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:24.586185 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:24.586442 (+ 257us) client_negotiation.cc:769] Sending connection context
0808 15:49:24.586639 (+ 197us) client_negotiation.cc:240] Negotiation successful
0808 15:49:24.586955 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":170,"threads_started":1}
I20260808 15:49:24.588642 23427 ts_tablet_manager.cc:1397] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec: Time spent bootstrapping tablet: real 0.032s user 0.014s sys 0.015s
I20260808 15:49:24.589217 23543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:24.571995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:56645 (local address 127.8.39.126:41885)
0808 15:49:24.573146 (+ 1151us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:24.573166 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:24.573217 (+ 51us) server_negotiation.cc:407] Connection header received
0808 15:49:24.573984 (+ 767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:24.573994 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:24.574309 (+ 315us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:24.574665 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:24.575917 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:24.577008 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:24.578873 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:24.579666 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:24.579855 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:24.582741 (+ 2886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:24.582747 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:24.582759 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:24.582790 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:24.584632 (+ 1842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:24.585190 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:24.585195 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:24.585199 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:24.585319 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:24.585691 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:24.585695 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:24.585697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:24.586055 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:24.586204 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:24.588203 (+ 1999us) server_negotiation.cc:299] Negotiation successful
0808 15:49:24.588552 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":975,"thread_start_us":158,"threads_started":1}
I20260808 15:49:24.591284 23539 heartbeater.cc:347] Connected to a master server at 127.8.39.126:41885
I20260808 15:49:24.591548 23539 heartbeater.cc:464] Registering TS with master...
I20260808 15:49:24.592054 23539 heartbeater.cc:511] Master 127.8.39.126:41885 requested a full tablet report, sending...
I20260808 15:49:24.592661 23427 raft_consensus.cc:348] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:24.593243 23427 raft_consensus.cc:729] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb49f4400ec4df29448214d18c565ec, State: Initialized, Role: FOLLOWER
I20260808 15:49:24.593755 23427 consensus_queue.cc:260] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:24.594952 23427 ts_tablet_manager.cc:1428] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260808 15:49:24.595404 23342 ts_manager.cc:194] Registered new tserver with Master: afb49f4400ec4df29448214d18c565ec (127.8.39.65:44579)
I20260808 15:49:24.599613 23342 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.65@KRBTEST.COM'} at 127.8.39.65:56645
I20260808 15:49:24.602811 23539 heartbeater.cc:503] Master 127.8.39.126:41885 was elected leader, sending a full tablet report...
Aug 08 15:49:24 dist-test-slave-8tdl krb5kdc[22726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204164, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for kudu/127.8.39.65@KRBTEST.COM
I20260808 15:49:24.611109 23548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:24.598996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:44579 (local address 127.0.0.1:42542)
0808 15:49:24.600042 (+ 1046us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:24.600114 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:24.600290 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:24.601106 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:24.601111 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:24.601480 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:24.601604 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:24.601612 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:24.602626 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:24.602629 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:24.603540 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:24.603573 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:24.604413 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:24.604418 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:24.604554 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:24.605295 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:24.605307 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:24.606835 (+ 1528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:24.609202 (+ 2367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:24.609219 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:24.609225 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:24.609470 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:24.609832 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:24.609834 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:24.609835 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:24.609917 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:24.610455 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:24.610460 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:24.610588 (+ 128us) client_negotiation.cc:769] Sending connection context
0808 15:49:24.610783 (+ 195us) client_negotiation.cc:240] Negotiation successful
0808 15:49:24.610962 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":856,"thread_start_us":147,"threads_started":1}
I20260808 15:49:24.611220 23547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:24.598989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42542 (local address 127.8.39.65:44579)
0808 15:49:24.599334 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:24.599347 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:24.600256 (+ 909us) server_negotiation.cc:407] Connection header received
0808 15:49:24.600466 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:24.600471 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:24.600770 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:24.600938 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:24.601755 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:24.602492 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:24.603695 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:24.604265 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:24.604390 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:24.606995 (+ 2605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:24.607008 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:24.607023 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:24.607069 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:24.609044 (+ 1975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:24.609619 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:24.609625 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:24.609627 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:24.609731 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:24.610002 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:24.610005 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:24.610007 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:24.610344 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:24.610477 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:24.610873 (+ 396us) server_negotiation.cc:299] Negotiation successful
0808 15:49:24.611053 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":121,"threads_started":1}
I20260808 15:49:24.612393 23471 tablet_service.cc:1514] Processing DeleteTablet for tablet de5ab707b3054cf5ba04dddc32a57f34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:49:24 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:42542
I20260808 15:49:24.613299 23549 tablet_replica.cc:330] stopping tablet replica
I20260808 15:49:24.613632 23549 raft_consensus.cc:2229] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:49:24.613906 23549 raft_consensus.cc:2258] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:49:24.615091 23549 ts_tablet_manager.cc:1905] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:49:24.619325 23549 ts_tablet_manager.cc:1918] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:49:24.619441 23549 log.cc:1196] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/wal/wals/de5ab707b3054cf5ba04dddc32a57f34
I20260808 15:49:24.619813 23549 ts_tablet_manager.cc:1939] T de5ab707b3054cf5ba04dddc32a57f34 P afb49f4400ec4df29448214d18c565ec: Deleting consensus metadata
I20260808 15:49:24.621690 23328 catalog_manager.cc:4841] TS afb49f4400ec4df29448214d18c565ec (127.8.39.65:44579): tablet de5ab707b3054cf5ba04dddc32a57f34 (table test-table [id=f9be5eeeac1044b9bf3814f2ad264394]) successfully deleted
W20260808 15:49:24.706547 23545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:24.706919 23545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:24.707012 23545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:24.711370 23545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:24.711462 23545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:24.711550 23545 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:49:24.717335 23545 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:42587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:39761
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=45347
--tserver_master_addrs=127.8.39.126:41885
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:24.718549 23545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:24.719753 23545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 15:49:24.730374 23545 server_base.cc:1034] running on GCE node
W20260808 15:49:24.730332 23554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:24.730362 23558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:24.730332 23555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:24.731232 23545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:24.731994 23545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:24.733186 23545 hybrid_clock.cc:648] HybridClock initialized: now 1786204164733157 us; error 43 us; skew 500 ppm
Aug 08 15:49:24 dist-test-slave-8tdl krb5kdc[22726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204164, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:24.736315 23545 init.cc:377] Logged in from keytab as kudu/127.8.39.66@KRBTEST.COM (short username kudu)
I20260808 15:49:24.737203 23545 webserver.cc:460] Webserver started at http://127.8.39.66:45347/ using document root <none> and password file <none>
I20260808 15:49:24.737816 23545 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:24.737903 23545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:49:24.741950 23545 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:49:24.744364 23565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:24.745781 23545 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 15:49:24.745952 23545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "ae59124ccaf9459d94da42e455cd38ec"
format_stamp: "Formatted at 2026-08-08 15:49:23 on dist-test-slave-8tdl"
server_key: "3626f5f4978c1f57c5694c9a37a5c159"
server_key_iv: "977888b8bc5722ebc2be48cacd5d94b0"
server_key_version: "encryptionkey@0"
I20260808 15:49:24.746551 23545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:24.770784 23545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:24.774467 23545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:24.774739 23545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:24.775527 23545 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:49:24.776458 23545 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:49:24.776531 23545 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:24.776607 23545 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:49:24.776662 23545 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:24.786065 23545 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:39761
I20260808 15:49:24.786091 23682 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:39761 every 8 connection(s)
I20260808 15:49:24.787235 23545 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:49:24.788434 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 23545
I20260808 15:49:24.788940 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:41487
--local_ip_for_outbound_sockets=127.8.39.67
--tserver_master_addrs=127.8.39.126:41885
--webserver_port=39633
--webserver_interface=127.8.39.67
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:42587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 15:49:24 dist-test-slave-8tdl krb5kdc[22726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204164, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:49:24.804842 23543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:24.789255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:36457 (local address 127.8.39.126:41885)
0808 15:49:24.789399 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:24.789403 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:24.790757 (+ 1354us) server_negotiation.cc:407] Connection header received
0808 15:49:24.791775 (+ 1018us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:24.791782 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:24.791858 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:24.791975 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:24.793233 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:24.794184 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:24.795617 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:24.796068 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:24.796211 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:24.799563 (+ 3352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:24.799570 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:24.799576 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:24.799617 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:24.801518 (+ 1901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:24.802264 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:24.802268 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:24.802270 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:24.802371 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:24.802820 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:24.802827 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:24.802828 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:24.803117 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:24.803206 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:24.804587 (+ 1381us) server_negotiation.cc:299] Negotiation successful
0808 15:49:24.804712 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 15:49:24.805938 23685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:24.789769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.66:36457)
0808 15:49:24.790553 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:24.790609 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:24.791530 (+ 921us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:24.792180 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:24.792187 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:24.792558 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:24.793057 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:24.793072 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:24.794353 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:24.794356 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:24.795475 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:24.795485 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:24.796276 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:24.796279 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:24.796454 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:24.797325 (+ 871us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:24.797342 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:24.799362 (+ 2020us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:24.801678 (+ 2316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:24.801687 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:24.801706 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:24.802113 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:24.802475 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:24.802478 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:24.802480 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:24.802661 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:24.803967 (+ 1306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:24.803974 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:24.804301 (+ 327us) client_negotiation.cc:769] Sending connection context
0808 15:49:24.804519 (+ 218us) client_negotiation.cc:240] Negotiation successful
0808 15:49:24.804868 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":167,"threads_started":1}
I20260808 15:49:24.807381 23683 heartbeater.cc:347] Connected to a master server at 127.8.39.126:41885
I20260808 15:49:24.807677 23683 heartbeater.cc:464] Registering TS with master...
I20260808 15:49:24.808269 23683 heartbeater.cc:511] Master 127.8.39.126:41885 requested a full tablet report, sending...
I20260808 15:49:24.809502 23342 ts_manager.cc:194] Registered new tserver with Master: ae59124ccaf9459d94da42e455cd38ec (127.8.39.66:39761)
I20260808 15:49:24.810256 23342 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.66@KRBTEST.COM'} at 127.8.39.66:36457
W20260808 15:49:24.911242 23686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:24.911599 23686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:24.911652 23686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:24.916471 23686 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:24.916543 23686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:24.916608 23686 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:49:24.922294 23686 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:42587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:41487
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=39633
--tserver_master_addrs=127.8.39.126:41885
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23686
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:24.923456 23686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:24.924561 23686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:49:24.934768 23695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:24.934959 23686 server_base.cc:1034] running on GCE node
W20260808 15:49:24.934857 23693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:24.934772 23692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:24.935482 23686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:24.936160 23686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:24.937322 23686 hybrid_clock.cc:648] HybridClock initialized: now 1786204164937300 us; error 37 us; skew 500 ppm
Aug 08 15:49:24 dist-test-slave-8tdl krb5kdc[22726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204164, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:24.940157 23686 init.cc:377] Logged in from keytab as kudu/127.8.39.67@KRBTEST.COM (short username kudu)
I20260808 15:49:24.940990 23686 webserver.cc:460] Webserver started at http://127.8.39.67:39633/ using document root <none> and password file <none>
I20260808 15:49:24.941521 23686 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:24.941594 23686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:49:24.945560 23686 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:49:24.947710 23702 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:24.949083 23686 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:49:24.949229 23686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "ff4a81c8e84b45c3a68de683ec63a17a"
format_stamp: "Formatted at 2026-08-08 15:49:23 on dist-test-slave-8tdl"
server_key: "41f60c49360a33508b41e632d3684a75"
server_key_iv: "6605378180b6b34e4c47668ed1504510"
server_key_version: "encryptionkey@0"
I20260808 15:49:24.949797 23686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:24.976117 23686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:24.979730 23686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:24.979969 23686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:24.980612 23686 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:49:24.981482 23686 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:49:24.981559 23686 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:24.981637 23686 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:49:24.981678 23686 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:24.990969 23686 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:41487
I20260808 15:49:24.991024 23817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:41487 every 8 connection(s)
I20260808 15:49:24.992003 23686 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:49:24.997623 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 23686
Aug 08 15:49:25 dist-test-slave-8tdl krb5kdc[22726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204164, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:49:25.007126 23821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:24.998409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49296 (local address 127.8.39.126:41885)
0808 15:49:24.998655 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:24.998658 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:24.998955 (+ 297us) server_negotiation.cc:407] Connection header received
0808 15:49:24.999098 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:24.999102 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:24.999155 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:24.999299 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:25.000031 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:25.000696 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:25.001620 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:25.001840 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:25.001920 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:25.003385 (+ 1465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:25.003389 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:25.003392 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:25.003419 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:25.005134 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:25.005646 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:25.005649 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:25.005650 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:25.005764 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:25.006039 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:25.006042 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:25.006045 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:25.006301 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:25.006519 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:25.006767 (+ 248us) server_negotiation.cc:299] Negotiation successful
0808 15:49:25.006923 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":95,"threads_started":1}
I20260808 15:49:25.008220 23543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:24.993897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:49713 (local address 127.8.39.126:41885)
0808 15:49:24.994110 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:24.994114 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:24.995367 (+ 1253us) server_negotiation.cc:407] Connection header received
0808 15:49:24.996314 (+ 947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:24.996318 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:24.996380 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:24.996492 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:24.998113 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:24.998973 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:25.000458 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:25.000674 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:25.000757 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:25.003847 (+ 3090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:25.003851 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:25.003855 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:25.003898 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:25.005638 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:25.006289 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:25.006291 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:25.006292 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:25.006394 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:25.006860 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:25.006867 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:25.006872 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:25.007102 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:25.007482 (+ 380us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:25.007884 (+ 402us) server_negotiation.cc:299] Negotiation successful
0808 15:49:25.008060 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 15:49:25.009272 23820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:24.994313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.67:49713)
0808 15:49:24.995178 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:24.995259 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:24.996096 (+ 837us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:24.996730 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:24.996743 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:24.997177 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:24.997917 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:24.997938 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:24.999137 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:24.999142 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:25.000324 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:25.000336 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:25.000844 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:25.000848 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:25.001014 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:25.001705 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:25.001723 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:25.003654 (+ 1931us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:25.005761 (+ 2107us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:25.005768 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:25.005787 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:25.006185 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:25.006502 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:25.006505 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:25.006507 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:25.006748 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:25.007220 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:25.007230 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:25.007604 (+ 374us) client_negotiation.cc:769] Sending connection context
0808 15:49:25.007806 (+ 202us) client_negotiation.cc:240] Negotiation successful
0808 15:49:25.008184 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"thread_start_us":112,"threads_started":1}
I20260808 15:49:25.010489 23818 heartbeater.cc:347] Connected to a master server at 127.8.39.126:41885
I20260808 15:49:25.010788 23818 heartbeater.cc:464] Registering TS with master...
I20260808 15:49:25.011382 23818 heartbeater.cc:511] Master 127.8.39.126:41885 requested a full tablet report, sending...
I20260808 15:49:25.012444 23342 ts_manager.cc:194] Registered new tserver with Master: ff4a81c8e84b45c3a68de683ec63a17a (127.8.39.67:41487)
I20260808 15:49:25.013049 23342 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.67@KRBTEST.COM'} at 127.8.39.67:49713
I20260808 15:49:25.021044 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:49:25.025367 23543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:25.021676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49310 (local address 127.8.39.126:41885)
0808 15:49:25.021807 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:25.021811 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:25.022015 (+ 204us) server_negotiation.cc:407] Connection header received
0808 15:49:25.022169 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:25.022171 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:25.022278 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:25.022367 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:49:25.022580 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:25.023238 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:25.024083 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:25.024295 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:25.024373 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:25.024634 (+ 261us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:49:25.025061 (+ 427us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:49:25.025150 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:25.025209 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 15:49:25.025258 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 15:49:25.026013 23342 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:49310:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:49:25.029539 23342 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:49:25.037887 23471 tablet_service.cc:1467] Processing CreateTablet for tablet 85332a6a0f9642db8019071ad397b600 (DEFAULT_TABLE table=test-table [id=89bf30895e4f482caa909c2f44edda74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:49:25.038616 23471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85332a6a0f9642db8019071ad397b600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:49:25.041626 23427 tablet_bootstrap.cc:492] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec: Bootstrap starting.
I20260808 15:49:25.042591 23427 tablet_bootstrap.cc:654] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec: Neither blocks nor log segments found. Creating new log.
I20260808 15:49:25.042588 23548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:25.036597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:39761 (local address 127.0.0.1:53284)
0808 15:49:25.036924 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:25.036941 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:25.037062 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:25.037927 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:25.037933 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:25.037957 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:49:25.038071 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:25.038080 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:25.039573 (+ 1493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:25.039578 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:25.040825 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:25.040836 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:25.042120 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:25.042125 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:25.042224 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:25.042280 (+ 56us) client_negotiation.cc:769] Sending connection context
0808 15:49:25.042337 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 15:49:25.042443 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"mutex_wait_us":27}
I20260808 15:49:25.043538 23829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:25.036775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53284 (local address 127.8.39.66:39761)
0808 15:49:25.037463 (+ 688us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:25.037476 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:25.037507 (+ 31us) server_negotiation.cc:407] Connection header received
0808 15:49:25.037586 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:25.037590 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:25.037763 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:25.037892 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:49:25.038220 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:25.039412 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:25.040980 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:25.041838 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:25.043048 (+ 1210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:25.043216 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:25.043274 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 15:49:25.043393 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":571,"thread_start_us":188,"threads_started":1}
I20260808 15:49:25.043669 23831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:25.037132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37502 (local address 127.8.39.67:41487)
0808 15:49:25.037577 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:25.037590 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:25.038441 (+ 851us) server_negotiation.cc:407] Connection header received
0808 15:49:25.038509 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:25.038514 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:25.038657 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:25.038850 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:49:25.039455 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:25.040427 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:25.042120 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:25.043043 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:25.043177 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:25.043327 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:25.043405 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 15:49:25.043504 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":198,"threads_started":1}
I20260808 15:49:25.043582 23828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:25.036875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:41487 (local address 127.0.0.1:37502)
0808 15:49:25.038238 (+ 1363us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:25.038256 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:25.038349 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:25.039031 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:25.039034 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:25.039056 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:49:25.039322 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:25.039331 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:25.040566 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:25.040573 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:25.041985 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:25.041995 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:25.043190 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:25.043194 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:25.043286 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:25.043307 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 15:49:25.043371 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 15:49:25.043435 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1287,"mutex_wait_us":1,"thread_start_us":97,"threads_started":1}
I20260808 15:49:25.044258 23427 tablet_bootstrap.cc:492] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec: No bootstrap required, opened a new log
I20260808 15:49:25.044333 23427 ts_tablet_manager.cc:1397] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 15:49:25.044873 23427 raft_consensus.cc:348] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:25.044988 23427 raft_consensus.cc:374] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:49:25.045027 23427 raft_consensus.cc:729] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb49f4400ec4df29448214d18c565ec, State: Initialized, Role: FOLLOWER
I20260808 15:49:25.045167 23427 consensus_queue.cc:260] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:25.045460 23427 ts_tablet_manager.cc:1428] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 15:49:25.046808 23616 tablet_service.cc:1467] Processing CreateTablet for tablet 85332a6a0f9642db8019071ad397b600 (DEFAULT_TABLE table=test-table [id=89bf30895e4f482caa909c2f44edda74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:49:25.047158 23752 tablet_service.cc:1467] Processing CreateTablet for tablet 85332a6a0f9642db8019071ad397b600 (DEFAULT_TABLE table=test-table [id=89bf30895e4f482caa909c2f44edda74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:49:25.048008 23616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85332a6a0f9642db8019071ad397b600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:49:25.048059 23752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85332a6a0f9642db8019071ad397b600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:49:25.056833 23834 tablet_bootstrap.cc:492] T 85332a6a0f9642db8019071ad397b600 P ae59124ccaf9459d94da42e455cd38ec: Bootstrap starting.
I20260808 15:49:25.056833 23833 tablet_bootstrap.cc:492] T 85332a6a0f9642db8019071ad397b600 P ff4a81c8e84b45c3a68de683ec63a17a: Bootstrap starting.
I20260808 15:49:25.059935 23833 tablet_bootstrap.cc:654] T 85332a6a0f9642db8019071ad397b600 P ff4a81c8e84b45c3a68de683ec63a17a: Neither blocks nor log segments found. Creating new log.
I20260808 15:49:25.059935 23834 tablet_bootstrap.cc:654] T 85332a6a0f9642db8019071ad397b600 P ae59124ccaf9459d94da42e455cd38ec: Neither blocks nor log segments found. Creating new log.
I20260808 15:49:25.060947 23834 log.cc:824] T 85332a6a0f9642db8019071ad397b600 P ae59124ccaf9459d94da42e455cd38ec: Log is configured to *not* fsync() on all Append() calls
I20260808 15:49:25.060947 23833 log.cc:824] T 85332a6a0f9642db8019071ad397b600 P ff4a81c8e84b45c3a68de683ec63a17a: Log is configured to *not* fsync() on all Append() calls
I20260808 15:49:25.063477 23834 tablet_bootstrap.cc:492] T 85332a6a0f9642db8019071ad397b600 P ae59124ccaf9459d94da42e455cd38ec: No bootstrap required, opened a new log
I20260808 15:49:25.063477 23833 tablet_bootstrap.cc:492] T 85332a6a0f9642db8019071ad397b600 P ff4a81c8e84b45c3a68de683ec63a17a: No bootstrap required, opened a new log
I20260808 15:49:25.063699 23833 ts_tablet_manager.cc:1397] T 85332a6a0f9642db8019071ad397b600 P ff4a81c8e84b45c3a68de683ec63a17a: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260808 15:49:25.063699 23834 ts_tablet_manager.cc:1397] T 85332a6a0f9642db8019071ad397b600 P ae59124ccaf9459d94da42e455cd38ec: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 15:49:25.067898 23834 raft_consensus.cc:348] T 85332a6a0f9642db8019071ad397b600 P ae59124ccaf9459d94da42e455cd38ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:25.067903 23833 raft_consensus.cc:348] T 85332a6a0f9642db8019071ad397b600 P ff4a81c8e84b45c3a68de683ec63a17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:25.068235 23834 raft_consensus.cc:374] T 85332a6a0f9642db8019071ad397b600 P ae59124ccaf9459d94da42e455cd38ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:49:25.068235 23833 raft_consensus.cc:374] T 85332a6a0f9642db8019071ad397b600 P ff4a81c8e84b45c3a68de683ec63a17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:49:25.068300 23833 raft_consensus.cc:729] T 85332a6a0f9642db8019071ad397b600 P ff4a81c8e84b45c3a68de683ec63a17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4a81c8e84b45c3a68de683ec63a17a, State: Initialized, Role: FOLLOWER
I20260808 15:49:25.068300 23834 raft_consensus.cc:729] T 85332a6a0f9642db8019071ad397b600 P ae59124ccaf9459d94da42e455cd38ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae59124ccaf9459d94da42e455cd38ec, State: Initialized, Role: FOLLOWER
I20260808 15:49:25.068807 23834 consensus_queue.cc:260] T 85332a6a0f9642db8019071ad397b600 P ae59124ccaf9459d94da42e455cd38ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:25.068807 23833 consensus_queue.cc:260] T 85332a6a0f9642db8019071ad397b600 P ff4a81c8e84b45c3a68de683ec63a17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:25.069651 23818 heartbeater.cc:503] Master 127.8.39.126:41885 was elected leader, sending a full tablet report...
I20260808 15:49:25.069885 23683 heartbeater.cc:503] Master 127.8.39.126:41885 was elected leader, sending a full tablet report...
I20260808 15:49:25.069962 23833 ts_tablet_manager.cc:1428] T 85332a6a0f9642db8019071ad397b600 P ff4a81c8e84b45c3a68de683ec63a17a: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 15:49:25.069962 23834 ts_tablet_manager.cc:1428] T 85332a6a0f9642db8019071ad397b600 P ae59124ccaf9459d94da42e455cd38ec: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260808 15:49:25.070936 23541 tablet.cc:2369] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:49:25.133934 23546 raft_consensus.cc:482] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:49:25.134155 23546 raft_consensus.cc:504] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:25.135458 23546 leader_election.cc:288] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae59124ccaf9459d94da42e455cd38ec (127.8.39.66:39761), ff4a81c8e84b45c3a68de683ec63a17a (127.8.39.67:41487)
I20260808 15:49:25.139534 23831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:25.136222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:40567 (local address 127.8.39.67:41487)
0808 15:49:25.136368 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:25.136373 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:25.136389 (+ 16us) server_negotiation.cc:407] Connection header received
0808 15:49:25.136547 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:25.136550 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:25.136600 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:25.136680 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:49:25.136918 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:25.137406 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:25.138412 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:25.138877 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:25.139001 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:25.139068 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:25.139315 (+ 247us) server_negotiation.cc:299] Negotiation successful
0808 15:49:25.139395 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 15:49:25.139564 23839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:25.135641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:39761 (local address 127.8.39.65:37919)
0808 15:49:25.135925 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:25.135942 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:25.136053 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:25.136384 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:25.136388 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:25.136427 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:49:25.136552 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:25.136558 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:25.137319 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:25.137325 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:25.138210 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:25.138220 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:25.138982 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:25.138985 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:25.139162 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:25.139203 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 15:49:25.139297 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 15:49:25.139409 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"mutex_wait_us":77,"spinlock_wait_cycles":10496,"thread_start_us":118,"threads_started":1}
I20260808 15:49:25.139577 23840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:25.136063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:41487 (local address 127.8.39.65:40567)
0808 15:49:25.136316 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:25.136329 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:25.136424 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:25.136694 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:25.136696 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:25.136713 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:49:25.136812 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:25.136818 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:25.137525 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:25.137529 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:25.138286 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:25.138294 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:25.139000 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:25.139004 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:25.139160 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:25.139200 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 15:49:25.139287 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 15:49:25.139392 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"mutex_wait_us":27,"spinlock_wait_cycles":4480,"thread_start_us":88,"threads_started":1}
I20260808 15:49:25.139544 23829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:25.135833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:37919 (local address 127.8.39.66:39761)
0808 15:49:25.135968 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:25.135972 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:25.135990 (+ 18us) server_negotiation.cc:407] Connection header received
0808 15:49:25.136218 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:25.136222 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:25.136281 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:25.136367 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:49:25.136680 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:25.137205 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:25.138348 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:25.138852 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:25.138975 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:25.139045 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:25.139315 (+ 270us) server_negotiation.cc:299] Negotiation successful
0808 15:49:25.139399 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 15:49:25.140326 23772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85332a6a0f9642db8019071ad397b600" candidate_uuid: "afb49f4400ec4df29448214d18c565ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" is_pre_election: true
I20260808 15:49:25.140470 23636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85332a6a0f9642db8019071ad397b600" candidate_uuid: "afb49f4400ec4df29448214d18c565ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae59124ccaf9459d94da42e455cd38ec" is_pre_election: true
I20260808 15:49:25.140682 23772 raft_consensus.cc:2454] T 85332a6a0f9642db8019071ad397b600 P ff4a81c8e84b45c3a68de683ec63a17a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb49f4400ec4df29448214d18c565ec in term 0.
I20260808 15:49:25.140830 23636 raft_consensus.cc:2454] T 85332a6a0f9642db8019071ad397b600 P ae59124ccaf9459d94da42e455cd38ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afb49f4400ec4df29448214d18c565ec in term 0.
I20260808 15:49:25.141220 23424 leader_election.cc:302] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afb49f4400ec4df29448214d18c565ec, ff4a81c8e84b45c3a68de683ec63a17a; no voters:
I20260808 15:49:25.141497 23546 raft_consensus.cc:2781] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:49:25.141582 23546 raft_consensus.cc:482] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:49:25.141614 23546 raft_consensus.cc:3037] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:49:25.142853 23546 raft_consensus.cc:504] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:25.143234 23546 leader_election.cc:288] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [CANDIDATE]: Term 1 election: Requested vote from peers ae59124ccaf9459d94da42e455cd38ec (127.8.39.66:39761), ff4a81c8e84b45c3a68de683ec63a17a (127.8.39.67:41487)
I20260808 15:49:25.143800 23636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85332a6a0f9642db8019071ad397b600" candidate_uuid: "afb49f4400ec4df29448214d18c565ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae59124ccaf9459d94da42e455cd38ec"
I20260808 15:49:25.143958 23636 raft_consensus.cc:3037] T 85332a6a0f9642db8019071ad397b600 P ae59124ccaf9459d94da42e455cd38ec [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:49:25.144117 23772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85332a6a0f9642db8019071ad397b600" candidate_uuid: "afb49f4400ec4df29448214d18c565ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff4a81c8e84b45c3a68de683ec63a17a"
I20260808 15:49:25.144260 23772 raft_consensus.cc:3037] T 85332a6a0f9642db8019071ad397b600 P ff4a81c8e84b45c3a68de683ec63a17a [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:49:25.145145 23636 raft_consensus.cc:2454] T 85332a6a0f9642db8019071ad397b600 P ae59124ccaf9459d94da42e455cd38ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb49f4400ec4df29448214d18c565ec in term 1.
I20260808 15:49:25.145385 23772 raft_consensus.cc:2454] T 85332a6a0f9642db8019071ad397b600 P ff4a81c8e84b45c3a68de683ec63a17a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afb49f4400ec4df29448214d18c565ec in term 1.
I20260808 15:49:25.145459 23424 leader_election.cc:302] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae59124ccaf9459d94da42e455cd38ec, afb49f4400ec4df29448214d18c565ec; no voters:
I20260808 15:49:25.145663 23546 raft_consensus.cc:2781] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:49:25.145893 23546 raft_consensus.cc:686] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 1 LEADER]: Becoming Leader. State: Replica: afb49f4400ec4df29448214d18c565ec, State: Running, Role: LEADER
I20260808 15:49:25.146188 23546 consensus_queue.cc:237] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:25.149580 23341 catalog_manager.cc:5495] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec reported cstate change: term changed from 0 to 1, leader changed from <none> to afb49f4400ec4df29448214d18c565ec (127.8.39.65). New cstate: current_term: 1 leader_uuid: "afb49f4400ec4df29448214d18c565ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } health_report { overall_health: HEALTHY } } }
I20260808 15:49:25.168680 23844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:25.164786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42554 (local address 127.8.39.65:44579)
0808 15:49:25.165073 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:25.165081 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:25.165094 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:49:25.165170 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:25.165172 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:25.165224 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:25.165328 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:49:25.165541 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:25.166105 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:25.167055 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:25.167316 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:25.167416 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:25.167676 (+ 260us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:49:25.168195 (+ 519us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:49:25.168296 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:25.168458 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 15:49:25.168522 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":110,"threads_started":1}
I20260808 15:49:25.173131 23636 raft_consensus.cc:1261] T 85332a6a0f9642db8019071ad397b600 P ae59124ccaf9459d94da42e455cd38ec [term 1 FOLLOWER]: Refusing update from remote peer afb49f4400ec4df29448214d18c565ec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:49:25.173147 23772 raft_consensus.cc:1261] T 85332a6a0f9642db8019071ad397b600 P ff4a81c8e84b45c3a68de683ec63a17a [term 1 FOLLOWER]: Refusing update from remote peer afb49f4400ec4df29448214d18c565ec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:49:25.173951 23841 consensus_queue.cc:1035] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:49:25.174165 23546 consensus_queue.cc:1035] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:49:25.182713 23846 mvcc.cc:205] Tried to move back new op lower bound from 7316292260542287872 to 7316292260441612288. Current Snapshot: MvccSnapshot[applied={T|T < 7316292260542287872}]
I20260808 15:49:25.182783 23847 mvcc.cc:205] Tried to move back new op lower bound from 7316292260542287872 to 7316292260441612288. Current Snapshot: MvccSnapshot[applied={T|T < 7316292260542287872}]
I20260808 15:49:25.190600 23341 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:49310:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:49:25.190855 23341 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:49310:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:49:25.193358 23341 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d: Sending DeleteTablet for 3 replicas of tablet 85332a6a0f9642db8019071ad397b600
I20260808 15:49:25.194152 23471 tablet_service.cc:1514] Processing DeleteTablet for tablet 85332a6a0f9642db8019071ad397b600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:49:25 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:42542
I20260808 15:49:25.194279 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 23382
I20260808 15:49:25.194410 23752 tablet_service.cc:1514] Processing DeleteTablet for tablet 85332a6a0f9642db8019071ad397b600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:49:25 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:37502
I20260808 15:49:25.194976 23616 tablet_service.cc:1514] Processing DeleteTablet for tablet 85332a6a0f9642db8019071ad397b600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:49:25 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:53284
I20260808 15:49:25.196771 23856 tablet_replica.cc:330] T 85332a6a0f9642db8019071ad397b600 P ae59124ccaf9459d94da42e455cd38ec: stopping tablet replica
I20260808 15:49:25.197109 23856 raft_consensus.cc:2229] T 85332a6a0f9642db8019071ad397b600 P ae59124ccaf9459d94da42e455cd38ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:49:25.197444 23856 raft_consensus.cc:2258] T 85332a6a0f9642db8019071ad397b600 P ae59124ccaf9459d94da42e455cd38ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:49:25.197885 23855 tablet_replica.cc:330] T 85332a6a0f9642db8019071ad397b600 P ff4a81c8e84b45c3a68de683ec63a17a: stopping tablet replica
I20260808 15:49:25.198196 23855 raft_consensus.cc:2229] T 85332a6a0f9642db8019071ad397b600 P ff4a81c8e84b45c3a68de683ec63a17a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:49:25.198499 23855 raft_consensus.cc:2258] T 85332a6a0f9642db8019071ad397b600 P ff4a81c8e84b45c3a68de683ec63a17a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:49:25.199334 23856 ts_tablet_manager.cc:1905] T 85332a6a0f9642db8019071ad397b600 P ae59124ccaf9459d94da42e455cd38ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:49:25.199918 23855 ts_tablet_manager.cc:1905] T 85332a6a0f9642db8019071ad397b600 P ff4a81c8e84b45c3a68de683ec63a17a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:49:25.202203 23856 ts_tablet_manager.cc:1918] T 85332a6a0f9642db8019071ad397b600 P ae59124ccaf9459d94da42e455cd38ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:49:25.202324 23856 log.cc:1196] T 85332a6a0f9642db8019071ad397b600 P ae59124ccaf9459d94da42e455cd38ec: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/wal/wals/85332a6a0f9642db8019071ad397b600
I20260808 15:49:25.202658 23855 ts_tablet_manager.cc:1918] T 85332a6a0f9642db8019071ad397b600 P ff4a81c8e84b45c3a68de683ec63a17a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:49:25.202729 23856 ts_tablet_manager.cc:1939] T 85332a6a0f9642db8019071ad397b600 P ae59124ccaf9459d94da42e455cd38ec: Deleting consensus metadata
I20260808 15:49:25.202787 23855 log.cc:1196] T 85332a6a0f9642db8019071ad397b600 P ff4a81c8e84b45c3a68de683ec63a17a: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/85332a6a0f9642db8019071ad397b600
I20260808 15:49:25.203132 23855 ts_tablet_manager.cc:1939] T 85332a6a0f9642db8019071ad397b600 P ff4a81c8e84b45c3a68de683ec63a17a: Deleting consensus metadata
W20260808 15:49:25.203599 23328 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.39.65:44579 (error 108)
I20260808 15:49:25.203919 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 23545
I20260808 15:49:25.204115 23328 catalog_manager.cc:4841] TS ae59124ccaf9459d94da42e455cd38ec (127.8.39.66:39761): tablet 85332a6a0f9642db8019071ad397b600 (table test-table [id=89bf30895e4f482caa909c2f44edda74]) successfully deleted
I20260808 15:49:25.205478 23828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:25.204709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:44579 (local address 127.0.0.1:42556)
0808 15:49:25.205279 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:25.205370 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.65:44579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":455}
W20260808 15:49:25.205911 23328 catalog_manager.cc:4584] TS afb49f4400ec4df29448214d18c565ec (127.8.39.65:44579): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 85332a6a0f9642db8019071ad397b600: Network error: Client connection negotiation failed: client connection to 127.8.39.65:44579: connect: Connection refused (error 111)
I20260808 15:49:25.206868 23328 catalog_manager.cc:4841] TS ff4a81c8e84b45c3a68de683ec63a17a (127.8.39.67:41487): tablet 85332a6a0f9642db8019071ad397b600 (table test-table [id=89bf30895e4f482caa909c2f44edda74]) successfully deleted
I20260808 15:49:25.211300 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 23686
I20260808 15:49:25.217378 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 23307
I20260808 15:49:25.225744 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:41885
--webserver_interface=127.8.39.126
--webserver_port=38411
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:42587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:41885
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:49:25.343405 23858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:25.343721 23858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:25.343807 23858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:25.347942 23858 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:49:25.348053 23858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:25.348091 23858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:25.348145 23858 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:49:25.348183 23858 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:49:25.353756 23858 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:42587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:41885
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:41885
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=38411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23858
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:25.354991 23858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:25.356060 23858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:49:25.364814 23864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:25.364850 23865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:25.364981 23858 server_base.cc:1034] running on GCE node
W20260808 15:49:25.364807 23867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:25.365757 23858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:25.366925 23858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:25.368098 23858 hybrid_clock.cc:648] HybridClock initialized: now 1786204165368064 us; error 50 us; skew 500 ppm
Aug 08 15:49:25 dist-test-slave-8tdl krb5kdc[22726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204165, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:25.370990 23858 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:49:25.371919 23858 webserver.cc:460] Webserver started at http://127.8.39.126:38411/ using document root <none> and password file <none>
I20260808 15:49:25.372565 23858 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:25.372634 23858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:49:25.376708 23858 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:49:25.379024 23874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:25.380395 23858 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 15:49:25.380549 23858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "c3ebb2e9d40a47beb462e80fd8298e3d"
format_stamp: "Formatted at 2026-08-08 15:49:22 on dist-test-slave-8tdl"
server_key: "b1835eddc3e096318828bd9405d2a8e9"
server_key_iv: "7a4c1ab63ea6089a9c34528fe7432767"
server_key_version: "encryptionkey@0"
I20260808 15:49:25.381119 23858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:25.399647 23858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:25.403014 23858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:25.403228 23858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:25.411159 23858 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:41885
I20260808 15:49:25.411489 23926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:41885 every 8 connection(s)
I20260808 15:49:25.412334 23858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:49:25.413260 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 23858
I20260808 15:49:25.413748 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:44579
--local_ip_for_outbound_sockets=127.8.39.65
--tserver_master_addrs=127.8.39.126:41885
--webserver_port=40123
--webserver_interface=127.8.39.65
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:42587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:49:25.417595 23927 sys_catalog.cc:263] Verifying existing consensus state
I20260808 15:49:25.419628 23927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d: Bootstrap starting.
I20260808 15:49:25.440639 23927 log.cc:824] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d: Log is configured to *not* fsync() on all Append() calls
I20260808 15:49:25.453095 23927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 15:49:25.453616 23927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d: Bootstrap complete.
I20260808 15:49:25.458348 23927 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ebb2e9d40a47beb462e80fd8298e3d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41885 } }
I20260808 15:49:25.459209 23927 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3ebb2e9d40a47beb462e80fd8298e3d, State: Initialized, Role: FOLLOWER
I20260808 15:49:25.459858 23927 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ebb2e9d40a47beb462e80fd8298e3d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41885 } }
I20260808 15:49:25.460119 23927 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:49:25.460230 23927 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:49:25.460367 23927 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [term 2 FOLLOWER]: Advancing to term 3
I20260808 15:49:25.462833 23927 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ebb2e9d40a47beb462e80fd8298e3d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41885 } }
I20260808 15:49:25.463265 23927 leader_election.cc:302] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3ebb2e9d40a47beb462e80fd8298e3d; no voters:
I20260808 15:49:25.463691 23927 leader_election.cc:288] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 15:49:25.463873 23932 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [term 3 FOLLOWER]: Leader election won for term 3
I20260808 15:49:25.464202 23932 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [term 3 LEADER]: Becoming Leader. State: Replica: c3ebb2e9d40a47beb462e80fd8298e3d, State: Running, Role: LEADER
I20260808 15:49:25.464593 23932 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ebb2e9d40a47beb462e80fd8298e3d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41885 } }
I20260808 15:49:25.465250 23927 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:49:25.466256 23933 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "c3ebb2e9d40a47beb462e80fd8298e3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ebb2e9d40a47beb462e80fd8298e3d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41885 } } }
I20260808 15:49:25.466410 23933 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [sys.catalog]: This master's current role is: LEADER
I20260808 15:49:25.466790 23934 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3ebb2e9d40a47beb462e80fd8298e3d. Latest consensus state: current_term: 3 leader_uuid: "c3ebb2e9d40a47beb462e80fd8298e3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ebb2e9d40a47beb462e80fd8298e3d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41885 } } }
I20260808 15:49:25.466890 23934 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ebb2e9d40a47beb462e80fd8298e3d [sys.catalog]: This master's current role is: LEADER
I20260808 15:49:25.467341 23942 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:49:25.473265 23942 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:49:25.474416 23942 catalog_manager.cc:1259] Loaded cluster ID: 5de1381d3f8848128e50f785fbdf859b
I20260808 15:49:25.474498 23942 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 15:49:25.475910 23942 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fb1f0c749ad google::LogMessage::Fail() at ??:0
@ 0x7fb1f0c7788a google::LogMessage::SendToLog() at ??:0
@ 0x7fb1f0c744de google::LogMessage::Flush() at ??:0
@ 0x7fb1f0c75a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fb1fb5b7fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7fb1fb5b8d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fb1fb5b5579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7fb1fb5f9640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fb1f2ec63d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fb1f2ec6c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fb1f2ec83f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fb1f2eb7512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fb1f44fb6db start_thread at ??:0
@ 0x7fb1ef77261f clone at ??:0
W20260808 15:49:25.575800 23930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:25.576093 23930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:25.576144 23930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:25.580332 23930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:25.580395 23930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:25.580485 23930 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:49:25.586016 23930 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:42587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:44579
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=40123
--tserver_master_addrs=127.8.39.126:41885
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23930
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:25.587211 23930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:25.588269 23930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:49:25.598476 23972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:25.598524 23971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:25.598519 23975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:25.598654 23930 server_base.cc:1034] running on GCE node
I20260808 15:49:25.599295 23930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:25.599993 23930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:25.601184 23930 hybrid_clock.cc:648] HybridClock initialized: now 1786204165601153 us; error 52 us; skew 500 ppm
Aug 08 15:49:25 dist-test-slave-8tdl krb5kdc[22726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204165, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:25.604210 23930 init.cc:377] Logged in from keytab as kudu/127.8.39.65@KRBTEST.COM (short username kudu)
I20260808 15:49:25.605118 23930 webserver.cc:460] Webserver started at http://127.8.39.65:40123/ using document root <none> and password file <none>
I20260808 15:49:25.605967 23930 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:25.606094 23930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:49:25.610551 23930 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:49:25.613170 23982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:25.614725 23930 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:49:25.614888 23930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "afb49f4400ec4df29448214d18c565ec"
format_stamp: "Formatted at 2026-08-08 15:49:23 on dist-test-slave-8tdl"
server_key: "d0026081035ebcb1b92b3cf77a1b6baf"
server_key_iv: "e2ce5a934938cb0780971e99c1a91f2d"
server_key_version: "encryptionkey@0"
I20260808 15:49:25.615474 23930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:25.629483 23930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:25.632983 23930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:25.633206 23930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:25.633833 23930 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:49:25.635077 23989 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 15:49:25.639237 23930 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 15:49:25.639304 23930 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260808 15:49:25.639353 23930 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 15:49:25.641068 23930 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 15:49:25.641130 23930 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260808 15:49:25.641383 23989 tablet_bootstrap.cc:492] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec: Bootstrap starting.
I20260808 15:49:25.652730 23930 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:44579
I20260808 15:49:25.654058 23930 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:49:25.654392 24102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:44579 every 8 connection(s)
I20260808 15:49:25.662992 23989 log.cc:824] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec: Log is configured to *not* fsync() on all Append() calls
I20260808 15:49:25.663035 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 23930
I20260808 15:49:25.663537 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:39761
--local_ip_for_outbound_sockets=127.8.39.66
--tserver_master_addrs=127.8.39.126:41885
--webserver_port=45347
--webserver_interface=127.8.39.66
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:42587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:49:25.671547 23989 tablet_bootstrap.cc:492] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 15:49:25.672160 23989 tablet_bootstrap.cc:492] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec: Bootstrap complete.
I20260808 15:49:25.673804 23989 ts_tablet_manager.cc:1397] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec: Time spent bootstrapping tablet: real 0.033s user 0.022s sys 0.008s
I20260808 15:49:25.678339 23989 raft_consensus.cc:348] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:25.679136 23989 raft_consensus.cc:729] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb49f4400ec4df29448214d18c565ec, State: Initialized, Role: FOLLOWER
I20260808 15:49:25.679796 23989 consensus_queue.cc:260] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:25.681043 23989 ts_tablet_manager.cc:1428] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
W20260808 15:49:25.734367 24105 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:49:25.656862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.65:53195)
0808 15:49:25.657516 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:25.657578 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:25.658772 (+ 1194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:25.733475 (+ 74703us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":166,"threads_started":1}
W20260808 15:49:25.734990 24103 heartbeater.cc:644] Failed to heartbeat to 127.8.39.126:41885 (0 consecutive failures): Network error: Failed to ping master at 127.8.39.126:41885: Client connection negotiation failed: client connection to 127.8.39.126:41885: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 15:49:25.735793 24105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:25.735501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.65:33917)
0808 15:49:25.735645 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:25.735731 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 15:49:25.736572 24105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:25.736330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.65:40869)
0808 15:49:25.736462 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:25.736520 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260808 15:49:25.736753 24103 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 15:49:25.791883 24107 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:25.792217 24107 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:25.792301 24107 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:25.796669 24107 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:25.796765 24107 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:25.796866 24107 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:49:25.802582 24107 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:42587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:39761
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=45347
--tserver_master_addrs=127.8.39.126:41885
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24107
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:25.803795 24107 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:25.805248 24107 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:49:25.816816 24117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:25.816841 24115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:25.817056 24113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:25.816865 24107 server_base.cc:1034] running on GCE node
I20260808 15:49:25.817624 24107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:25.818322 24107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:25.819523 24107 hybrid_clock.cc:648] HybridClock initialized: now 1786204165819481 us; error 56 us; skew 500 ppm
Aug 08 15:49:25 dist-test-slave-8tdl krb5kdc[22726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204165, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:25.822397 24107 init.cc:377] Logged in from keytab as kudu/127.8.39.66@KRBTEST.COM (short username kudu)
I20260808 15:49:25.823402 24107 webserver.cc:460] Webserver started at http://127.8.39.66:45347/ using document root <none> and password file <none>
I20260808 15:49:25.823977 24107 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:25.824070 24107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:49:25.828020 24107 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:49:25.830137 24124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:25.831501 24107 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:49:25.831645 24107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "ae59124ccaf9459d94da42e455cd38ec"
format_stamp: "Formatted at 2026-08-08 15:49:23 on dist-test-slave-8tdl"
server_key: "3626f5f4978c1f57c5694c9a37a5c159"
server_key_iv: "977888b8bc5722ebc2be48cacd5d94b0"
server_key_version: "encryptionkey@0"
I20260808 15:49:25.832219 24107 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:25.850176 24107 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:25.853637 24107 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:25.853852 24107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:25.854470 24107 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:49:25.855393 24107 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:49:25.855468 24107 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:25.855548 24107 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:49:25.855590 24107 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:25.865832 24107 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:39761
I20260808 15:49:25.865855 24240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:39761 every 8 connection(s)
I20260808 15:49:25.866997 24107 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:49:25.870822 24243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:25.869216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.66:53165)
0808 15:49:25.869909 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:25.870026 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":129,"threads_started":1}
W20260808 15:49:25.871308 24241 heartbeater.cc:644] Failed to heartbeat to 127.8.39.126:41885 (0 consecutive failures): Network error: Failed to ping master at 127.8.39.126:41885: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
I20260808 15:49:25.872051 24243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:25.871750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.66:42439)
0808 15:49:25.871938 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:25.871992 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260808 15:49:25.872810 24243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:25.872619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.66:50481)
0808 15:49:25.872716 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:25.872760 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260808 15:49:25.873026 24241 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 15:49:25.875555 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 24107
I20260808 15:49:25.875983 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:41487
--local_ip_for_outbound_sockets=127.8.39.67
--tserver_master_addrs=127.8.39.126:41885
--webserver_port=39633
--webserver_interface=127.8.39.67
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:42587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:49:25.998404 24244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:25.998769 24244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:25.998822 24244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:26.003050 24244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:26.003118 24244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:26.003181 24244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:49:26.009117 24244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:42587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:41487
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=39633
--tserver_master_addrs=127.8.39.126:41885
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:26.010298 24244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:26.011463 24244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:49:26.023072 24252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:26.023212 24250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:26.023074 24249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:26.023392 24244 server_base.cc:1034] running on GCE node
I20260808 15:49:26.023967 24244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:26.024747 24244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:26.026005 24244 hybrid_clock.cc:648] HybridClock initialized: now 1786204166025985 us; error 41 us; skew 500 ppm
Aug 08 15:49:26 dist-test-slave-8tdl krb5kdc[22726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204166, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:26.029134 24244 init.cc:377] Logged in from keytab as kudu/127.8.39.67@KRBTEST.COM (short username kudu)
I20260808 15:49:26.030164 24244 webserver.cc:460] Webserver started at http://127.8.39.67:39633/ using document root <none> and password file <none>
I20260808 15:49:26.030833 24244 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:26.030936 24244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:49:26.035269 24244 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:49:26.037628 24259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:26.039140 24244 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:49:26.039287 24244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "ff4a81c8e84b45c3a68de683ec63a17a"
format_stamp: "Formatted at 2026-08-08 15:49:23 on dist-test-slave-8tdl"
server_key: "41f60c49360a33508b41e632d3684a75"
server_key_iv: "6605378180b6b34e4c47668ed1504510"
server_key_version: "encryptionkey@0"
I20260808 15:49:26.039882 24244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:26.068562 24244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:26.072395 24244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:26.072630 24244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:26.073318 24244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:49:26.074256 24244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:49:26.074330 24244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:26.074402 24244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:49:26.074445 24244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:26.084378 24244 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:41487
I20260808 15:49:26.084434 24374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:41487 every 8 connection(s)
I20260808 15:49:26.085479 24244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:49:26.089581 24378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:26.087828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.67:36187)
0808 15:49:26.088608 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:26.088730 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":136,"threads_started":1}
W20260808 15:49:26.090166 24376 heartbeater.cc:644] Failed to heartbeat to 127.8.39.126:41885 (0 consecutive failures): Network error: Failed to ping master at 127.8.39.126:41885: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
I20260808 15:49:26.090898 24378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:26.090607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.67:54787)
0808 15:49:26.090783 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:26.090837 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 15:49:26.091709 24378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:26.091495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.67:50209)
0808 15:49:26.091601 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:26.091647 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 15:49:26.091941 24376 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 15:49:26.094466 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 24244
I20260808 15:49:26.737941 24380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:26.737428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.65:43161)
0808 15:49:26.737748 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:26.737817 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":111,"threads_started":1}
I20260808 15:49:26.874047 24381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:26.873594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.66:39787)
0808 15:49:26.873835 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:26.873894 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":74,"threads_started":1}
I20260808 15:49:27.092964 24382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:27.092500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.67:51821)
0808 15:49:27.092786 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:27.092860 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":94,"threads_started":1}
I20260808 15:49:27.553206 24383 raft_consensus.cc:482] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:49:27.553428 24383 raft_consensus.cc:504] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:27.554863 24383 leader_election.cc:288] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae59124ccaf9459d94da42e455cd38ec (127.8.39.66:39761), ff4a81c8e84b45c3a68de683ec63a17a (127.8.39.67:41487)
Aug 08 15:49:27 dist-test-slave-8tdl krb5kdc[22726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204165, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for kudu/127.8.39.66@KRBTEST.COM
Aug 08 15:49:27 dist-test-slave-8tdl krb5kdc[22726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204165, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for kudu/127.8.39.67@KRBTEST.COM
I20260808 15:49:27.576450 24386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:27.555462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:41487 (local address 127.8.39.65:41911)
0808 15:49:27.555847 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:27.555860 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:27.555975 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:27.557347 (+ 1372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:27.557350 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:27.557729 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:27.558241 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:27.558256 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:27.559639 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:27.559647 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:27.560617 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:27.560626 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:27.561342 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:27.561346 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:27.561600 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:27.568362 (+ 6762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:27.568376 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:27.570406 (+ 2030us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:27.572962 (+ 2556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:27.572969 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:27.572984 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:27.573566 (+ 582us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:27.574006 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:27.574010 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:27.574013 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:27.574241 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:27.575147 (+ 906us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:27.575156 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:27.575571 (+ 415us) client_negotiation.cc:769] Sending connection context
0808 15:49:27.575844 (+ 273us) client_negotiation.cc:240] Negotiation successful
0808 15:49:27.576224 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"mutex_wait_us":281,"spinlock_wait_cycles":41984,"thread_start_us":118,"threads_started":1}
I20260808 15:49:27.576663 24387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:27.555784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:41911 (local address 127.8.39.67:41487)
0808 15:49:27.556041 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:27.556066 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:27.556111 (+ 45us) server_negotiation.cc:407] Connection header received
0808 15:49:27.556731 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:27.556736 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:27.557083 (+ 347us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:27.557372 (+ 289us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:27.558418 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:27.559480 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:27.560751 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:27.561214 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:27.561385 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:27.570747 (+ 9362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:27.570757 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:27.570771 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:27.570807 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:27.572784 (+ 1977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:27.573697 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:27.573703 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:27.573708 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:27.573859 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:27.574361 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:27.574366 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:27.574369 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:27.574974 (+ 605us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:27.575145 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:27.576139 (+ 994us) server_negotiation.cc:299] Negotiation successful
0808 15:49:27.576466 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":79,"threads_started":1}
I20260808 15:49:27.576493 24385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:27.555233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:33019 (local address 127.8.39.66:39761)
0808 15:49:27.555541 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:27.555559 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:27.555606 (+ 47us) server_negotiation.cc:407] Connection header received
0808 15:49:27.556435 (+ 829us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:27.556443 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:27.556792 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:27.557050 (+ 258us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:27.558446 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:27.559484 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:27.560746 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:27.561209 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:27.561398 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:27.570354 (+ 8956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:27.570359 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:27.570371 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:27.570401 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:27.572784 (+ 2383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:27.573697 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:27.573703 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:27.573708 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:27.573859 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:27.574384 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:27.574387 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:27.574388 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:27.574974 (+ 586us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:27.575142 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:27.575990 (+ 848us) server_negotiation.cc:299] Negotiation successful
0808 15:49:27.576344 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":112,"threads_started":1}
I20260808 15:49:27.577039 24384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:27.555101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:39761 (local address 127.8.39.65:33019)
0808 15:49:27.555325 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:27.555340 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:27.555449 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:27.557172 (+ 1723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:27.557178 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:27.557742 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:27.558241 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:27.558257 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:27.559637 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:27.559640 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:27.560615 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:27.560625 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:27.561348 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:27.561352 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:27.561604 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:27.568338 (+ 6734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:27.568357 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:27.570056 (+ 1699us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:27.572962 (+ 2906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:27.572969 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:27.572984 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:27.573566 (+ 582us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:27.574006 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:27.574010 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:27.574013 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:27.574241 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:27.575147 (+ 906us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:27.575156 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:27.575571 (+ 415us) client_negotiation.cc:769] Sending connection context
0808 15:49:27.575836 (+ 265us) client_negotiation.cc:240] Negotiation successful
0808 15:49:27.576746 (+ 910us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":907,"spinlock_wait_cycles":28544,"thread_start_us":84,"threads_started":1}
W20260808 15:49:27.579865 23986 leader_election.cc:341] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ae59124ccaf9459d94da42e455cd38ec (127.8.39.66:39761): Not found: Tablet not found: 85332a6a0f9642db8019071ad397b600
W20260808 15:49:27.580058 23986 leader_election.cc:341] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ff4a81c8e84b45c3a68de683ec63a17a (127.8.39.67:41487): Not found: Tablet not found: 85332a6a0f9642db8019071ad397b600
I20260808 15:49:27.580104 23986 leader_election.cc:302] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb49f4400ec4df29448214d18c565ec; no voters: ae59124ccaf9459d94da42e455cd38ec, ff4a81c8e84b45c3a68de683ec63a17a
I20260808 15:49:27.580336 24383 raft_consensus.cc:2726] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 15:49:27.739391 24384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:27.739061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.65:55387)
0808 15:49:27.739217 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:27.739293 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260808 15:49:27.875510 24388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:27.875046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.66:37689)
0808 15:49:27.875325 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:27.875383 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":103,"threads_started":1}
I20260808 15:49:28.094235 24389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:28.093799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.67:46787)
0808 15:49:28.094078 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:28.094141 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":82,"threads_started":1}
I20260808 15:49:28.740711 24390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:28.740266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.65:35895)
0808 15:49:28.740542 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:28.740605 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":78,"threads_started":1}
I20260808 15:49:28.876909 24391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:28.876410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.66:45467)
0808 15:49:28.876735 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:28.876804 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":106,"threads_started":1}
I20260808 15:49:29.095461 24392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:29.095023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.67:39305)
0808 15:49:29.095308 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:29.095366 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":94,"threads_started":1}
I20260808 15:49:29.645732 24393 raft_consensus.cc:482] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:49:29.645874 24393 raft_consensus.cc:504] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:29.646473 24393 leader_election.cc:288] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae59124ccaf9459d94da42e455cd38ec (127.8.39.66:39761), ff4a81c8e84b45c3a68de683ec63a17a (127.8.39.67:41487)
W20260808 15:49:29.647349 23986 leader_election.cc:341] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ae59124ccaf9459d94da42e455cd38ec (127.8.39.66:39761): Not found: Tablet not found: 85332a6a0f9642db8019071ad397b600
W20260808 15:49:29.647507 23986 leader_election.cc:341] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ff4a81c8e84b45c3a68de683ec63a17a (127.8.39.67:41487): Not found: Tablet not found: 85332a6a0f9642db8019071ad397b600
I20260808 15:49:29.647565 23986 leader_election.cc:302] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb49f4400ec4df29448214d18c565ec; no voters: ae59124ccaf9459d94da42e455cd38ec, ff4a81c8e84b45c3a68de683ec63a17a
I20260808 15:49:29.647761 24393 raft_consensus.cc:2726] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 15:49:29.742158 24394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:29.741668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.65:57745)
0808 15:49:29.741976 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:29.742055 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":112,"threads_started":1}
I20260808 15:49:29.878377 24395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:29.877917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.66:59415)
0808 15:49:29.878223 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:29.878277 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":117,"threads_started":1}
I20260808 15:49:30.096894 24396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:30.096379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.67:60051)
0808 15:49:30.096727 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:30.096792 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":136,"threads_started":1}
I20260808 15:49:30.743834 24397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:30.743262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.65:46279)
0808 15:49:30.743675 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:30.743735 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":85,"threads_started":1}
I20260808 15:49:30.879781 24398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:30.879295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.66:51223)
0808 15:49:30.879606 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:30.879675 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":84,"threads_started":1}
I20260808 15:49:31.098102 24399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:31.097682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.67:41057)
0808 15:49:31.097940 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:31.097995 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":72,"threads_started":1}
I20260808 15:49:31.683136 24400 raft_consensus.cc:482] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:49:31.683320 24400 raft_consensus.cc:504] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:31.683758 24400 leader_election.cc:288] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae59124ccaf9459d94da42e455cd38ec (127.8.39.66:39761), ff4a81c8e84b45c3a68de683ec63a17a (127.8.39.67:41487)
W20260808 15:49:31.684685 23986 leader_election.cc:341] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ae59124ccaf9459d94da42e455cd38ec (127.8.39.66:39761): Not found: Tablet not found: 85332a6a0f9642db8019071ad397b600
W20260808 15:49:31.684844 23986 leader_election.cc:341] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ff4a81c8e84b45c3a68de683ec63a17a (127.8.39.67:41487): Not found: Tablet not found: 85332a6a0f9642db8019071ad397b600
I20260808 15:49:31.684900 23986 leader_election.cc:302] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb49f4400ec4df29448214d18c565ec; no voters: ae59124ccaf9459d94da42e455cd38ec, ff4a81c8e84b45c3a68de683ec63a17a
I20260808 15:49:31.685104 24400 raft_consensus.cc:2726] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 15:49:31.745220 24401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:31.744747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.65:46297)
0808 15:49:31.745056 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:31.745115 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":127,"threads_started":1}
I20260808 15:49:31.881055 24402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:31.880552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.66:47195)
0808 15:49:31.880827 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:31.880939 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":83,"threads_started":1}
I20260808 15:49:32.099323 24403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:32.098888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.67:41403)
0808 15:49:32.099165 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:32.099222 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":80,"threads_started":1}
I20260808 15:49:32.746855 24404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:32.746250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.65:60879)
0808 15:49:32.746603 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:32.746738 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":109,"threads_started":1}
I20260808 15:49:32.882310 24405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:32.881826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.66:58343)
0808 15:49:32.882153 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:32.882211 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":77,"threads_started":1}
I20260808 15:49:33.100695 24406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:33.100195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.67:46195)
0808 15:49:33.100536 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:33.100599 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":89,"threads_started":1}
I20260808 15:49:33.748467 24407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:33.747973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.65:36599)
0808 15:49:33.748267 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:33.748332 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":90,"threads_started":1}
I20260808 15:49:33.883697 24408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:33.883227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.66:54097)
0808 15:49:33.883527 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:33.883597 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":82,"threads_started":1}
I20260808 15:49:34.102016 24409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:34.101561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.67:50275)
0808 15:49:34.101851 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:34.101917 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":82,"threads_started":1}
I20260808 15:49:34.749801 24410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:34.749352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.65:34481)
0808 15:49:34.749636 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:34.749701 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":122,"threads_started":1}
I20260808 15:49:34.885159 24411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:34.884668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.66:39489)
0808 15:49:34.884985 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:34.885059 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":90,"threads_started":1}
I20260808 15:49:35.103484 24412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:35.103005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.67:41391)
0808 15:49:35.103308 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:35.103379 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":81,"threads_started":1}
I20260808 15:49:35.125671 24413 raft_consensus.cc:482] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:49:35.125814 24413 raft_consensus.cc:504] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:35.126186 24413 leader_election.cc:288] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae59124ccaf9459d94da42e455cd38ec (127.8.39.66:39761), ff4a81c8e84b45c3a68de683ec63a17a (127.8.39.67:41487)
W20260808 15:49:35.127079 23986 leader_election.cc:341] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ae59124ccaf9459d94da42e455cd38ec (127.8.39.66:39761): Not found: Tablet not found: 85332a6a0f9642db8019071ad397b600
W20260808 15:49:35.127245 23986 leader_election.cc:341] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ff4a81c8e84b45c3a68de683ec63a17a (127.8.39.67:41487): Not found: Tablet not found: 85332a6a0f9642db8019071ad397b600
I20260808 15:49:35.127314 23986 leader_election.cc:302] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb49f4400ec4df29448214d18c565ec; no voters: ae59124ccaf9459d94da42e455cd38ec, ff4a81c8e84b45c3a68de683ec63a17a
I20260808 15:49:35.127519 24413 raft_consensus.cc:2726] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 15:49:35.751298 24414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:35.750819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.65:57841)
0808 15:49:35.751134 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:35.751198 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":82,"threads_started":1}
I20260808 15:49:35.886572 24415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:35.886079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.66:56407)
0808 15:49:35.886396 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:35.886466 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":84,"threads_started":1}
I20260808 15:49:36.104734 24416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:36.104293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.67:32991)
0808 15:49:36.104558 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:36.104619 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":78,"threads_started":1}
I20260808 15:49:36.752880 24417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:36.752358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.65:35253)
0808 15:49:36.752655 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:36.752722 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":100,"threads_started":1}
I20260808 15:49:36.887935 24418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:36.887436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.66:33789)
0808 15:49:36.887759 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:36.887830 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":124,"threads_started":1}
I20260808 15:49:37.106007 24419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:37.105579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.67:41931)
0808 15:49:37.105852 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:37.105908 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":105,"threads_started":1}
I20260808 15:49:37.754175 24420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:37.753684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.65:44853)
0808 15:49:37.753981 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:37.754071 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":107,"threads_started":1}
I20260808 15:49:37.889259 24421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:37.888817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.66:33221)
0808 15:49:37.889098 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:37.889157 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":99,"threads_started":1}
I20260808 15:49:38.107436 24422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:38.106919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.67:48933)
0808 15:49:38.107246 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:38.107312 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":109,"threads_started":1}
I20260808 15:49:38.755483 24423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:38.755016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.65:45983)
0808 15:49:38.755310 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:38.755379 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":101,"threads_started":1}
I20260808 15:49:38.890524 24424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:38.890061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.66:50613)
0808 15:49:38.890355 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:38.890418 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":103,"threads_started":1}
I20260808 15:49:39.108919 24425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:39.108418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.67:44735)
0808 15:49:39.108721 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:39.108789 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":108,"threads_started":1}
I20260808 15:49:39.756819 24426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:39.756340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.65:43673)
0808 15:49:39.756650 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:39.756716 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":104,"threads_started":1}
I20260808 15:49:39.891965 24427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:39.891494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.66:33399)
0808 15:49:39.891797 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:39.891863 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":111,"threads_started":1}
I20260808 15:49:40.110199 24428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:40.109770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.67:51115)
0808 15:49:40.110036 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:40.110097 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":83,"threads_started":1}
I20260808 15:49:40.758198 24429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:40.757757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.65:39753)
0808 15:49:40.758041 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:40.758097 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":92,"threads_started":1}
I20260808 15:49:40.893360 24430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:40.892923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.66:45329)
0808 15:49:40.893202 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:40.893259 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":93,"threads_started":1}
I20260808 15:49:41.027710 24431 raft_consensus.cc:482] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:49:41.027980 24431 raft_consensus.cc:504] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae59124ccaf9459d94da42e455cd38ec" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 39761 } } peers { permanent_uuid: "ff4a81c8e84b45c3a68de683ec63a17a" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41487 } } peers { permanent_uuid: "afb49f4400ec4df29448214d18c565ec" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 44579 } }
I20260808 15:49:41.028431 24431 leader_election.cc:288] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae59124ccaf9459d94da42e455cd38ec (127.8.39.66:39761), ff4a81c8e84b45c3a68de683ec63a17a (127.8.39.67:41487)
W20260808 15:49:41.029422 23986 leader_election.cc:341] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ae59124ccaf9459d94da42e455cd38ec (127.8.39.66:39761): Not found: Tablet not found: 85332a6a0f9642db8019071ad397b600
W20260808 15:49:41.029557 23986 leader_election.cc:341] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ff4a81c8e84b45c3a68de683ec63a17a (127.8.39.67:41487): Not found: Tablet not found: 85332a6a0f9642db8019071ad397b600
I20260808 15:49:41.029640 23986 leader_election.cc:302] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afb49f4400ec4df29448214d18c565ec; no voters: ae59124ccaf9459d94da42e455cd38ec, ff4a81c8e84b45c3a68de683ec63a17a
I20260808 15:49:41.029824 24431 raft_consensus.cc:2726] T 85332a6a0f9642db8019071ad397b600 P afb49f4400ec4df29448214d18c565ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 15:49:41.098595 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 23930
I20260808 15:49:41.107889 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 24107
I20260808 15:49:41.111708 24432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:41.111277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41885 (local address 127.8.39.67:60259)
0808 15:49:41.111539 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:41.111607 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:41885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":98,"threads_started":1}
I20260808 15:49:41.116012 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 24244
2026-08-08T15:49:41Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19529 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:49:41 dist-test-slave-8tdl krb5kdc[24435](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:49:41 dist-test-slave-8tdl krb5kdc[24435](info): set up 2 sockets
Aug 08 15:49:41 dist-test-slave-8tdl krb5kdc[24435](info): commencing operation
krb5kdc: starting...
W20260808 15:49:42.216789 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.008s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:49:42 dist-test-slave-8tdl krb5kdc[24435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204182, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:49:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:49:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:49:42.352156 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:35009
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:36349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:35009
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:49:42.473086 24449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:42.473452 24449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:42.473531 24449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:42.477641 24449 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 15:49:42.477737 24449 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 15:49:42.477766 24449 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 15:49:42.477792 24449 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:49:42.477833 24449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:42.477878 24449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:42.477937 24449 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:49:42.477977 24449 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:49:42.483453 24449 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:36349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:35009
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:35009
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24449
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:42.484612 24449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:42.485682 24449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:49:42.495011 24454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:42.495004 24455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:42.495064 24449 server_base.cc:1034] running on GCE node
W20260808 15:49:42.495010 24457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:42.495926 24449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:42.497133 24449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:42.498329 24449 hybrid_clock.cc:648] HybridClock initialized: now 1786204182498303 us; error 53 us; skew 500 ppm
Aug 08 15:49:42 dist-test-slave-8tdl krb5kdc[24435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204182, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:42.501248 24449 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:49:42.502147 24449 webserver.cc:460] Webserver started at http://127.8.39.126:45241/ using document root <none> and password file <none>
I20260808 15:49:42.502743 24449 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:42.502820 24449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:49:42.503005 24449 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:49:42.505054 24449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "62e49714697a4cd5bf989ce17528b876"
format_stamp: "Formatted at 2026-08-08 15:49:42 on dist-test-slave-8tdl"
server_key: "2bc7525930dfed8cf39c39ec2dc6f446"
server_key_iv: "b55b03d8b2d124430b78eab5bc449e10"
server_key_version: "encryptionkey@0"
I20260808 15:49:42.505585 24449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "62e49714697a4cd5bf989ce17528b876"
format_stamp: "Formatted at 2026-08-08 15:49:42 on dist-test-slave-8tdl"
server_key: "2bc7525930dfed8cf39c39ec2dc6f446"
server_key_iv: "b55b03d8b2d124430b78eab5bc449e10"
server_key_version: "encryptionkey@0"
I20260808 15:49:42.509331 24449 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 15:49:42.511780 24464 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:42.513027 24449 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:49:42.513178 24449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "62e49714697a4cd5bf989ce17528b876"
format_stamp: "Formatted at 2026-08-08 15:49:42 on dist-test-slave-8tdl"
server_key: "2bc7525930dfed8cf39c39ec2dc6f446"
server_key_iv: "b55b03d8b2d124430b78eab5bc449e10"
server_key_version: "encryptionkey@0"
I20260808 15:49:42.513298 24449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:42.544611 24449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:42.547825 24449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:42.548053 24449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:42.555095 24449 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:35009
I20260808 15:49:42.555421 24517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:35009 every 8 connection(s)
I20260808 15:49:42.556092 24449 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:49:42.558903 24518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:49:42.560618 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 24449
I20260808 15:49:42.560786 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:49:42.561133 8349 external_mini_cluster.cc:1428] Setting key 01ed78731af5c7a6d9b613c607ecde6c
I20260808 15:49:42.566198 24518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876: Bootstrap starting.
I20260808 15:49:42.569226 24518 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876: Neither blocks nor log segments found. Creating new log.
I20260808 15:49:42.570262 24518 log.cc:824] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876: Log is configured to *not* fsync() on all Append() calls
Aug 08 15:49:42 dist-test-slave-8tdl krb5kdc[24435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204182, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:49:42.572757 24518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876: No bootstrap required, opened a new log
I20260808 15:49:42.577809 24518 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e49714697a4cd5bf989ce17528b876" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 35009 } }
I20260808 15:49:42.578047 24521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:42.562647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44112 (local address 127.8.39.126:35009)
0808 15:49:42.563114 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:42.563134 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:42.563178 (+ 44us) server_negotiation.cc:407] Connection header received
0808 15:49:42.564055 (+ 877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:42.564083 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:42.564512 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:42.564887 (+ 375us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:42.565948 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:42.567617 (+ 1669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:42.568554 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:42.569338 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:42.569540 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:42.572370 (+ 2830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:42.572378 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:42.572395 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:42.572428 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:42.574567 (+ 2139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:42.575143 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:42.575153 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:42.575162 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:42.575330 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:42.575657 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:42.575661 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:42.575663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:42.576209 (+ 546us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:42.576428 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:42.576644 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 15:49:42.576968 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":127,"threads_started":1}
I20260808 15:49:42.578105 24518 raft_consensus.cc:374] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:49:42.578158 24518 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62e49714697a4cd5bf989ce17528b876, State: Initialized, Role: FOLLOWER
I20260808 15:49:42.578660 24518 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e49714697a4cd5bf989ce17528b876" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 35009 } }
I20260808 15:49:42.578851 24518 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:49:42.578917 24518 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:49:42.579015 24518 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:49:42.580021 24518 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e49714697a4cd5bf989ce17528b876" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 35009 } }
I20260808 15:49:42.580406 24518 leader_election.cc:302] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62e49714697a4cd5bf989ce17528b876; no voters:
I20260808 15:49:42.580729 24518 leader_election.cc:288] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:49:42.580952 24523 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:49:42.581229 24523 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [term 1 LEADER]: Becoming Leader. State: Replica: 62e49714697a4cd5bf989ce17528b876, State: Running, Role: LEADER
I20260808 15:49:42.581555 24523 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e49714697a4cd5bf989ce17528b876" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 35009 } }
I20260808 15:49:42.582021 24518 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:49:42.583098 24524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "62e49714697a4cd5bf989ce17528b876" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e49714697a4cd5bf989ce17528b876" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 35009 } } }
I20260808 15:49:42.583231 24524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [sys.catalog]: This master's current role is: LEADER
I20260808 15:49:42.583577 24525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62e49714697a4cd5bf989ce17528b876. Latest consensus state: current_term: 1 leader_uuid: "62e49714697a4cd5bf989ce17528b876" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e49714697a4cd5bf989ce17528b876" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 35009 } } }
I20260808 15:49:42.583683 24525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [sys.catalog]: This master's current role is: LEADER
W20260808 15:49:42.587458 24538 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:49:42.587555 24538 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:49:42.587678 24532 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:49:42.588634 24532 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:49:42.595600 24532 catalog_manager.cc:1347] Generated new cluster ID: 0ad9734588e045c38a1c6ff17dd60f3c
I20260808 15:49:42.595705 24532 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:49:42.604041 24532 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:49:42.604941 24532 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:49:42.609582 24532 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876: Generated new TSK 0
I20260808 15:49:42.610239 24532 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.39.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
I20260808 15:49:42.645815 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:0
--local_ip_for_outbound_sockets=127.8.39.65
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:35009
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:36349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:49:42.762545 24545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:42.762838 24545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:42.762885 24545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:42.766979 24545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:42.767051 24545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:42.767154 24545 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:49:42.772610 24545 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:36349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:35009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:42.773733 24545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:42.774811 24545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:49:42.785130 24551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:42.785113 24550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:42.785245 24545 server_base.cc:1034] running on GCE node
W20260808 15:49:42.785113 24553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:42.785952 24545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:42.786839 24545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:42.788062 24545 hybrid_clock.cc:648] HybridClock initialized: now 1786204182788033 us; error 41 us; skew 500 ppm
Aug 08 15:49:42 dist-test-slave-8tdl krb5kdc[24435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204182, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:42.791357 24545 init.cc:377] Logged in from keytab as kudu/127.8.39.65@KRBTEST.COM (short username kudu)
I20260808 15:49:42.792339 24545 webserver.cc:460] Webserver started at http://127.8.39.65:39991/ using document root <none> and password file <none>
I20260808 15:49:42.792992 24545 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:42.793087 24545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:49:42.793324 24545 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:49:42.795523 24545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/data/instance:
uuid: "eb58936031334fd9b040449fef479585"
format_stamp: "Formatted at 2026-08-08 15:49:42 on dist-test-slave-8tdl"
server_key: "6717989036ca4db876521f1e99da4c1f"
server_key_iv: "0f08fceda3634dab85cd8a76afb32df1"
server_key_version: "encryptionkey@0"
I20260808 15:49:42.796110 24545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance:
uuid: "eb58936031334fd9b040449fef479585"
format_stamp: "Formatted at 2026-08-08 15:49:42 on dist-test-slave-8tdl"
server_key: "6717989036ca4db876521f1e99da4c1f"
server_key_iv: "0f08fceda3634dab85cd8a76afb32df1"
server_key_version: "encryptionkey@0"
I20260808 15:49:42.800431 24545 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 15:49:42.803089 24560 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:42.804482 24545 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 15:49:42.804733 24545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "eb58936031334fd9b040449fef479585"
format_stamp: "Formatted at 2026-08-08 15:49:42 on dist-test-slave-8tdl"
server_key: "6717989036ca4db876521f1e99da4c1f"
server_key_iv: "0f08fceda3634dab85cd8a76afb32df1"
server_key_version: "encryptionkey@0"
I20260808 15:49:42.804862 24545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:42.823119 24545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:42.826268 24545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:42.826484 24545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:42.827224 24545 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:49:42.828115 24545 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:49:42.828166 24545 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:42.828207 24545 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:49:42.828230 24545 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:42.837441 24545 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:37077
I20260808 15:49:42.837469 24678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:37077 every 8 connection(s)
I20260808 15:49:42.838376 24545 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:49:42.843590 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 24545
I20260808 15:49:42.843709 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance
I20260808 15:49:42.844027 8349 external_mini_cluster.cc:1428] Setting key 4d3db2ba1ce067925c783534b3f06635
Aug 08 15:49:42 dist-test-slave-8tdl krb5kdc[24435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204182, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:49:42.853649 24521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:42.840232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:50991 (local address 127.8.39.126:35009)
0808 15:49:42.840371 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:42.840375 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:42.841474 (+ 1099us) server_negotiation.cc:407] Connection header received
0808 15:49:42.842425 (+ 951us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:42.842429 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:42.842517 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:42.842616 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:42.843862 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:42.844504 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:42.846204 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:42.846653 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:42.846805 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:42.849584 (+ 2779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:42.849590 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:42.849596 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:42.849629 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:42.851388 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:42.851907 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:42.851914 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:42.851919 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:42.852016 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:42.852351 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:42.852357 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:42.852360 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:42.852645 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:42.852764 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:42.853283 (+ 519us) server_negotiation.cc:299] Negotiation successful
0808 15:49:42.853429 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 15:49:42.854399 24681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:42.840639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.65:50991)
0808 15:49:42.841337 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:42.841380 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:42.842223 (+ 843us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:42.842816 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:42.842823 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:42.843190 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:42.843716 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:42.843739 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:42.844652 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:42.844655 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:42.846049 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:42.846064 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:42.846833 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:42.846837 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:42.846982 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:42.847620 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:42.847637 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:42.849397 (+ 1760us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:42.851523 (+ 2126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:42.851529 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:42.851542 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:42.851803 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:42.852120 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:42.852122 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:42.852123 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:42.852259 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:42.852749 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:42.852753 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:42.852996 (+ 243us) client_negotiation.cc:769] Sending connection context
0808 15:49:42.853196 (+ 200us) client_negotiation.cc:240] Negotiation successful
0808 15:49:42.853473 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":120,"threads_started":1}
WARNING: no policy specified for kudu/127.8.39.66@KRBTEST.COM; defaulting to no policy
I20260808 15:49:42.855741 24679 heartbeater.cc:347] Connected to a master server at 127.8.39.126:35009
I20260808 15:49:42.855989 24679 heartbeater.cc:464] Registering TS with master...
I20260808 15:49:42.856491 24679 heartbeater.cc:511] Master 127.8.39.126:35009 requested a full tablet report, sending...
I20260808 15:49:42.858079 24482 ts_manager.cc:194] Registered new tserver with Master: eb58936031334fd9b040449fef479585 (127.8.39.65:37077)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.66@KRBTEST.COM" created.
I20260808 15:49:42.859272 24482 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.65@KRBTEST.COM'} at 127.8.39.65:50991
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
I20260808 15:49:42.875737 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:0
--local_ip_for_outbound_sockets=127.8.39.66
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:35009
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:36349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:49:42.991433 24684 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:42.991706 24684 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:42.991750 24684 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:42.996202 24684 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:42.996279 24684 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:42.996340 24684 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:49:43.001781 24684 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:36349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:35009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24684
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:43.003115 24684 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:43.004151 24684 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:49:43.013983 24690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:43.014045 24689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:43.013998 24692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:43.014889 24684 server_base.cc:1034] running on GCE node
I20260808 15:49:43.015331 24684 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:43.016012 24684 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:43.017167 24684 hybrid_clock.cc:648] HybridClock initialized: now 1786204183017125 us; error 54 us; skew 500 ppm
Aug 08 15:49:43 dist-test-slave-8tdl krb5kdc[24435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204183, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:43.019951 24684 init.cc:377] Logged in from keytab as kudu/127.8.39.66@KRBTEST.COM (short username kudu)
I20260808 15:49:43.020882 24684 webserver.cc:460] Webserver started at http://127.8.39.66:43147/ using document root <none> and password file <none>
I20260808 15:49:43.021500 24684 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:43.021593 24684 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:49:43.021818 24684 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:49:43.024111 24684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/data/instance:
uuid: "e46deffb10e14cd7b30dcd1a4291e836"
format_stamp: "Formatted at 2026-08-08 15:49:43 on dist-test-slave-8tdl"
server_key: "5229c09adda0f442ecceea88d0a15715"
server_key_iv: "0edd5aa80519ddc600965a534548c0f5"
server_key_version: "encryptionkey@0"
I20260808 15:49:43.024736 24684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance:
uuid: "e46deffb10e14cd7b30dcd1a4291e836"
format_stamp: "Formatted at 2026-08-08 15:49:43 on dist-test-slave-8tdl"
server_key: "5229c09adda0f442ecceea88d0a15715"
server_key_iv: "0edd5aa80519ddc600965a534548c0f5"
server_key_version: "encryptionkey@0"
I20260808 15:49:43.028682 24684 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260808 15:49:43.031049 24700 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:43.032312 24684 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:49:43.032457 24684 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "e46deffb10e14cd7b30dcd1a4291e836"
format_stamp: "Formatted at 2026-08-08 15:49:43 on dist-test-slave-8tdl"
server_key: "5229c09adda0f442ecceea88d0a15715"
server_key_iv: "0edd5aa80519ddc600965a534548c0f5"
server_key_version: "encryptionkey@0"
I20260808 15:49:43.032579 24684 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:43.055405 24684 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:43.058341 24684 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:43.058821 24684 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:43.059556 24684 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:49:43.060413 24684 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:49:43.060485 24684 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:43.060559 24684 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:49:43.060609 24684 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:43.069664 24684 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:33605
I20260808 15:49:43.069689 24816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:33605 every 8 connection(s)
I20260808 15:49:43.070566 24684 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:49:43.073518 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 24684
I20260808 15:49:43.073650 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance
I20260808 15:49:43.073982 8349 external_mini_cluster.cc:1428] Setting key 7803eab0f78ade68c6e4c0a2fa8b7d3f
Aug 08 15:49:43 dist-test-slave-8tdl krb5kdc[24435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204183, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.39.67@KRBTEST.COM; defaulting to no policy
I20260808 15:49:43.086400 24521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:43.072595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:50001 (local address 127.8.39.126:35009)
0808 15:49:43.072749 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:43.072753 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:43.073822 (+ 1069us) server_negotiation.cc:407] Connection header received
0808 15:49:43.074843 (+ 1021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:43.074846 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:43.074890 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:43.074956 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:43.076187 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.077009 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.078671 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.079050 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.079162 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:43.082308 (+ 3146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:43.082311 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:43.082313 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:43.082338 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:43.084239 (+ 1901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:43.084831 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:43.084835 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:43.084839 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:43.084943 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:43.085307 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:43.085311 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:43.085312 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:43.085544 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:43.085642 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:43.086165 (+ 523us) server_negotiation.cc:299] Negotiation successful
0808 15:49:43.086273 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 15:49:43.087317 24819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:43.072939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.66:50001)
0808 15:49:43.073649 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:43.073711 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:43.074606 (+ 895us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:43.075147 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:43.075155 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:43.075559 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:43.076044 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:43.076058 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.077143 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.077149 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:43.078538 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:43.078549 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.079235 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.079242 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:43.079476 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:43.080139 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:43.080165 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:43.082124 (+ 1959us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:43.084358 (+ 2234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:43.084363 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:43.084391 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:43.084722 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:43.085053 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:43.085056 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:43.085058 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:43.085203 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:43.085650 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:43.085654 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:43.085940 (+ 286us) client_negotiation.cc:769] Sending connection context
0808 15:49:43.086101 (+ 161us) client_negotiation.cc:240] Negotiation successful
0808 15:49:43.086358 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":115,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.67@KRBTEST.COM" created.
I20260808 15:49:43.088685 24817 heartbeater.cc:347] Connected to a master server at 127.8.39.126:35009
I20260808 15:49:43.088933 24817 heartbeater.cc:464] Registering TS with master...
I20260808 15:49:43.089470 24817 heartbeater.cc:511] Master 127.8.39.126:35009 requested a full tablet report, sending...
I20260808 15:49:43.090600 24482 ts_manager.cc:194] Registered new tserver with Master: e46deffb10e14cd7b30dcd1a4291e836 (127.8.39.66:33605)
I20260808 15:49:43.091228 24482 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.66@KRBTEST.COM'} at 127.8.39.66:50001
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
I20260808 15:49:43.106622 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:0
--local_ip_for_outbound_sockets=127.8.39.67
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:35009
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:36349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:49:43.220988 24823 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:49:43.221325 24823 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:49:43.221408 24823 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:49:43.225411 24823 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:49:43.225502 24823 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:49:43.225600 24823 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:49:43.230901 24823 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:36349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:35009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24823
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:49:43.232030 24823 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:49:43.233043 24823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 15:49:43.243074 24823 server_base.cc:1034] running on GCE node
W20260808 15:49:43.243048 24828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:43.243021 24829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:49:43.243022 24831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:49:43.243719 24823 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:49:43.244345 24823 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:49:43.245520 24823 hybrid_clock.cc:648] HybridClock initialized: now 1786204183245487 us; error 44 us; skew 500 ppm
Aug 08 15:49:43 dist-test-slave-8tdl krb5kdc[24435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204183, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:49:43.248224 24823 init.cc:377] Logged in from keytab as kudu/127.8.39.67@KRBTEST.COM (short username kudu)
I20260808 15:49:43.249155 24823 webserver.cc:460] Webserver started at http://127.8.39.67:43203/ using document root <none> and password file <none>
I20260808 15:49:43.249729 24823 fs_manager.cc:359] Metadata directory not provided
I20260808 15:49:43.249821 24823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:49:43.250054 24823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:49:43.252244 24823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/data/instance:
uuid: "04bb6523a01742b0b084067990825339"
format_stamp: "Formatted at 2026-08-08 15:49:43 on dist-test-slave-8tdl"
server_key: "018d0e4306e6e0fc7dbb40b249c10e0d"
server_key_iv: "0414e5e411d22652ca8527fb5050e3ec"
server_key_version: "encryptionkey@0"
I20260808 15:49:43.252807 24823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance:
uuid: "04bb6523a01742b0b084067990825339"
format_stamp: "Formatted at 2026-08-08 15:49:43 on dist-test-slave-8tdl"
server_key: "018d0e4306e6e0fc7dbb40b249c10e0d"
server_key_iv: "0414e5e411d22652ca8527fb5050e3ec"
server_key_version: "encryptionkey@0"
I20260808 15:49:43.256781 24823 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 15:49:43.259682 24838 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:43.260953 24823 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:49:43.261143 24823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "04bb6523a01742b0b084067990825339"
format_stamp: "Formatted at 2026-08-08 15:49:43 on dist-test-slave-8tdl"
server_key: "018d0e4306e6e0fc7dbb40b249c10e0d"
server_key_iv: "0414e5e411d22652ca8527fb5050e3ec"
server_key_version: "encryptionkey@0"
I20260808 15:49:43.261269 24823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:49:43.289072 24823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:49:43.292469 24823 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:49:43.292691 24823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:49:43.293313 24823 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:49:43.294205 24823 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:49:43.294255 24823 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:43.294322 24823 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:49:43.294358 24823 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:49:43.303442 24823 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:37889
I20260808 15:49:43.303532 24952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:37889 every 8 connection(s)
I20260808 15:49:43.304435 24823 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
Aug 08 15:49:43 dist-test-slave-8tdl krb5kdc[24435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204183, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:49:43.314620 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 24823
I20260808 15:49:43.314771 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance
I20260808 15:49:43.315202 8349 external_mini_cluster.cc:1428] Setting key 2ba724692ccccad657916a9863eb2427
I20260808 15:49:43.318673 24521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:43.306614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:37095 (local address 127.8.39.126:35009)
0808 15:49:43.306794 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:43.306799 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:43.307875 (+ 1076us) server_negotiation.cc:407] Connection header received
0808 15:49:43.308745 (+ 870us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:43.308748 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:43.308794 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:43.308869 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:43.310109 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.310819 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.311941 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.312152 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.312226 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:43.314804 (+ 2578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:43.314809 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:43.314811 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:43.314851 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:43.316595 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:43.317103 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:43.317108 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:43.317110 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:43.317197 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:43.317580 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:43.317585 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:43.317587 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:43.317784 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:43.317889 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:43.318380 (+ 491us) server_negotiation.cc:299] Negotiation successful
0808 15:49:43.318498 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 15:49:43.319509 24955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:43.307050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.67:37095)
0808 15:49:43.307697 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:43.307769 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:43.308569 (+ 800us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:43.309023 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:43.309032 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:43.309509 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:49:43.309980 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:43.309993 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.310935 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.310938 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:43.311826 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:43.311835 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.312272 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.312275 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:43.312405 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:43.313028 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:49:43.313044 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:49:43.314604 (+ 1560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:49:43.316709 (+ 2105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:43.316715 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:43.316729 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:43.316988 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:43.317288 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:49:43.317292 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:49:43.317294 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:49:43.317483 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:49:43.317889 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:49:43.317897 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:49:43.318146 (+ 249us) client_negotiation.cc:769] Sending connection context
0808 15:49:43.318334 (+ 188us) client_negotiation.cc:240] Negotiation successful
0808 15:49:43.318658 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":117,"threads_started":1}
I20260808 15:49:43.320544 24953 heartbeater.cc:347] Connected to a master server at 127.8.39.126:35009
I20260808 15:49:43.320784 24953 heartbeater.cc:464] Registering TS with master...
I20260808 15:49:43.321290 24953 heartbeater.cc:511] Master 127.8.39.126:35009 requested a full tablet report, sending...
I20260808 15:49:43.322276 24482 ts_manager.cc:194] Registered new tserver with Master: 04bb6523a01742b0b084067990825339 (127.8.39.67:37889)
I20260808 15:49:43.322924 24482 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.67@KRBTEST.COM'} at 127.8.39.67:37095
I20260808 15:49:43.329169 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:49:43.339215 24521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:43.331209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44126 (local address 127.8.39.126:35009)
0808 15:49:43.331325 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:43.331329 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:43.331562 (+ 233us) server_negotiation.cc:407] Connection header received
0808 15:49:43.331664 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:43.331666 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:43.331705 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:43.331774 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:49:43.332439 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.332946 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.333767 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.333968 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.334051 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:43.335904 (+ 1853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:49:43.335910 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:49:43.335912 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:49:43.335944 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:49:43.337440 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:43.337862 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:43.337865 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:43.337866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:43.337941 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:49:43.338275 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:49:43.338277 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:49:43.338278 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:49:43.338497 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:49:43.338600 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:43.338915 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 15:49:43.339036 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 15:49:43.342053 24482 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44126:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:49:43.345438 24482 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:49:43.359642 24964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:43.353827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:37077 (local address 127.0.0.1:46384)
0808 15:49:43.354202 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:43.354256 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:43.354388 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:43.355255 (+ 867us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:43.355261 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:43.355287 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:49:43.355436 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:43.355445 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.356580 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.356583 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:43.357928 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:43.357939 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.359090 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.359094 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:43.359204 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:43.359242 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 15:49:43.359356 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 15:49:43.359482 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":86,"threads_started":1}
I20260808 15:49:43.359683 24965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:43.353986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46384 (local address 127.8.39.65:37077)
0808 15:49:43.354702 (+ 716us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:43.354723 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:43.354746 (+ 23us) server_negotiation.cc:407] Connection header received
0808 15:49:43.354836 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:43.354844 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:43.355065 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:43.355588 (+ 523us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:49:43.355696 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.356462 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.358074 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.358959 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.359079 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:43.359238 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:43.359405 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 15:49:43.359524 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":578,"thread_start_us":114,"threads_started":1}
I20260808 15:49:43.360095 24966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:43.354091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:37889 (local address 127.0.0.1:34512)
0808 15:49:43.355293 (+ 1202us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:43.355307 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:43.355405 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:43.355810 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:43.355813 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:43.355832 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:49:43.355950 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:43.355959 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.357262 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.357265 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:43.358384 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:43.358394 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.359683 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.359687 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:43.359785 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:43.359808 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 15:49:43.359885 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 15:49:43.359966 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1133,"thread_start_us":111,"threads_started":1}
I20260808 15:49:43.360492 24968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:43.354654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34512 (local address 127.8.39.67:37889)
0808 15:49:43.355219 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:43.355231 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:43.355414 (+ 183us) server_negotiation.cc:407] Connection header received
0808 15:49:43.355503 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:43.355514 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:43.355642 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:43.355821 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:49:43.356074 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.357101 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.358521 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.359389 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.359490 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:43.359614 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:43.360267 (+ 653us) server_negotiation.cc:299] Negotiation successful
0808 15:49:43.360360 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":169,"threads_started":1}
I20260808 15:49:43.361204 24967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:43.354579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:33605 (local address 127.0.0.1:33794)
0808 15:49:43.356653 (+ 2074us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:43.356664 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:43.356765 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:43.357143 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:43.357146 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:43.357164 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:49:43.357253 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:43.357259 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.358465 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.358468 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:43.359415 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:43.359424 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.360825 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.360829 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:43.360931 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:43.360957 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 15:49:43.361020 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 15:49:43.361084 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2023,"thread_start_us":120,"threads_started":1}
I20260808 15:49:43.361781 24969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:43.354765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33794 (local address 127.8.39.66:33605)
0808 15:49:43.355403 (+ 638us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:43.355415 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:43.356750 (+ 1335us) server_negotiation.cc:407] Connection header received
0808 15:49:43.356878 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:43.356882 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:43.357011 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:43.357160 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:49:43.357343 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.358334 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.359556 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.360378 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.360487 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:43.361478 (+ 991us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:43.361538 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 15:49:43.361636 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":121,"threads_started":1}
I20260808 15:49:43.363175 24610 tablet_service.cc:1467] Processing CreateTablet for tablet 53fa8b0c0fba4226b70869e96ef0c822 (DEFAULT_TABLE table=test-table [id=4aeb4b0c6fb646e4a9b5189933361705]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:49:43.363230 24886 tablet_service.cc:1467] Processing CreateTablet for tablet 53fa8b0c0fba4226b70869e96ef0c822 (DEFAULT_TABLE table=test-table [id=4aeb4b0c6fb646e4a9b5189933361705]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:49:43.364202 24610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53fa8b0c0fba4226b70869e96ef0c822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:49:43.364280 24886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53fa8b0c0fba4226b70869e96ef0c822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:49:43.364513 24749 tablet_service.cc:1467] Processing CreateTablet for tablet 53fa8b0c0fba4226b70869e96ef0c822 (DEFAULT_TABLE table=test-table [id=4aeb4b0c6fb646e4a9b5189933361705]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:49:43.365518 24749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53fa8b0c0fba4226b70869e96ef0c822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:49:43.370633 24970 tablet_bootstrap.cc:492] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585: Bootstrap starting.
I20260808 15:49:43.372077 24971 tablet_bootstrap.cc:492] T 53fa8b0c0fba4226b70869e96ef0c822 P 04bb6523a01742b0b084067990825339: Bootstrap starting.
I20260808 15:49:43.372434 24972 tablet_bootstrap.cc:492] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836: Bootstrap starting.
I20260808 15:49:43.373319 24970 tablet_bootstrap.cc:654] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585: Neither blocks nor log segments found. Creating new log.
I20260808 15:49:43.374213 24970 log.cc:824] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585: Log is configured to *not* fsync() on all Append() calls
I20260808 15:49:43.374354 24971 tablet_bootstrap.cc:654] T 53fa8b0c0fba4226b70869e96ef0c822 P 04bb6523a01742b0b084067990825339: Neither blocks nor log segments found. Creating new log.
I20260808 15:49:43.374646 24972 tablet_bootstrap.cc:654] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836: Neither blocks nor log segments found. Creating new log.
I20260808 15:49:43.375617 24972 log.cc:824] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836: Log is configured to *not* fsync() on all Append() calls
I20260808 15:49:43.375617 24971 log.cc:824] T 53fa8b0c0fba4226b70869e96ef0c822 P 04bb6523a01742b0b084067990825339: Log is configured to *not* fsync() on all Append() calls
I20260808 15:49:43.376570 24970 tablet_bootstrap.cc:492] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585: No bootstrap required, opened a new log
I20260808 15:49:43.376780 24970 ts_tablet_manager.cc:1397] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 15:49:43.377329 24971 tablet_bootstrap.cc:492] T 53fa8b0c0fba4226b70869e96ef0c822 P 04bb6523a01742b0b084067990825339: No bootstrap required, opened a new log
I20260808 15:49:43.377514 24971 ts_tablet_manager.cc:1397] T 53fa8b0c0fba4226b70869e96ef0c822 P 04bb6523a01742b0b084067990825339: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 15:49:43.377585 24972 tablet_bootstrap.cc:492] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836: No bootstrap required, opened a new log
I20260808 15:49:43.377764 24972 ts_tablet_manager.cc:1397] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 15:49:43.380419 24971 raft_consensus.cc:348] T 53fa8b0c0fba4226b70869e96ef0c822 P 04bb6523a01742b0b084067990825339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } }
I20260808 15:49:43.380684 24971 raft_consensus.cc:374] T 53fa8b0c0fba4226b70869e96ef0c822 P 04bb6523a01742b0b084067990825339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:49:43.380759 24971 raft_consensus.cc:729] T 53fa8b0c0fba4226b70869e96ef0c822 P 04bb6523a01742b0b084067990825339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04bb6523a01742b0b084067990825339, State: Initialized, Role: FOLLOWER
I20260808 15:49:43.381251 24971 consensus_queue.cc:260] T 53fa8b0c0fba4226b70869e96ef0c822 P 04bb6523a01742b0b084067990825339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } }
I20260808 15:49:43.381489 24970 raft_consensus.cc:348] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } }
I20260808 15:49:43.381559 24972 raft_consensus.cc:348] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } }
I20260808 15:49:43.381784 24972 raft_consensus.cc:374] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:49:43.381829 24970 raft_consensus.cc:374] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:49:43.381891 24972 raft_consensus.cc:729] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46deffb10e14cd7b30dcd1a4291e836, State: Initialized, Role: FOLLOWER
I20260808 15:49:43.381930 24970 raft_consensus.cc:729] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb58936031334fd9b040449fef479585, State: Initialized, Role: FOLLOWER
I20260808 15:49:43.382314 24971 ts_tablet_manager.cc:1428] T 53fa8b0c0fba4226b70869e96ef0c822 P 04bb6523a01742b0b084067990825339: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 15:49:43.382468 24972 consensus_queue.cc:260] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } }
I20260808 15:49:43.382472 24970 consensus_queue.cc:260] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } }
I20260808 15:49:43.383167 24953 heartbeater.cc:503] Master 127.8.39.126:35009 was elected leader, sending a full tablet report...
I20260808 15:49:43.383464 24970 ts_tablet_manager.cc:1428] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585: Time spent starting tablet: real 0.007s user 0.005s sys 0.003s
I20260808 15:49:43.383520 24972 ts_tablet_manager.cc:1428] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 15:49:43.383844 24817 heartbeater.cc:503] Master 127.8.39.126:35009 was elected leader, sending a full tablet report...
I20260808 15:49:43.383857 24679 heartbeater.cc:503] Master 127.8.39.126:35009 was elected leader, sending a full tablet report...
W20260808 15:49:43.555459 24954 tablet.cc:2369] T 53fa8b0c0fba4226b70869e96ef0c822 P 04bb6523a01742b0b084067990825339: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:49:43.559093 24979 raft_consensus.cc:482] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:49:43.559357 24979 raft_consensus.cc:504] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } }
I20260808 15:49:43.560680 24979 leader_election.cc:288] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb58936031334fd9b040449fef479585 (127.8.39.65:37077), 04bb6523a01742b0b084067990825339 (127.8.39.67:37889)
I20260808 15:49:43.565500 24968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:43.561527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:56935 (local address 127.8.39.67:37889)
0808 15:49:43.561652 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:43.561657 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:43.561671 (+ 14us) server_negotiation.cc:407] Connection header received
0808 15:49:43.561722 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:43.561725 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:43.561788 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:43.561881 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:49:43.562193 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.563009 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.564150 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.564862 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.564984 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:43.565057 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:43.565266 (+ 209us) server_negotiation.cc:299] Negotiation successful
0808 15:49:43.565370 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 15:49:43.565653 24819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:43.560909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:37077 (local address 127.8.39.66:42861)
0808 15:49:43.561129 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:43.561147 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:43.561253 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:43.561645 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:43.561649 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:43.561670 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:49:43.561804 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:43.561815 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.562971 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.562975 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:43.564147 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:43.564158 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.565176 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.565180 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:43.565316 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:43.565334 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 15:49:43.565433 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 15:49:43.565519 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133}
I20260808 15:49:43.565676 24965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:43.561115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:42861 (local address 127.8.39.65:37077)
0808 15:49:43.561352 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:43.561357 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:43.561374 (+ 17us) server_negotiation.cc:407] Connection header received
0808 15:49:43.561430 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:43.561433 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:43.561484 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:43.561578 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:49:43.561955 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.562855 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.564281 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.565051 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.565164 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:43.565229 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:43.565482 (+ 253us) server_negotiation.cc:299] Negotiation successful
0808 15:49:43.565562 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148}
I20260808 15:49:43.565965 24980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:43.560944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:37889 (local address 127.8.39.66:56935)
0808 15:49:43.561351 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:43.561369 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 15:49:43.561469 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:49:43.561907 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:49:43.561910 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:49:43.561930 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:49:43.562062 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:43.562068 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.563119 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.563124 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:43.564017 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:49:43.564027 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.565003 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.565007 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:49:43.565111 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:43.565139 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 15:49:43.565700 (+ 561us) client_negotiation.cc:240] Negotiation successful
0808 15:49:43.565779 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":110,"threads_started":1}
I20260808 15:49:43.566464 24632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53fa8b0c0fba4226b70869e96ef0c822" candidate_uuid: "e46deffb10e14cd7b30dcd1a4291e836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb58936031334fd9b040449fef479585" is_pre_election: true
I20260808 15:49:43.566581 24907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53fa8b0c0fba4226b70869e96ef0c822" candidate_uuid: "e46deffb10e14cd7b30dcd1a4291e836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04bb6523a01742b0b084067990825339" is_pre_election: true
I20260808 15:49:43.566835 24632 raft_consensus.cc:2454] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46deffb10e14cd7b30dcd1a4291e836 in term 0.
I20260808 15:49:43.566862 24907 raft_consensus.cc:2454] T 53fa8b0c0fba4226b70869e96ef0c822 P 04bb6523a01742b0b084067990825339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46deffb10e14cd7b30dcd1a4291e836 in term 0.
I20260808 15:49:43.567349 24704 leader_election.cc:302] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04bb6523a01742b0b084067990825339, e46deffb10e14cd7b30dcd1a4291e836; no voters:
I20260808 15:49:43.567694 24979 raft_consensus.cc:2781] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:49:43.567790 24979 raft_consensus.cc:482] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:49:43.567830 24979 raft_consensus.cc:3037] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:49:43.569103 24979 raft_consensus.cc:504] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } }
I20260808 15:49:43.569492 24979 leader_election.cc:288] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836 [CANDIDATE]: Term 1 election: Requested vote from peers eb58936031334fd9b040449fef479585 (127.8.39.65:37077), 04bb6523a01742b0b084067990825339 (127.8.39.67:37889)
I20260808 15:49:43.569851 24632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53fa8b0c0fba4226b70869e96ef0c822" candidate_uuid: "e46deffb10e14cd7b30dcd1a4291e836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb58936031334fd9b040449fef479585"
I20260808 15:49:43.569852 24907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53fa8b0c0fba4226b70869e96ef0c822" candidate_uuid: "e46deffb10e14cd7b30dcd1a4291e836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04bb6523a01742b0b084067990825339"
I20260808 15:49:43.569986 24632 raft_consensus.cc:3037] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:49:43.570025 24907 raft_consensus.cc:3037] T 53fa8b0c0fba4226b70869e96ef0c822 P 04bb6523a01742b0b084067990825339 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:49:43.571102 24632 raft_consensus.cc:2454] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46deffb10e14cd7b30dcd1a4291e836 in term 1.
I20260808 15:49:43.571201 24907 raft_consensus.cc:2454] T 53fa8b0c0fba4226b70869e96ef0c822 P 04bb6523a01742b0b084067990825339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46deffb10e14cd7b30dcd1a4291e836 in term 1.
I20260808 15:49:43.571434 24701 leader_election.cc:302] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e46deffb10e14cd7b30dcd1a4291e836, eb58936031334fd9b040449fef479585; no voters:
I20260808 15:49:43.571645 24979 raft_consensus.cc:2781] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:49:43.571880 24979 raft_consensus.cc:686] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836 [term 1 LEADER]: Becoming Leader. State: Replica: e46deffb10e14cd7b30dcd1a4291e836, State: Running, Role: LEADER
W20260808 15:49:43.571929 24818 tablet.cc:2369] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:49:43.572221 24979 consensus_queue.cc:237] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } }
I20260808 15:49:43.575649 24482 catalog_manager.cc:5495] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836 reported cstate change: term changed from 0 to 1, leader changed from <none> to e46deffb10e14cd7b30dcd1a4291e836 (127.8.39.66). New cstate: current_term: 1 leader_uuid: "e46deffb10e14cd7b30dcd1a4291e836" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } health_report { overall_health: UNKNOWN } } }
W20260808 15:49:43.589934 24680 tablet.cc:2369] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:49:43.596277 24969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:43.592624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33804 (local address 127.8.39.66:33605)
0808 15:49:43.592790 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 15:49:43.592796 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:49:43.592815 (+ 19us) server_negotiation.cc:407] Connection header received
0808 15:49:43.592891 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:49:43.592893 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:49:43.592953 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:49:43.593070 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:49:43.593345 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.593845 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.594740 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:49:43.594974 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:49:43.595087 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:49:43.595398 (+ 311us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:49:43.595840 (+ 442us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:49:43.595976 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 15:49:43.596043 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 15:49:43.596103 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 15:49:43.602908 24907 raft_consensus.cc:1261] T 53fa8b0c0fba4226b70869e96ef0c822 P 04bb6523a01742b0b084067990825339 [term 1 FOLLOWER]: Refusing update from remote peer e46deffb10e14cd7b30dcd1a4291e836: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:49:43.602972 24632 raft_consensus.cc:1261] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585 [term 1 FOLLOWER]: Refusing update from remote peer e46deffb10e14cd7b30dcd1a4291e836: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:49:43.603798 24979 consensus_queue.cc:1035] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:49:43.604024 24981 consensus_queue.cc:1035] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:49:43.613086 24987 mvcc.cc:205] Tried to move back new op lower bound from 7316292336028336128 to 7316292335915667456. Current Snapshot: MvccSnapshot[applied={T|T < 7316292336028336128}]
I20260808 15:49:43.619930 24482 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44126:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:49:43.620144 24482 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44126:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:49:43.622786 24482 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876: Sending DeleteTablet for 3 replicas of tablet 53fa8b0c0fba4226b70869e96ef0c822
I20260808 15:49:43.623694 24749 tablet_service.cc:1514] Processing DeleteTablet for tablet 53fa8b0c0fba4226b70869e96ef0c822 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:49:43 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:33794
I20260808 15:49:43.623772 24610 tablet_service.cc:1514] Processing DeleteTablet for tablet 53fa8b0c0fba4226b70869e96ef0c822 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:49:43 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:46384
I20260808 15:49:43.623740 24886 tablet_service.cc:1514] Processing DeleteTablet for tablet 53fa8b0c0fba4226b70869e96ef0c822 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:49:43 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:34512
I20260808 15:49:43.624254 24997 tablet_replica.cc:330] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585: stopping tablet replica
I20260808 15:49:43.624490 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 24545
I20260808 15:49:43.625630 24998 tablet_replica.cc:330] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836: stopping tablet replica
I20260808 15:49:43.624537 24999 tablet_replica.cc:330] T 53fa8b0c0fba4226b70869e96ef0c822 P 04bb6523a01742b0b084067990825339: stopping tablet replica
I20260808 15:49:43.625958 24998 raft_consensus.cc:2229] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:49:43.626137 24999 raft_consensus.cc:2229] T 53fa8b0c0fba4226b70869e96ef0c822 P 04bb6523a01742b0b084067990825339 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:49:43.626362 24998 raft_consensus.cc:2258] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:49:43.626472 24999 raft_consensus.cc:2258] T 53fa8b0c0fba4226b70869e96ef0c822 P 04bb6523a01742b0b084067990825339 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:49:43.628188 24998 ts_tablet_manager.cc:1905] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:49:43.628345 24999 ts_tablet_manager.cc:1905] T 53fa8b0c0fba4226b70869e96ef0c822 P 04bb6523a01742b0b084067990825339: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:49:43.631353 24999 ts_tablet_manager.cc:1918] T 53fa8b0c0fba4226b70869e96ef0c822 P 04bb6523a01742b0b084067990825339: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:49:43.631358 24998 ts_tablet_manager.cc:1918] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:49:43.631456 24998 log.cc:1196] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/wal/wals/53fa8b0c0fba4226b70869e96ef0c822
I20260808 15:49:43.631456 24999 log.cc:1196] T 53fa8b0c0fba4226b70869e96ef0c822 P 04bb6523a01742b0b084067990825339: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/53fa8b0c0fba4226b70869e96ef0c822
I20260808 15:49:43.631822 24998 ts_tablet_manager.cc:1939] T 53fa8b0c0fba4226b70869e96ef0c822 P e46deffb10e14cd7b30dcd1a4291e836: Deleting consensus metadata
I20260808 15:49:43.631822 24999 ts_tablet_manager.cc:1939] T 53fa8b0c0fba4226b70869e96ef0c822 P 04bb6523a01742b0b084067990825339: Deleting consensus metadata
I20260808 15:49:43.633459 24465 catalog_manager.cc:4841] TS e46deffb10e14cd7b30dcd1a4291e836 (127.8.39.66:33605): tablet 53fa8b0c0fba4226b70869e96ef0c822 (table test-table [id=4aeb4b0c6fb646e4a9b5189933361705]) successfully deleted
I20260808 15:49:43.636142 24468 catalog_manager.cc:4841] TS 04bb6523a01742b0b084067990825339 (127.8.39.67:37889): tablet 53fa8b0c0fba4226b70869e96ef0c822 (table test-table [id=4aeb4b0c6fb646e4a9b5189933361705]) successfully deleted
W20260808 15:49:43.638993 24465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.39.65:37077 (error 108)
I20260808 15:49:43.640046 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 24684
I20260808 15:49:43.640252 24967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:49:43.639834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:37077 (local address 127.0.0.1:46394)
0808 15:49:43.640039 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 15:49:43.640133 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.65:37077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
W20260808 15:49:43.643555 24465 catalog_manager.cc:4584] TS eb58936031334fd9b040449fef479585 (127.8.39.65:37077): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 53fa8b0c0fba4226b70869e96ef0c822: Network error: Client connection negotiation failed: client connection to 127.8.39.65:37077: connect: Connection refused (error 111)
I20260808 15:49:43.648960 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 24823
I20260808 15:49:43.656119 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 24449
I20260808 15:50:03.664602 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:35009
--webserver_interface=127.8.39.126
--webserver_port=45241
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:36349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:35009
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:50:03.789150 25001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:03.789469 25001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:03.789516 25001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:03.794063 25001 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 15:50:03.794149 25001 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 15:50:03.794167 25001 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 15:50:03.794183 25001 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:50:03.794205 25001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:03.794224 25001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:03.794240 25001 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:50:03.794256 25001 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:50:03.800431 25001 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:36349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:35009
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:35009
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=45241
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:03.801918 25001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:03.803138 25001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 15:50:03.817960 25001 server_base.cc:1034] running on GCE node
W20260808 15:50:03.817902 25008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:03.817902 25007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:03.818208 25010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:03.818925 25001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:03.820118 25001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:03.821276 25001 hybrid_clock.cc:648] HybridClock initialized: now 1786204203821262 us; error 27 us; skew 500 ppm
Aug 08 15:50:03 dist-test-slave-8tdl krb5kdc[24435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204203, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:50:03.824483 25001 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:50:03.825517 25001 webserver.cc:460] Webserver started at http://127.8.39.126:45241/ using document root <none> and password file <none>
I20260808 15:50:03.826139 25001 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:03.826221 25001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:03.830449 25001 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:50:03.832845 25017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:03.834151 25001 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:50:03.834299 25001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "62e49714697a4cd5bf989ce17528b876"
format_stamp: "Formatted at 2026-08-08 15:49:42 on dist-test-slave-8tdl"
server_key: "2bc7525930dfed8cf39c39ec2dc6f446"
server_key_iv: "b55b03d8b2d124430b78eab5bc449e10"
server_key_version: "encryptionkey@0"
I20260808 15:50:03.834998 25001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:03.849509 25001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:03.852905 25001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:03.853166 25001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:03.860622 25001 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:35009
I20260808 15:50:03.860917 25070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:35009 every 8 connection(s)
I20260808 15:50:03.861807 25001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:50:03.863456 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 25001
I20260808 15:50:03.863996 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:37077
--local_ip_for_outbound_sockets=127.8.39.65
--tserver_master_addrs=127.8.39.126:35009
--webserver_port=39991
--webserver_interface=127.8.39.65
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:36349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:50:03.867393 25071 sys_catalog.cc:263] Verifying existing consensus state
I20260808 15:50:03.869194 25071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876: Bootstrap starting.
I20260808 15:50:03.887987 25071 log.cc:824] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:03.897238 25071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 15:50:03.897677 25071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876: Bootstrap complete.
I20260808 15:50:03.902062 25071 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e49714697a4cd5bf989ce17528b876" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 35009 } }
I20260808 15:50:03.902459 25071 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62e49714697a4cd5bf989ce17528b876, State: Initialized, Role: FOLLOWER
I20260808 15:50:03.903036 25071 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e49714697a4cd5bf989ce17528b876" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 35009 } }
I20260808 15:50:03.903167 25071 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:50:03.903275 25071 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:50:03.903388 25071 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [term 1 FOLLOWER]: Advancing to term 2
I20260808 15:50:03.905375 25071 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e49714697a4cd5bf989ce17528b876" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 35009 } }
I20260808 15:50:03.905725 25071 leader_election.cc:302] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62e49714697a4cd5bf989ce17528b876; no voters:
I20260808 15:50:03.906116 25071 leader_election.cc:288] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 15:50:03.906209 25075 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 15:50:03.906391 25075 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [term 2 LEADER]: Becoming Leader. State: Replica: 62e49714697a4cd5bf989ce17528b876, State: Running, Role: LEADER
I20260808 15:50:03.906787 25075 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e49714697a4cd5bf989ce17528b876" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 35009 } }
I20260808 15:50:03.907452 25071 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:50:03.907804 25077 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62e49714697a4cd5bf989ce17528b876. Latest consensus state: current_term: 2 leader_uuid: "62e49714697a4cd5bf989ce17528b876" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e49714697a4cd5bf989ce17528b876" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 35009 } } }
I20260808 15:50:03.907928 25077 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [sys.catalog]: This master's current role is: LEADER
I20260808 15:50:03.908633 25076 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "62e49714697a4cd5bf989ce17528b876" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e49714697a4cd5bf989ce17528b876" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 35009 } } }
I20260808 15:50:03.908748 25076 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [sys.catalog]: This master's current role is: LEADER
I20260808 15:50:03.909554 25079 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:50:03.913705 25079 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:50:03.914269 25079 catalog_manager.cc:1259] Loaded cluster ID: 0ad9734588e045c38a1c6ff17dd60f3c
I20260808 15:50:03.914352 25079 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:50:03.916249 25079 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:50:03.916847 25079 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876: Loaded TSK: 0
I20260808 15:50:03.930472 25079 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876: Generated new TSK 1
I20260808 15:50:03.930826 25079 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 15:50:03.998663 25073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:03.999003 25073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:03.999099 25073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:04.003765 25073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:04.003841 25073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:04.003944 25073 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:50:04.010460 25073 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:36349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:37077
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=39991
--tserver_master_addrs=127.8.39.126:35009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25073
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:04.011637 25073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:04.012753 25073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:04.024195 25098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:04.024230 25099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:04.024235 25101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:04.024914 25073 server_base.cc:1034] running on GCE node
I20260808 15:50:04.025427 25073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:04.026275 25073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:04.027482 25073 hybrid_clock.cc:648] HybridClock initialized: now 1786204204027436 us; error 54 us; skew 500 ppm
Aug 08 15:50:04 dist-test-slave-8tdl krb5kdc[24435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204204, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:50:04.031064 25073 init.cc:377] Logged in from keytab as kudu/127.8.39.65@KRBTEST.COM (short username kudu)
I20260808 15:50:04.032150 25073 webserver.cc:460] Webserver started at http://127.8.39.65:39991/ using document root <none> and password file <none>
I20260808 15:50:04.032768 25073 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:04.032887 25073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:04.037052 25073 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:50:04.039652 25109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:04.041019 25073 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:50:04.041163 25073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "eb58936031334fd9b040449fef479585"
format_stamp: "Formatted at 2026-08-08 15:49:42 on dist-test-slave-8tdl"
server_key: "6717989036ca4db876521f1e99da4c1f"
server_key_iv: "0f08fceda3634dab85cd8a76afb32df1"
server_key_version: "encryptionkey@0"
I20260808 15:50:04.041862 25073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:04.073935 25073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:04.077378 25073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:04.077608 25073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:04.078241 25073 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:50:04.079370 25117 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 15:50:04.083511 25073 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 15:50:04.083612 25073 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260808 15:50:04.083719 25073 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 15:50:04.085466 25073 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 15:50:04.085541 25073 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260808 15:50:04.085809 25117 tablet_bootstrap.cc:492] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585: Bootstrap starting.
I20260808 15:50:04.096592 25073 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:37077
I20260808 15:50:04.096669 25227 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:37077 every 8 connection(s)
I20260808 15:50:04.097604 25073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:50:04.102895 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 25073
I20260808 15:50:04.103566 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:33605
--local_ip_for_outbound_sockets=127.8.39.66
--tserver_master_addrs=127.8.39.126:35009
--webserver_port=43147
--webserver_interface=127.8.39.66
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:36349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:50:04.105815 25117 log.cc:824] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585: Log is configured to *not* fsync() on all Append() calls
Aug 08 15:50:04 dist-test-slave-8tdl krb5kdc[24435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204204, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:50:04.113670 25117 tablet_bootstrap.cc:492] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 15:50:04.114130 25117 tablet_bootstrap.cc:492] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585: Bootstrap complete.
I20260808 15:50:04.115516 25117 ts_tablet_manager.cc:1397] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585: Time spent bootstrapping tablet: real 0.030s user 0.021s sys 0.007s
I20260808 15:50:04.117729 25230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:04.099852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:49333 (local address 127.8.39.126:35009)
0808 15:50:04.100221 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:04.100244 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:04.100630 (+ 386us) server_negotiation.cc:407] Connection header received
0808 15:50:04.101790 (+ 1160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:04.101801 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:04.102098 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:04.102426 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:04.103843 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.105130 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.107055 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.107755 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.107933 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:04.110986 (+ 3053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:04.110996 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:04.111015 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:04.111059 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:04.113547 (+ 2488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:04.114324 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:04.114333 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:04.114341 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:04.114528 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:04.115012 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:04.115019 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:04.115023 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:04.115572 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:04.115725 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:04.116548 (+ 823us) server_negotiation.cc:299] Negotiation successful
0808 15:50:04.116843 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":130,"threads_started":1}
I20260808 15:50:04.117843 25231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:04.099875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.65:49333)
0808 15:50:04.100448 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:04.100493 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:04.101341 (+ 848us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:04.102489 (+ 1148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:04.102497 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:04.102966 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:50:04.103502 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:04.103518 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.105305 (+ 1787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.105308 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:04.106900 (+ 1592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:04.106915 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.107906 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.107909 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:04.108081 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:04.108768 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:50:04.108794 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:50:04.110742 (+ 1948us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:50:04.113690 (+ 2948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:04.113697 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:04.113712 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:04.114143 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:04.114645 (+ 502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:04.114651 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:04.114656 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:04.114882 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:04.115794 (+ 912us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:50:04.115803 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:50:04.116159 (+ 356us) client_negotiation.cc:769] Sending connection context
0808 15:50:04.116385 (+ 226us) client_negotiation.cc:240] Negotiation successful
0808 15:50:04.116781 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":149,"threads_started":1}
I20260808 15:50:04.118325 25117 raft_consensus.cc:348] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } }
I20260808 15:50:04.118934 25117 raft_consensus.cc:729] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb58936031334fd9b040449fef479585, State: Initialized, Role: FOLLOWER
I20260808 15:50:04.119418 25117 consensus_queue.cc:260] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } }
I20260808 15:50:04.120440 25117 ts_tablet_manager.cc:1428] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 15:50:04.120870 25228 heartbeater.cc:347] Connected to a master server at 127.8.39.126:35009
I20260808 15:50:04.121129 25228 heartbeater.cc:464] Registering TS with master...
I20260808 15:50:04.121601 25228 heartbeater.cc:511] Master 127.8.39.126:35009 requested a full tablet report, sending...
I20260808 15:50:04.124120 25035 ts_manager.cc:194] Registered new tserver with Master: eb58936031334fd9b040449fef479585 (127.8.39.65:37077)
I20260808 15:50:04.128628 25035 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.65@KRBTEST.COM'} at 127.8.39.65:49333
I20260808 15:50:04.131559 25228 heartbeater.cc:503] Master 127.8.39.126:35009 was elected leader, sending a full tablet report...
Aug 08 15:50:04 dist-test-slave-8tdl krb5kdc[24435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204203, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for kudu/127.8.39.65@KRBTEST.COM
I20260808 15:50:04.137835 25235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:04.127546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:37077 (local address 127.0.0.1:53222)
0808 15:50:04.127941 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:04.127985 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:04.128110 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:04.128704 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:04.128710 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:04.129164 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:50:04.129281 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:04.129288 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.130403 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.130408 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:04.131156 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:04.131166 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.131784 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.131788 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:04.131904 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:04.132512 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:50:04.132527 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:50:04.134078 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:50:04.136207 (+ 2129us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:04.136216 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:04.136220 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:04.136445 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:04.136755 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:04.136758 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:04.136759 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:04.136833 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:04.137336 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:50:04.137340 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:50:04.137437 (+ 97us) client_negotiation.cc:769] Sending connection context
0808 15:50:04.137556 (+ 119us) client_negotiation.cc:240] Negotiation successful
0808 15:50:04.137706 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":132,"threads_started":1}
I20260808 15:50:04.137991 25236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:04.127613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53222 (local address 127.8.39.65:37077)
0808 15:50:04.128323 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:04.128332 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:04.128349 (+ 17us) server_negotiation.cc:407] Connection header received
0808 15:50:04.128402 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:04.128406 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:04.128555 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:04.128700 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:04.129457 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.130282 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.131281 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.131625 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.131754 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:04.134219 (+ 2465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:04.134230 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:04.134243 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:04.134271 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:04.136100 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:04.136558 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:04.136563 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:04.136565 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:04.136664 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:04.136918 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:04.136921 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:04.136923 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:04.137223 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:04.137347 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:04.137667 (+ 320us) server_negotiation.cc:299] Negotiation successful
0808 15:50:04.137835 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623,"thread_start_us":106,"threads_started":1}
I20260808 15:50:04.139123 25160 tablet_service.cc:1514] Processing DeleteTablet for tablet 53fa8b0c0fba4226b70869e96ef0c822 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:49:43 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:53222
I20260808 15:50:04.140201 25237 tablet_replica.cc:330] stopping tablet replica
I20260808 15:50:04.140504 25237 raft_consensus.cc:2229] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:50:04.140756 25237 raft_consensus.cc:2258] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:50:04.141738 25237 ts_tablet_manager.cc:1905] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:50:04.145431 25237 ts_tablet_manager.cc:1918] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:50:04.145548 25237 log.cc:1196] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/wal/wals/53fa8b0c0fba4226b70869e96ef0c822
I20260808 15:50:04.145843 25237 ts_tablet_manager.cc:1939] T 53fa8b0c0fba4226b70869e96ef0c822 P eb58936031334fd9b040449fef479585: Deleting consensus metadata
I20260808 15:50:04.147627 25018 catalog_manager.cc:4841] TS eb58936031334fd9b040449fef479585 (127.8.39.65:37077): tablet 53fa8b0c0fba4226b70869e96ef0c822 (table test-table [id=4aeb4b0c6fb646e4a9b5189933361705]) successfully deleted
W20260808 15:50:04.230036 25232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:04.230301 25232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:04.230381 25232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:04.234748 25232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:04.234841 25232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:04.234949 25232 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:50:04.240321 25232 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:36349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:33605
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=43147
--tserver_master_addrs=127.8.39.126:35009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25232
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:04.241508 25232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:04.242547 25232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:04.252832 25242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:04.252885 25232 server_base.cc:1034] running on GCE node
W20260808 15:50:04.252832 25243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:04.252832 25245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:04.253542 25232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:04.254235 25232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:04.255429 25232 hybrid_clock.cc:648] HybridClock initialized: now 1786204204255414 us; error 26 us; skew 500 ppm
Aug 08 15:50:04 dist-test-slave-8tdl krb5kdc[24435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204204, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:50:04.258249 25232 init.cc:377] Logged in from keytab as kudu/127.8.39.66@KRBTEST.COM (short username kudu)
I20260808 15:50:04.259244 25232 webserver.cc:460] Webserver started at http://127.8.39.66:43147/ using document root <none> and password file <none>
I20260808 15:50:04.259830 25232 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:04.259953 25232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:04.263964 25232 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260808 15:50:04.266098 25252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:04.267379 25232 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:50:04.267532 25232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "e46deffb10e14cd7b30dcd1a4291e836"
format_stamp: "Formatted at 2026-08-08 15:49:43 on dist-test-slave-8tdl"
server_key: "5229c09adda0f442ecceea88d0a15715"
server_key_iv: "0edd5aa80519ddc600965a534548c0f5"
server_key_version: "encryptionkey@0"
I20260808 15:50:04.268121 25232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:04.286931 25232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:04.290125 25232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:04.290346 25232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:04.291013 25232 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:50:04.291946 25232 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:50:04.292018 25232 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:04.292100 25232 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:50:04.292153 25232 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:04.301700 25232 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:33605
I20260808 15:50:04.301723 25370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:33605 every 8 connection(s)
I20260808 15:50:04.302734 25232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:50:04.303820 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 25232
I20260808 15:50:04.304360 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:37889
--local_ip_for_outbound_sockets=127.8.39.67
--tserver_master_addrs=127.8.39.126:35009
--webserver_port=43203
--webserver_interface=127.8.39.67
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:36349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 15:50:04 dist-test-slave-8tdl krb5kdc[24435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204204, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:50:04.318857 25230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:04.304676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:53887 (local address 127.8.39.126:35009)
0808 15:50:04.304804 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:04.304808 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:04.306002 (+ 1194us) server_negotiation.cc:407] Connection header received
0808 15:50:04.307340 (+ 1338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:04.307343 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:04.307394 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:04.307465 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:04.308868 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.309493 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.311455 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.312076 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.312176 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:04.315238 (+ 3062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:04.315241 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:04.315243 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:04.315271 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:04.316718 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:04.317255 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:04.317258 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:04.317259 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:04.317335 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:04.317701 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:04.317704 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:04.317705 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:04.317889 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:04.317999 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:04.318502 (+ 503us) server_negotiation.cc:299] Negotiation successful
0808 15:50:04.318644 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 15:50:04.319679 25373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:04.305143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.66:53887)
0808 15:50:04.305840 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:04.305880 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:04.307075 (+ 1195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:04.307718 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:04.307729 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:04.308213 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:50:04.308688 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:04.308701 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.309625 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.309632 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:04.311284 (+ 1652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:04.311298 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.312269 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.312276 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:04.312521 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:04.313230 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:50:04.313257 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:50:04.315044 (+ 1787us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:50:04.316843 (+ 1799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:04.316850 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:04.316865 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:04.317133 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:04.317438 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:04.317441 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:04.317443 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:04.317593 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:04.317997 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:50:04.318004 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:50:04.318254 (+ 250us) client_negotiation.cc:769] Sending connection context
0808 15:50:04.318442 (+ 188us) client_negotiation.cc:240] Negotiation successful
0808 15:50:04.318810 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":154,"threads_started":1}
I20260808 15:50:04.320972 25371 heartbeater.cc:347] Connected to a master server at 127.8.39.126:35009
I20260808 15:50:04.321249 25371 heartbeater.cc:464] Registering TS with master...
I20260808 15:50:04.321748 25371 heartbeater.cc:511] Master 127.8.39.126:35009 requested a full tablet report, sending...
I20260808 15:50:04.322870 25035 ts_manager.cc:194] Registered new tserver with Master: e46deffb10e14cd7b30dcd1a4291e836 (127.8.39.66:33605)
I20260808 15:50:04.323441 25035 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.66@KRBTEST.COM'} at 127.8.39.66:53887
W20260808 15:50:04.423750 25374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:04.424057 25374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:04.424162 25374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:04.428352 25374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:04.428435 25374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:04.428524 25374 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:50:04.434156 25374 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:36349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:37889
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=43203
--tserver_master_addrs=127.8.39.126:35009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:04.435396 25374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:04.436480 25374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:04.447042 25379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:04.447043 25380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:04.447036 25382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:04.447237 25374 server_base.cc:1034] running on GCE node
I20260808 15:50:04.447793 25374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:04.448578 25374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:04.449770 25374 hybrid_clock.cc:648] HybridClock initialized: now 1786204204449742 us; error 47 us; skew 500 ppm
Aug 08 15:50:04 dist-test-slave-8tdl krb5kdc[24435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204204, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:50:04.452689 25374 init.cc:377] Logged in from keytab as kudu/127.8.39.67@KRBTEST.COM (short username kudu)
I20260808 15:50:04.453648 25374 webserver.cc:460] Webserver started at http://127.8.39.67:43203/ using document root <none> and password file <none>
I20260808 15:50:04.454202 25374 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:04.454277 25374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:04.458253 25374 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:50:04.460474 25391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:04.461866 25374 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:50:04.462044 25374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "04bb6523a01742b0b084067990825339"
format_stamp: "Formatted at 2026-08-08 15:49:43 on dist-test-slave-8tdl"
server_key: "018d0e4306e6e0fc7dbb40b249c10e0d"
server_key_iv: "0414e5e411d22652ca8527fb5050e3ec"
server_key_version: "encryptionkey@0"
I20260808 15:50:04.462600 25374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:04.479317 25374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:04.482613 25374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:04.482892 25374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:04.483560 25374 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:50:04.484438 25374 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:50:04.484486 25374 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:04.484555 25374 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:50:04.484591 25374 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:04.494035 25374 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:37889
I20260808 15:50:04.494059 25511 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:37889 every 8 connection(s)
I20260808 15:50:04.495204 25374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:50:04.504122 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 25374
Aug 08 15:50:04 dist-test-slave-8tdl krb5kdc[24435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204204, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:50:04.509485 25230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:04.497157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:46603 (local address 127.8.39.126:35009)
0808 15:50:04.497315 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:04.497319 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:04.498358 (+ 1039us) server_negotiation.cc:407] Connection header received
0808 15:50:04.499305 (+ 947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:04.499308 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:04.499371 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:04.499457 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:04.500648 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.501188 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.502340 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.502615 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.502767 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:04.505511 (+ 2744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:04.505516 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:04.505521 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:04.505547 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:04.507208 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:04.507771 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:04.507775 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:04.507777 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:04.507865 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:04.508195 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:04.508199 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:04.508201 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:04.508417 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:04.508519 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:04.509189 (+ 670us) server_negotiation.cc:299] Negotiation successful
0808 15:50:04.509329 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 15:50:04.510413 25514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:04.497530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.67:46603)
0808 15:50:04.498197 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:04.498240 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:04.499085 (+ 845us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:04.499643 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:04.499650 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:04.500009 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:50:04.500495 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:04.500508 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.501323 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.501333 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:04.502208 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:04.502217 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.502804 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.502808 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:04.502989 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:04.503546 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:50:04.503561 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:50:04.505323 (+ 1762us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:50:04.507317 (+ 1994us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:04.507323 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:04.507356 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:04.507668 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:04.507959 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:04.507961 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:04.507962 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:04.508101 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:04.508520 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:50:04.508527 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:50:04.508880 (+ 353us) client_negotiation.cc:769] Sending connection context
0808 15:50:04.509105 (+ 225us) client_negotiation.cc:240] Negotiation successful
0808 15:50:04.509461 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":124,"threads_started":1}
I20260808 15:50:04.511684 25512 heartbeater.cc:347] Connected to a master server at 127.8.39.126:35009
I20260808 15:50:04.511981 25512 heartbeater.cc:464] Registering TS with master...
I20260808 15:50:04.512625 25512 heartbeater.cc:511] Master 127.8.39.126:35009 requested a full tablet report, sending...
I20260808 15:50:04.513914 25035 ts_manager.cc:194] Registered new tserver with Master: 04bb6523a01742b0b084067990825339 (127.8.39.67:37889)
I20260808 15:50:04.514348 25516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:04.505083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42152 (local address 127.8.39.126:35009)
0808 15:50:04.505365 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:04.505370 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:04.505388 (+ 18us) server_negotiation.cc:407] Connection header received
0808 15:50:04.505498 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:04.505500 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:04.505541 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:04.505613 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:04.506668 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.507320 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.508481 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.508846 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.508956 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:04.510723 (+ 1767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:04.510726 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:04.510729 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:04.510754 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:04.512422 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:04.512945 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:04.512948 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:04.512950 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:04.513044 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:04.513342 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:04.513344 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:04.513345 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:04.513592 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:04.513778 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:04.514020 (+ 242us) server_negotiation.cc:299] Negotiation successful
0808 15:50:04.514150 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":106,"threads_started":1}
I20260808 15:50:04.514674 25035 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.67@KRBTEST.COM'} at 127.8.39.67:46603
I20260808 15:50:04.516454 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:50:04.520291 25516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:04.517153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42166 (local address 127.8.39.126:35009)
0808 15:50:04.517275 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:04.517278 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:04.517506 (+ 228us) server_negotiation.cc:407] Connection header received
0808 15:50:04.517621 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:04.517623 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:04.517704 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:04.517783 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:50:04.517988 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.518461 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.519357 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.519591 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.519671 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:04.519898 (+ 227us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:50:04.520012 (+ 114us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 15:50:04.520203 (+ 191us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42166: token expired
Metrics: {"server-negotiator.queue_time_us":57}
W20260808 15:50:04.520376 25516 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42166: token expired
W20260808 15:50:04.520715 24959 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.8.39.126:35009)
I20260808 15:50:04.528173 25516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:04.521078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42176 (local address 127.8.39.126:35009)
0808 15:50:04.521191 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:04.521197 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:04.521249 (+ 52us) server_negotiation.cc:407] Connection header received
0808 15:50:04.521377 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:04.521380 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:04.521417 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:04.521505 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:04.522117 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.522594 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.523419 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.523651 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.523756 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:04.525025 (+ 1269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:04.525029 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:04.525032 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:04.525056 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:04.526422 (+ 1366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:04.526940 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:04.526944 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:04.526946 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:04.527036 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:04.527322 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:04.527326 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:04.527328 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:04.527508 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:04.527648 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:04.527895 (+ 247us) server_negotiation.cc:299] Negotiation successful
0808 15:50:04.528014 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 15:50:04.530759 25035 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42176:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:50:04.534067 25035 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:50:04.542343 25160 tablet_service.cc:1467] Processing CreateTablet for tablet 6bc23872c76d4ca082d9dc6c655f742a (DEFAULT_TABLE table=test-table [id=6b8938dab14e40a09e5fc15879ab7c4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:50:04.543076 25160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bc23872c76d4ca082d9dc6c655f742a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:04.545995 25117 tablet_bootstrap.cc:492] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585: Bootstrap starting.
I20260808 15:50:04.546906 25117 tablet_bootstrap.cc:654] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:04.547544 25235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:04.540982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:37889 (local address 127.0.0.1:49940)
0808 15:50:04.541114 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:04.541130 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:04.541211 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:04.542438 (+ 1227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:04.542441 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:04.542460 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:04.542601 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:04.542608 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.544173 (+ 1565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.544176 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:04.545701 (+ 1525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:04.545714 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.547079 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.547083 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:04.547177 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:04.547221 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 15:50:04.547278 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 15:50:04.547369 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":132}
I20260808 15:50:04.547849 25521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:04.541300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:33605 (local address 127.0.0.1:45864)
0808 15:50:04.541628 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:04.541642 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:04.541728 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:04.542422 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:04.542426 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:04.542443 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:04.542781 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:04.542788 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.544170 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.544173 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:04.546002 (+ 1829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:04.546011 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.547295 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.547298 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:04.547386 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:04.547405 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 15:50:04.547471 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 15:50:04.547530 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"mutex_wait_us":274,"spinlock_wait_cycles":2304,"thread_start_us":145,"threads_started":1}
I20260808 15:50:04.548202 25523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:04.541397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49940 (local address 127.8.39.67:37889)
0808 15:50:04.541937 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:04.541950 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:04.541973 (+ 23us) server_negotiation.cc:407] Connection header received
0808 15:50:04.542053 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:04.542059 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:04.542270 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:04.542785 (+ 515us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:04.542954 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.544035 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.545886 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.546923 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.547744 (+ 821us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:04.547888 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:04.547943 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 15:50:04.548045 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":206,"threads_started":1}
I20260808 15:50:04.548390 25522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:04.541468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45864 (local address 127.8.39.66:33605)
0808 15:50:04.542009 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:04.542031 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:04.542051 (+ 20us) server_negotiation.cc:407] Connection header received
0808 15:50:04.542112 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:04.542115 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:04.542257 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:04.542422 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:04.542922 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.544045 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.546141 (+ 2096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.546975 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.547074 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:04.547234 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:04.547982 (+ 748us) server_negotiation.cc:299] Negotiation successful
0808 15:50:04.548246 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":110,"threads_started":1}
I20260808 15:50:04.549546 25117 tablet_bootstrap.cc:492] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585: No bootstrap required, opened a new log
I20260808 15:50:04.549657 25117 ts_tablet_manager.cc:1397] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 15:50:04.550122 25117 raft_consensus.cc:348] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } }
I20260808 15:50:04.550256 25117 raft_consensus.cc:374] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:04.550304 25117 raft_consensus.cc:729] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb58936031334fd9b040449fef479585, State: Initialized, Role: FOLLOWER
I20260808 15:50:04.550438 25117 consensus_queue.cc:260] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } }
I20260808 15:50:04.550758 25117 ts_tablet_manager.cc:1428] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260808 15:50:04.551316 25443 tablet_service.cc:1467] Processing CreateTablet for tablet 6bc23872c76d4ca082d9dc6c655f742a (DEFAULT_TABLE table=test-table [id=6b8938dab14e40a09e5fc15879ab7c4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:50:04.551314 25302 tablet_service.cc:1467] Processing CreateTablet for tablet 6bc23872c76d4ca082d9dc6c655f742a (DEFAULT_TABLE table=test-table [id=6b8938dab14e40a09e5fc15879ab7c4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:50:04.552464 25443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bc23872c76d4ca082d9dc6c655f742a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:04.552456 25302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bc23872c76d4ca082d9dc6c655f742a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:04.560786 25526 tablet_bootstrap.cc:492] T 6bc23872c76d4ca082d9dc6c655f742a P 04bb6523a01742b0b084067990825339: Bootstrap starting.
I20260808 15:50:04.562968 25526 tablet_bootstrap.cc:654] T 6bc23872c76d4ca082d9dc6c655f742a P 04bb6523a01742b0b084067990825339: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:04.563030 25525 tablet_bootstrap.cc:492] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836: Bootstrap starting.
I20260808 15:50:04.564321 25526 log.cc:824] T 6bc23872c76d4ca082d9dc6c655f742a P 04bb6523a01742b0b084067990825339: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:04.565384 25525 tablet_bootstrap.cc:654] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:04.566061 25525 log.cc:824] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:04.566250 25526 tablet_bootstrap.cc:492] T 6bc23872c76d4ca082d9dc6c655f742a P 04bb6523a01742b0b084067990825339: No bootstrap required, opened a new log
I20260808 15:50:04.566548 25526 ts_tablet_manager.cc:1397] T 6bc23872c76d4ca082d9dc6c655f742a P 04bb6523a01742b0b084067990825339: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 15:50:04.567862 25525 tablet_bootstrap.cc:492] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836: No bootstrap required, opened a new log
I20260808 15:50:04.568056 25525 ts_tablet_manager.cc:1397] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 15:50:04.569718 25526 raft_consensus.cc:348] T 6bc23872c76d4ca082d9dc6c655f742a P 04bb6523a01742b0b084067990825339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } }
I20260808 15:50:04.570029 25526 raft_consensus.cc:374] T 6bc23872c76d4ca082d9dc6c655f742a P 04bb6523a01742b0b084067990825339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:04.570091 25526 raft_consensus.cc:729] T 6bc23872c76d4ca082d9dc6c655f742a P 04bb6523a01742b0b084067990825339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04bb6523a01742b0b084067990825339, State: Initialized, Role: FOLLOWER
I20260808 15:50:04.570489 25526 consensus_queue.cc:260] T 6bc23872c76d4ca082d9dc6c655f742a P 04bb6523a01742b0b084067990825339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } }
I20260808 15:50:04.571187 25512 heartbeater.cc:503] Master 127.8.39.126:35009 was elected leader, sending a full tablet report...
I20260808 15:50:04.571409 25525 raft_consensus.cc:348] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } }
I20260808 15:50:04.571605 25526 ts_tablet_manager.cc:1428] T 6bc23872c76d4ca082d9dc6c655f742a P 04bb6523a01742b0b084067990825339: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 15:50:04.571666 25525 raft_consensus.cc:374] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:04.571733 25525 raft_consensus.cc:729] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46deffb10e14cd7b30dcd1a4291e836, State: Initialized, Role: FOLLOWER
I20260808 15:50:04.572141 25525 consensus_queue.cc:260] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } }
I20260808 15:50:04.572881 25371 heartbeater.cc:503] Master 127.8.39.126:35009 was elected leader, sending a full tablet report...
I20260808 15:50:04.573134 25525 ts_tablet_manager.cc:1428] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836: Time spent starting tablet: real 0.005s user 0.000s sys 0.006s
I20260808 15:50:04.591598 25530 raft_consensus.cc:482] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:50:04.591828 25530 raft_consensus.cc:504] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } }
I20260808 15:50:04.593127 25530 leader_election.cc:288] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04bb6523a01742b0b084067990825339 (127.8.39.67:37889), eb58936031334fd9b040449fef479585 (127.8.39.65:37077)
I20260808 15:50:04.597508 25523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:04.593473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:33695 (local address 127.8.39.67:37889)
0808 15:50:04.593677 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:04.593684 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:04.593978 (+ 294us) server_negotiation.cc:407] Connection header received
0808 15:50:04.594085 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:04.594088 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:04.594138 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:04.594238 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:04.594535 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.595254 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.596534 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.596921 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.597006 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:04.597102 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:04.597288 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 15:50:04.597375 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 15:50:04.597538 25236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:04.593527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:43365 (local address 127.8.39.65:37077)
0808 15:50:04.593680 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:04.593685 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:04.593701 (+ 16us) server_negotiation.cc:407] Connection header received
0808 15:50:04.593759 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:04.593762 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:04.593830 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:04.593947 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:04.594346 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.595056 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.596492 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.596946 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.597087 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:04.597267 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:04.597354 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 15:50:04.597427 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 15:50:04.597505 25531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:04.593379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:37889 (local address 127.8.39.66:33695)
0808 15:50:04.593880 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:04.593896 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:04.593987 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:04.594255 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:04.594257 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:04.594293 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:04.594421 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:04.594428 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.595371 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.595374 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:04.596375 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:04.596385 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.597052 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.597056 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:04.597151 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:04.597175 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 15:50:04.597252 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 15:50:04.597338 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"mutex_wait_us":114,"thread_start_us":151,"threads_started":1}
I20260808 15:50:04.597515 25373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:04.593376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:37077 (local address 127.8.39.66:43365)
0808 15:50:04.593500 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:04.593516 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:04.593615 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:04.593989 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:04.594036 (+ 47us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:04.594071 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:04.594211 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:04.594222 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.595224 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.595228 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:04.596361 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:04.596371 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.597102 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.597107 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:04.597218 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:04.597265 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 15:50:04.597343 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 15:50:04.597409 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":5}
I20260808 15:50:04.598475 25179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bc23872c76d4ca082d9dc6c655f742a" candidate_uuid: "e46deffb10e14cd7b30dcd1a4291e836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb58936031334fd9b040449fef479585" is_pre_election: true
I20260808 15:50:04.598562 25464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bc23872c76d4ca082d9dc6c655f742a" candidate_uuid: "e46deffb10e14cd7b30dcd1a4291e836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04bb6523a01742b0b084067990825339" is_pre_election: true
I20260808 15:50:04.598845 25179 raft_consensus.cc:2454] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46deffb10e14cd7b30dcd1a4291e836 in term 0.
I20260808 15:50:04.598943 25464 raft_consensus.cc:2454] T 6bc23872c76d4ca082d9dc6c655f742a P 04bb6523a01742b0b084067990825339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46deffb10e14cd7b30dcd1a4291e836 in term 0.
W20260808 15:50:04.598979 25229 tablet.cc:2369] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:50:04.599467 25257 leader_election.cc:302] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04bb6523a01742b0b084067990825339, e46deffb10e14cd7b30dcd1a4291e836; no voters:
I20260808 15:50:04.599769 25530 raft_consensus.cc:2781] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:50:04.599862 25530 raft_consensus.cc:482] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:50:04.599907 25530 raft_consensus.cc:3037] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:04.600984 25530 raft_consensus.cc:504] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } }
I20260808 15:50:04.601359 25530 leader_election.cc:288] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836 [CANDIDATE]: Term 1 election: Requested vote from peers 04bb6523a01742b0b084067990825339 (127.8.39.67:37889), eb58936031334fd9b040449fef479585 (127.8.39.65:37077)
I20260808 15:50:04.601747 25464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bc23872c76d4ca082d9dc6c655f742a" candidate_uuid: "e46deffb10e14cd7b30dcd1a4291e836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04bb6523a01742b0b084067990825339"
I20260808 15:50:04.601752 25179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bc23872c76d4ca082d9dc6c655f742a" candidate_uuid: "e46deffb10e14cd7b30dcd1a4291e836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb58936031334fd9b040449fef479585"
I20260808 15:50:04.601888 25464 raft_consensus.cc:3037] T 6bc23872c76d4ca082d9dc6c655f742a P 04bb6523a01742b0b084067990825339 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:04.601912 25179 raft_consensus.cc:3037] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:04.603080 25464 raft_consensus.cc:2454] T 6bc23872c76d4ca082d9dc6c655f742a P 04bb6523a01742b0b084067990825339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46deffb10e14cd7b30dcd1a4291e836 in term 1.
I20260808 15:50:04.603080 25179 raft_consensus.cc:2454] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46deffb10e14cd7b30dcd1a4291e836 in term 1.
I20260808 15:50:04.603426 25253 leader_election.cc:302] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e46deffb10e14cd7b30dcd1a4291e836, eb58936031334fd9b040449fef479585; no voters:
I20260808 15:50:04.603623 25530 raft_consensus.cc:2781] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:50:04.603827 25530 raft_consensus.cc:686] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836 [term 1 LEADER]: Becoming Leader. State: Replica: e46deffb10e14cd7b30dcd1a4291e836, State: Running, Role: LEADER
I20260808 15:50:04.604183 25530 consensus_queue.cc:237] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } }
I20260808 15:50:04.607282 25034 catalog_manager.cc:5495] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836 reported cstate change: term changed from 0 to 1, leader changed from <none> to e46deffb10e14cd7b30dcd1a4291e836 (127.8.39.66). New cstate: current_term: 1 leader_uuid: "e46deffb10e14cd7b30dcd1a4291e836" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } health_report { overall_health: UNKNOWN } } }
I20260808 15:50:04.632771 25522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:04.629237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45880 (local address 127.8.39.66:33605)
0808 15:50:04.629368 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:04.629372 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:04.629384 (+ 12us) server_negotiation.cc:407] Connection header received
0808 15:50:04.629456 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:04.629458 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:04.629515 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:04.629606 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:50:04.629846 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.630394 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.631259 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:04.631484 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:04.631597 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:04.631940 (+ 343us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:50:04.632358 (+ 418us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:50:04.632503 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:04.632540 (+ 37us) server_negotiation.cc:299] Negotiation successful
0808 15:50:04.632600 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 15:50:04.638969 25464 raft_consensus.cc:1261] T 6bc23872c76d4ca082d9dc6c655f742a P 04bb6523a01742b0b084067990825339 [term 1 FOLLOWER]: Refusing update from remote peer e46deffb10e14cd7b30dcd1a4291e836: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:50:04.638931 25179 raft_consensus.cc:1261] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [term 1 FOLLOWER]: Refusing update from remote peer e46deffb10e14cd7b30dcd1a4291e836: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:50:04.639802 25532 consensus_queue.cc:1035] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:50:04.640043 25530 consensus_queue.cc:1035] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:50:04.647153 25534 mvcc.cc:205] Tried to move back new op lower bound from 7316292422193557504 to 7316292422061420544. Current Snapshot: MvccSnapshot[applied={T|T < 7316292422193557504}]
I20260808 15:50:04.647773 25535 mvcc.cc:205] Tried to move back new op lower bound from 7316292422193557504 to 7316292422061420544. Current Snapshot: MvccSnapshot[applied={T|T < 7316292422193557504}]
I20260808 15:50:04.649160 25537 mvcc.cc:205] Tried to move back new op lower bound from 7316292422193557504 to 7316292422061420544. Current Snapshot: MvccSnapshot[applied={T|T < 7316292422193557504}]
I20260808 15:50:04.657143 25035 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:50:04.657306 25035 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:50:04.659863 25035 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876: Sending DeleteTablet for 3 replicas of tablet 6bc23872c76d4ca082d9dc6c655f742a
I20260808 15:50:04.660590 25443 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bc23872c76d4ca082d9dc6c655f742a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:50:04 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:49940
I20260808 15:50:04.660703 25160 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bc23872c76d4ca082d9dc6c655f742a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:50:04 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:53222
I20260808 15:50:04.660799 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 25073
I20260808 15:50:04.660925 25302 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bc23872c76d4ca082d9dc6c655f742a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:50:04 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:45864
I20260808 15:50:04.661808 25544 tablet_replica.cc:330] T 6bc23872c76d4ca082d9dc6c655f742a P 04bb6523a01742b0b084067990825339: stopping tablet replica
I20260808 15:50:04.662158 25544 raft_consensus.cc:2229] T 6bc23872c76d4ca082d9dc6c655f742a P 04bb6523a01742b0b084067990825339 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:50:04.662504 25544 raft_consensus.cc:2258] T 6bc23872c76d4ca082d9dc6c655f742a P 04bb6523a01742b0b084067990825339 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:50:04.665863 25545 tablet_replica.cc:330] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836: stopping tablet replica
I20260808 15:50:04.666239 25545 raft_consensus.cc:2229] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:50:04.666818 25545 raft_consensus.cc:2258] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:50:04.667074 25544 ts_tablet_manager.cc:1905] T 6bc23872c76d4ca082d9dc6c655f742a P 04bb6523a01742b0b084067990825339: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:50:04.668478 25545 ts_tablet_manager.cc:1905] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 15:50:04.669454 25018 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.39.65:37077 (error 108)
I20260808 15:50:04.670270 25544 ts_tablet_manager.cc:1918] T 6bc23872c76d4ca082d9dc6c655f742a P 04bb6523a01742b0b084067990825339: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:50:04.670459 25544 log.cc:1196] T 6bc23872c76d4ca082d9dc6c655f742a P 04bb6523a01742b0b084067990825339: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/6bc23872c76d4ca082d9dc6c655f742a
I20260808 15:50:04.670846 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 25232
I20260808 15:50:04.671015 25544 ts_tablet_manager.cc:1939] T 6bc23872c76d4ca082d9dc6c655f742a P 04bb6523a01742b0b084067990825339: Deleting consensus metadata
I20260808 15:50:04.672616 25521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:04.672292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:37077 (local address 127.0.0.1:54542)
0808 15:50:04.672418 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:04.672506 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.65:37077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 15:50:04.673913 25021 catalog_manager.cc:4841] TS 04bb6523a01742b0b084067990825339 (127.8.39.67:37889): tablet 6bc23872c76d4ca082d9dc6c655f742a (table test-table [id=6b8938dab14e40a09e5fc15879ab7c4c]) successfully deleted
W20260808 15:50:04.673624 25018 catalog_manager.cc:4584] TS eb58936031334fd9b040449fef479585 (127.8.39.65:37077): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6bc23872c76d4ca082d9dc6c655f742a: Network error: Client connection negotiation failed: client connection to 127.8.39.65:37077: connect: Connection refused (error 111)
I20260808 15:50:04.678537 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 25374
I20260808 15:50:04.680151 25521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:04.678768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:33605 (local address 127.0.0.1:45886)
0808 15:50:04.679948 (+ 1180us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:04.680019 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.66:33605: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1060}
I20260808 15:50:04.686921 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 25001
I20260808 15:50:24.695742 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:35009
--webserver_interface=127.8.39.126
--webserver_port=45241
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:36349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:35009
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:50:24.818501 25547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:24.818964 25547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:24.819053 25547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:24.823300 25547 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 15:50:24.823401 25547 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 15:50:24.823429 25547 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 15:50:24.823450 25547 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:50:24.823493 25547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:24.823531 25547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:24.823571 25547 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:50:24.823606 25547 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:50:24.829387 25547 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:36349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:35009
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:35009
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=45241
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25547
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:24.830633 25547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:24.831727 25547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:24.841310 25553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:24.841439 25547 server_base.cc:1034] running on GCE node
W20260808 15:50:24.841446 25552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:24.841691 25555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:24.842263 25547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:24.843546 25547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:24.844749 25547 hybrid_clock.cc:648] HybridClock initialized: now 1786204224844719 us; error 43 us; skew 500 ppm
Aug 08 15:50:24 dist-test-slave-8tdl krb5kdc[24435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204224, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:50:24.848186 25547 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:50:24.849169 25547 webserver.cc:460] Webserver started at http://127.8.39.126:45241/ using document root <none> and password file <none>
I20260808 15:50:24.849756 25547 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:24.849824 25547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:24.854244 25547 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:50:24.856755 25562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:24.858189 25547 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 15:50:24.858350 25547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "62e49714697a4cd5bf989ce17528b876"
format_stamp: "Formatted at 2026-08-08 15:49:42 on dist-test-slave-8tdl"
server_key: "2bc7525930dfed8cf39c39ec2dc6f446"
server_key_iv: "b55b03d8b2d124430b78eab5bc449e10"
server_key_version: "encryptionkey@0"
I20260808 15:50:24.859059 25547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:24.893944 25547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:24.897629 25547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:24.897856 25547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:24.905628 25547 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:35009
I20260808 15:50:24.905927 25618 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:35009 every 8 connection(s)
I20260808 15:50:24.906824 25547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:50:24.911655 25619 sys_catalog.cc:263] Verifying existing consensus state
I20260808 15:50:24.913491 25619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876: Bootstrap starting.
I20260808 15:50:24.914988 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 25547
I20260808 15:50:24.915508 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:37077
--local_ip_for_outbound_sockets=127.8.39.65
--tserver_master_addrs=127.8.39.126:35009
--webserver_port=39991
--webserver_interface=127.8.39.65
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:36349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:50:24.933395 25619 log.cc:824] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:24.945766 25619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 15:50:24.946214 25619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876: Bootstrap complete.
I20260808 15:50:24.950555 25619 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e49714697a4cd5bf989ce17528b876" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 35009 } }
I20260808 15:50:24.951156 25619 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62e49714697a4cd5bf989ce17528b876, State: Initialized, Role: FOLLOWER
I20260808 15:50:24.951740 25619 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e49714697a4cd5bf989ce17528b876" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 35009 } }
I20260808 15:50:24.951901 25619 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:50:24.952010 25619 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:50:24.952132 25619 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [term 2 FOLLOWER]: Advancing to term 3
I20260808 15:50:24.954150 25619 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e49714697a4cd5bf989ce17528b876" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 35009 } }
I20260808 15:50:24.954509 25619 leader_election.cc:302] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62e49714697a4cd5bf989ce17528b876; no voters:
I20260808 15:50:24.954975 25619 leader_election.cc:288] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 15:50:24.955056 25623 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 15:50:24.955281 25623 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [term 3 LEADER]: Becoming Leader. State: Replica: 62e49714697a4cd5bf989ce17528b876, State: Running, Role: LEADER
I20260808 15:50:24.955665 25623 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e49714697a4cd5bf989ce17528b876" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 35009 } }
I20260808 15:50:24.956319 25619 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:50:24.956712 25623 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "62e49714697a4cd5bf989ce17528b876" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e49714697a4cd5bf989ce17528b876" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 35009 } } }
I20260808 15:50:24.956840 25623 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [sys.catalog]: This master's current role is: LEADER
I20260808 15:50:24.958071 25624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62e49714697a4cd5bf989ce17528b876. Latest consensus state: current_term: 3 leader_uuid: "62e49714697a4cd5bf989ce17528b876" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e49714697a4cd5bf989ce17528b876" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 35009 } } }
I20260808 15:50:24.958244 25624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876 [sys.catalog]: This master's current role is: LEADER
I20260808 15:50:24.958178 25627 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:50:24.962765 25627 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:50:24.963430 25627 catalog_manager.cc:1259] Loaded cluster ID: 0ad9734588e045c38a1c6ff17dd60f3c
I20260808 15:50:24.963513 25627 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:50:24.965407 25627 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:50:24.966058 25627 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876: Loaded TSK: 0
I20260808 15:50:24.966151 25627 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 62e49714697a4cd5bf989ce17528b876: Loaded TSK: 1
F20260808 15:50:24.966827 25627 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f58ce4f19ad google::LogMessage::Fail() at ??:0
@ 0x7f58ce4f488a google::LogMessage::SendToLog() at ??:0
@ 0x7f58ce4f14de google::LogMessage::Flush() at ??:0
@ 0x7f58ce4f2a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f58d11b518d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f58d11adf0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f58d8e5a7bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f58d8e3499c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f58d8e35178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f58d8e76df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f58d8e9582b std::function<>::operator()() at ??:0
@ 0x7f58d8e34b4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f58d8e35f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f58d8e32579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f58d8e76640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f58d07433d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f58d0743c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f58d07453f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f58d0734512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f58d1d786db start_thread at ??:0
@ 0x7f58ccfef61f clone at ??:0
W20260808 15:50:25.058540 25621 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:25.058876 25621 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:25.058928 25621 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:25.063709 25621 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:25.063766 25621 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:25.063828 25621 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:50:25.070079 25621 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:36349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:37077
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=39991
--tserver_master_addrs=127.8.39.126:35009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25621
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:25.071297 25621 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:25.072326 25621 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:25.082765 25670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:25.083006 25621 server_base.cc:1034] running on GCE node
W20260808 15:50:25.083029 25668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:25.082779 25667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:25.083568 25621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:25.084395 25621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:25.085623 25621 hybrid_clock.cc:648] HybridClock initialized: now 1786204225085585 us; error 44 us; skew 500 ppm
Aug 08 15:50:25 dist-test-slave-8tdl krb5kdc[24435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204225, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:50:25.089308 25621 init.cc:377] Logged in from keytab as kudu/127.8.39.65@KRBTEST.COM (short username kudu)
I20260808 15:50:25.090595 25621 webserver.cc:460] Webserver started at http://127.8.39.65:39991/ using document root <none> and password file <none>
I20260808 15:50:25.091360 25621 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:25.091478 25621 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:25.096971 25621 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 15:50:25.099977 25678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:25.101740 25621 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:50:25.101877 25621 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "eb58936031334fd9b040449fef479585"
format_stamp: "Formatted at 2026-08-08 15:49:42 on dist-test-slave-8tdl"
server_key: "6717989036ca4db876521f1e99da4c1f"
server_key_iv: "0f08fceda3634dab85cd8a76afb32df1"
server_key_version: "encryptionkey@0"
I20260808 15:50:25.102639 25621 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:25.125123 25621 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:25.128976 25621 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:25.129235 25621 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:25.129894 25621 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:50:25.131230 25685 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 15:50:25.137205 25621 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 15:50:25.137316 25621 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260808 15:50:25.137408 25621 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 15:50:25.139343 25621 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 15:50:25.139420 25621 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.002s sys 0.000s
I20260808 15:50:25.139744 25685 tablet_bootstrap.cc:492] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585: Bootstrap starting.
I20260808 15:50:25.150534 25621 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:37077
I20260808 15:50:25.150594 25798 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:37077 every 8 connection(s)
I20260808 15:50:25.151571 25621 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:50:25.154459 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 25621
I20260808 15:50:25.155045 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:33605
--local_ip_for_outbound_sockets=127.8.39.66
--tserver_master_addrs=127.8.39.126:35009
--webserver_port=43147
--webserver_interface=127.8.39.66
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:36349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:50:25.162833 25685 log.cc:824] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:25.172338 25685 tablet_bootstrap.cc:492] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 15:50:25.172798 25685 tablet_bootstrap.cc:492] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585: Bootstrap complete.
I20260808 15:50:25.174343 25685 ts_tablet_manager.cc:1397] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585: Time spent bootstrapping tablet: real 0.035s user 0.022s sys 0.008s
I20260808 15:50:25.177781 25685 raft_consensus.cc:348] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } }
I20260808 15:50:25.178399 25685 raft_consensus.cc:729] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb58936031334fd9b040449fef479585, State: Initialized, Role: FOLLOWER
I20260808 15:50:25.179035 25685 consensus_queue.cc:260] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } }
I20260808 15:50:25.180213 25685 ts_tablet_manager.cc:1428] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585: Time spent starting tablet: real 0.006s user 0.008s sys 0.001s
W20260808 15:50:25.238735 25801 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:50:25.153540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.65:36515)
0808 15:50:25.154019 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:25.154076 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:25.156233 (+ 2157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:25.237483 (+ 81250us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":141,"threads_started":1}
W20260808 15:50:25.239429 25799 heartbeater.cc:644] Failed to heartbeat to 127.8.39.126:35009 (0 consecutive failures): Network error: Failed to ping master at 127.8.39.126:35009: Client connection negotiation failed: client connection to 127.8.39.126:35009: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 15:50:25.240247 25801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:25.239952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.65:55447)
0808 15:50:25.240101 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:25.240181 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260808 15:50:25.241040 25801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:25.240801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.65:33743)
0808 15:50:25.240944 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:25.240991 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260808 15:50:25.241247 25799 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 15:50:25.272408 25802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:25.272661 25802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:25.272735 25802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:25.276856 25802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:25.276924 25802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:25.277007 25802 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:50:25.282339 25802 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:36349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:33605
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=43147
--tserver_master_addrs=127.8.39.126:35009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25802
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:25.283481 25802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:25.284543 25802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:25.294524 25810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:25.294524 25812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:25.294592 25809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:25.294893 25802 server_base.cc:1034] running on GCE node
I20260808 15:50:25.295321 25802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:25.295913 25802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:25.297113 25802 hybrid_clock.cc:648] HybridClock initialized: now 1786204225297100 us; error 28 us; skew 500 ppm
Aug 08 15:50:25 dist-test-slave-8tdl krb5kdc[24435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204225, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:50:25.300297 25802 init.cc:377] Logged in from keytab as kudu/127.8.39.66@KRBTEST.COM (short username kudu)
I20260808 15:50:25.301327 25802 webserver.cc:460] Webserver started at http://127.8.39.66:43147/ using document root <none> and password file <none>
I20260808 15:50:25.301926 25802 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:25.302047 25802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:25.306226 25802 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:50:25.308694 25819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:25.310093 25802 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 15:50:25.310241 25802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "e46deffb10e14cd7b30dcd1a4291e836"
format_stamp: "Formatted at 2026-08-08 15:49:43 on dist-test-slave-8tdl"
server_key: "5229c09adda0f442ecceea88d0a15715"
server_key_iv: "0edd5aa80519ddc600965a534548c0f5"
server_key_version: "encryptionkey@0"
I20260808 15:50:25.310902 25802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:25.330770 25802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:25.334198 25802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:25.334363 25802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:25.334998 25802 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:50:25.336184 25826 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
W20260808 15:50:25.340348 25826 ts_tablet_manager.cc:1852] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260808 15:50:25.340771 25826 ts_tablet_manager.cc:1905] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:50:25.345084 25826 ts_tablet_manager.cc:1918] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:50:25.345197 25826 log.cc:1196] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/wal/wals/6bc23872c76d4ca082d9dc6c655f742a
I20260808 15:50:25.345566 25826 ts_tablet_manager.cc:1939] T 6bc23872c76d4ca082d9dc6c655f742a P e46deffb10e14cd7b30dcd1a4291e836: Deleting consensus metadata
I20260808 15:50:25.345911 25802 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260808 15:50:25.346009 25802 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.010s user 0.000s sys 0.000s
I20260808 15:50:25.346110 25802 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:50:25.346163 25802 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:25.356374 25802 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:33605
I20260808 15:50:25.356426 25939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:33605 every 8 connection(s)
I20260808 15:50:25.357288 25802 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:50:25.361052 25942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:25.359580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.66:58149)
0808 15:50:25.360128 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:25.360249 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":118,"threads_started":1}
W20260808 15:50:25.361526 25940 heartbeater.cc:644] Failed to heartbeat to 127.8.39.126:35009 (0 consecutive failures): Network error: Failed to ping master at 127.8.39.126:35009: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
I20260808 15:50:25.362228 25942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:25.361968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.66:45557)
0808 15:50:25.362110 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:25.362171 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 15:50:25.362895 25942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:25.362656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.66:35695)
0808 15:50:25.362789 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:25.362844 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260808 15:50:25.363201 25940 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 15:50:25.367169 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 25802
I20260808 15:50:25.367630 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:37889
--local_ip_for_outbound_sockets=127.8.39.67
--tserver_master_addrs=127.8.39.126:35009
--webserver_port=43203
--webserver_interface=127.8.39.67
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:36349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:50:25.487118 25943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:25.487403 25943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:25.487448 25943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:25.491504 25943 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:25.491566 25943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:25.491631 25943 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:50:25.496950 25943 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:36349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:37889
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=43203
--tserver_master_addrs=127.8.39.126:35009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25943
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:25.497933 25943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:25.498910 25943 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:25.508778 25949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:25.508803 25951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:25.508805 25948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:25.508985 25943 server_base.cc:1034] running on GCE node
I20260808 15:50:25.509617 25943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:25.510275 25943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:25.511466 25943 hybrid_clock.cc:648] HybridClock initialized: now 1786204225511452 us; error 35 us; skew 500 ppm
Aug 08 15:50:25 dist-test-slave-8tdl krb5kdc[24435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204225, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:50:25.514376 25943 init.cc:377] Logged in from keytab as kudu/127.8.39.67@KRBTEST.COM (short username kudu)
I20260808 15:50:25.515367 25943 webserver.cc:460] Webserver started at http://127.8.39.67:43203/ using document root <none> and password file <none>
I20260808 15:50:25.515983 25943 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:25.516088 25943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:25.520079 25943 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:50:25.522172 25958 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:25.523466 25943 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:50:25.523631 25943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "04bb6523a01742b0b084067990825339"
format_stamp: "Formatted at 2026-08-08 15:49:43 on dist-test-slave-8tdl"
server_key: "018d0e4306e6e0fc7dbb40b249c10e0d"
server_key_iv: "0414e5e411d22652ca8527fb5050e3ec"
server_key_version: "encryptionkey@0"
I20260808 15:50:25.524189 25943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:25.553213 25943 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:25.556577 25943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:25.556805 25943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:25.557467 25943 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:50:25.558337 25943 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:50:25.558411 25943 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:25.558485 25943 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:50:25.558542 25943 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:25.568558 25943 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:37889
I20260808 15:50:25.568565 26077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:37889 every 8 connection(s)
I20260808 15:50:25.569617 25943 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:50:25.573770 26082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:25.571903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.67:50893)
0808 15:50:25.572682 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:25.572806 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":126,"threads_started":1}
W20260808 15:50:25.574280 26080 heartbeater.cc:644] Failed to heartbeat to 127.8.39.126:35009 (0 consecutive failures): Network error: Failed to ping master at 127.8.39.126:35009: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
I20260808 15:50:25.575142 26082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:25.574791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.67:39469)
0808 15:50:25.575013 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:25.575082 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260808 15:50:25.575821 26082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:25.575605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.67:34191)
0808 15:50:25.575716 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:25.575771 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 15:50:25.576156 26080 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 15:50:25.576205 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 25943
I20260808 15:50:26.242372 26084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:26.241913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.65:33905)
0808 15:50:26.242197 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:26.242255 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":81,"threads_started":1}
I20260808 15:50:26.364246 26085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:26.363764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.66:35881)
0808 15:50:26.364095 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:26.364154 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":147,"threads_started":1}
I20260808 15:50:26.577278 26086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:26.576796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.67:59789)
0808 15:50:26.577109 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:26.577171 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":118,"threads_started":1}
I20260808 15:50:26.834898 26087 raft_consensus.cc:482] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:50:26.835170 26087 raft_consensus.cc:504] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } }
I20260808 15:50:26.836364 26087 leader_election.cc:288] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04bb6523a01742b0b084067990825339 (127.8.39.67:37889), e46deffb10e14cd7b30dcd1a4291e836 (127.8.39.66:33605)
Aug 08 15:50:26 dist-test-slave-8tdl krb5kdc[24435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204225, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for kudu/127.8.39.67@KRBTEST.COM
Aug 08 15:50:26 dist-test-slave-8tdl krb5kdc[24435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204225, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for kudu/127.8.39.66@KRBTEST.COM
I20260808 15:50:26.856348 26089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:26.836626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:33605 (local address 127.8.39.65:37025)
0808 15:50:26.837009 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:26.837026 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:26.837158 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:26.838839 (+ 1681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:26.838845 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:26.839419 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:50:26.839887 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:26.839901 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:26.841268 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:26.841272 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:26.842189 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:26.842200 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:26.843040 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:26.843044 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:26.843201 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:26.849053 (+ 5852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:50:26.849068 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:50:26.851276 (+ 2208us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:50:26.853702 (+ 2426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:26.853704 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:26.853713 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:26.854087 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:26.854465 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:26.854470 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:26.854472 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:26.854616 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:26.855325 (+ 709us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:50:26.855332 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:50:26.855562 (+ 230us) client_negotiation.cc:769] Sending connection context
0808 15:50:26.855757 (+ 195us) client_negotiation.cc:240] Negotiation successful
0808 15:50:26.856136 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"mutex_wait_us":153,"spinlock_wait_cycles":44544,"thread_start_us":111,"threads_started":1}
I20260808 15:50:26.856501 26088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:26.836629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:37889 (local address 127.8.39.65:41149)
0808 15:50:26.837118 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:26.837133 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:26.837236 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:26.838838 (+ 1602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:26.838845 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:26.839419 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:50:26.839886 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:26.839900 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:26.841262 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:26.841265 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:26.842180 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:26.842190 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:26.842964 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:26.842968 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:26.843177 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:26.849041 (+ 5864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:50:26.849070 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:50:26.850829 (+ 1759us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:50:26.853681 (+ 2852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:26.853695 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:26.853709 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:26.854095 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:26.854534 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:26.854538 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:26.854540 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:26.854639 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:26.855408 (+ 769us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:50:26.855411 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:50:26.855569 (+ 158us) client_negotiation.cc:769] Sending connection context
0808 15:50:26.855757 (+ 188us) client_negotiation.cc:240] Negotiation successful
0808 15:50:26.856245 (+ 488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"mutex_wait_us":339,"spinlock_wait_cycles":29184,"thread_start_us":69,"threads_started":1}
I20260808 15:50:26.856956 26091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:26.836813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:41149 (local address 127.8.39.67:37889)
0808 15:50:26.837331 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:26.837362 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:26.837393 (+ 31us) server_negotiation.cc:407] Connection header received
0808 15:50:26.838064 (+ 671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:26.838070 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:26.838447 (+ 377us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:26.838774 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:26.840061 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:26.841114 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:26.842307 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:26.842830 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:26.843014 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:26.851169 (+ 8155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:26.851174 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:26.851189 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:26.851222 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:26.853518 (+ 2296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:26.854251 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:26.854259 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:26.854267 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:26.854406 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:26.854798 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:26.854802 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:26.854804 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:26.855279 (+ 475us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:26.855440 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:26.855902 (+ 462us) server_negotiation.cc:299] Negotiation successful
0808 15:50:26.856797 (+ 895us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":100,"threads_started":1}
I20260808 15:50:26.857213 26090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:26.836834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:37025 (local address 127.8.39.66:33605)
0808 15:50:26.837310 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:26.837323 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:26.837361 (+ 38us) server_negotiation.cc:407] Connection header received
0808 15:50:26.838117 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:26.838123 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:26.838421 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:26.838778 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:26.840068 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:26.841119 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:26.842332 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:26.842889 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:26.843074 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:26.851511 (+ 8437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:26.851518 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:26.851535 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:26.851591 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:26.853518 (+ 1927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:26.854216 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:26.854222 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:26.854227 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:26.854359 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:26.854738 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:26.854755 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:26.854757 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:26.855201 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:26.855352 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:26.856711 (+ 1359us) server_negotiation.cc:299] Negotiation successful
0808 15:50:26.856990 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":100,"threads_started":1}
W20260808 15:50:26.859450 25682 leader_election.cc:341] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 04bb6523a01742b0b084067990825339 (127.8.39.67:37889): Not found: Tablet not found: 6bc23872c76d4ca082d9dc6c655f742a
W20260808 15:50:26.859632 25679 leader_election.cc:341] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e46deffb10e14cd7b30dcd1a4291e836 (127.8.39.66:33605): Not found: Tablet not found: 6bc23872c76d4ca082d9dc6c655f742a
I20260808 15:50:26.859756 25679 leader_election.cc:302] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb58936031334fd9b040449fef479585; no voters: 04bb6523a01742b0b084067990825339, e46deffb10e14cd7b30dcd1a4291e836
I20260808 15:50:26.860069 26087 raft_consensus.cc:2726] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 15:50:27.243544 26088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:27.243210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.65:39959)
0808 15:50:27.243392 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:27.243460 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260808 15:50:27.365466 26092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:27.365029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.66:45669)
0808 15:50:27.365304 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:27.365373 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":71,"threads_started":1}
I20260808 15:50:27.578620 26093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:27.578172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.67:39669)
0808 15:50:27.578459 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:27.578523 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":86,"threads_started":1}
I20260808 15:50:28.244935 26094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:28.244444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.65:59513)
0808 15:50:28.244742 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:28.244808 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":91,"threads_started":1}
I20260808 15:50:28.366919 26095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:28.366323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.66:39527)
0808 15:50:28.366620 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:28.366759 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":83,"threads_started":1}
I20260808 15:50:28.580165 26096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:28.579623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.67:50695)
0808 15:50:28.579943 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:28.580061 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":83,"threads_started":1}
I20260808 15:50:29.055045 26097 raft_consensus.cc:482] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:50:29.055207 26097 raft_consensus.cc:504] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } }
I20260808 15:50:29.055704 26097 leader_election.cc:288] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04bb6523a01742b0b084067990825339 (127.8.39.67:37889), e46deffb10e14cd7b30dcd1a4291e836 (127.8.39.66:33605)
W20260808 15:50:29.056613 25682 leader_election.cc:341] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 04bb6523a01742b0b084067990825339 (127.8.39.67:37889): Not found: Tablet not found: 6bc23872c76d4ca082d9dc6c655f742a
W20260808 15:50:29.056730 25679 leader_election.cc:341] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e46deffb10e14cd7b30dcd1a4291e836 (127.8.39.66:33605): Not found: Tablet not found: 6bc23872c76d4ca082d9dc6c655f742a
I20260808 15:50:29.056803 25679 leader_election.cc:302] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb58936031334fd9b040449fef479585; no voters: 04bb6523a01742b0b084067990825339, e46deffb10e14cd7b30dcd1a4291e836
I20260808 15:50:29.056948 26097 raft_consensus.cc:2726] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 15:50:29.246155 26098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:29.245692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.65:60837)
0808 15:50:29.245995 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:29.246054 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":83,"threads_started":1}
I20260808 15:50:29.368113 26099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:29.367686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.66:38313)
0808 15:50:29.367964 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:29.368025 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":75,"threads_started":1}
I20260808 15:50:29.581517 26100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:29.581075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.67:60509)
0808 15:50:29.581345 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:29.581410 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":82,"threads_started":1}
I20260808 15:50:30.247915 26101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:30.247308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.65:38075)
0808 15:50:30.247680 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:30.247777 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":134,"threads_started":1}
I20260808 15:50:30.369503 26102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:30.368997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.66:34275)
0808 15:50:30.369300 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:30.369396 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":117,"threads_started":1}
I20260808 15:50:30.582934 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:30.582397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.67:50067)
0808 15:50:30.582767 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:30.582828 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":91,"threads_started":1}
I20260808 15:50:30.894380 26104 raft_consensus.cc:482] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:50:30.894562 26104 raft_consensus.cc:504] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } }
I20260808 15:50:30.895354 26104 leader_election.cc:288] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04bb6523a01742b0b084067990825339 (127.8.39.67:37889), e46deffb10e14cd7b30dcd1a4291e836 (127.8.39.66:33605)
W20260808 15:50:30.896232 25679 leader_election.cc:341] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e46deffb10e14cd7b30dcd1a4291e836 (127.8.39.66:33605): Not found: Tablet not found: 6bc23872c76d4ca082d9dc6c655f742a
W20260808 15:50:30.896343 25682 leader_election.cc:341] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 04bb6523a01742b0b084067990825339 (127.8.39.67:37889): Not found: Tablet not found: 6bc23872c76d4ca082d9dc6c655f742a
I20260808 15:50:30.896415 25682 leader_election.cc:302] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb58936031334fd9b040449fef479585; no voters: 04bb6523a01742b0b084067990825339, e46deffb10e14cd7b30dcd1a4291e836
I20260808 15:50:30.896570 26104 raft_consensus.cc:2726] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 15:50:31.249305 26105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:31.248874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.65:56997)
0808 15:50:31.249135 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:31.249195 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":82,"threads_started":1}
I20260808 15:50:31.371076 26106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:31.370429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.66:46279)
0808 15:50:31.370821 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:31.370958 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":96,"threads_started":1}
I20260808 15:50:31.584424 26107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:31.583947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.67:44431)
0808 15:50:31.584257 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:31.584322 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":86,"threads_started":1}
I20260808 15:50:32.250833 26108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:32.250249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.65:55751)
0808 15:50:32.250588 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:32.250657 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":105,"threads_started":1}
I20260808 15:50:32.372709 26109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:32.372109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.66:60959)
0808 15:50:32.372521 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:32.372595 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":107,"threads_started":1}
I20260808 15:50:32.585989 26110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:32.585428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.67:45689)
0808 15:50:32.585796 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:32.585871 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":88,"threads_started":1}
I20260808 15:50:33.252295 26111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:33.251792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.65:60943)
0808 15:50:33.252124 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:33.252191 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":99,"threads_started":1}
I20260808 15:50:33.374148 26112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:33.373666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.66:54063)
0808 15:50:33.373984 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:33.374051 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":103,"threads_started":1}
I20260808 15:50:33.587548 26113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:33.587036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.67:37609)
0808 15:50:33.587372 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:33.587433 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":100,"threads_started":1}
I20260808 15:50:33.951157 26114 raft_consensus.cc:482] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:50:33.951305 26114 raft_consensus.cc:504] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } }
I20260808 15:50:33.951730 26114 leader_election.cc:288] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04bb6523a01742b0b084067990825339 (127.8.39.67:37889), e46deffb10e14cd7b30dcd1a4291e836 (127.8.39.66:33605)
W20260808 15:50:33.952564 25682 leader_election.cc:341] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 04bb6523a01742b0b084067990825339 (127.8.39.67:37889): Not found: Tablet not found: 6bc23872c76d4ca082d9dc6c655f742a
W20260808 15:50:33.952666 25679 leader_election.cc:341] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e46deffb10e14cd7b30dcd1a4291e836 (127.8.39.66:33605): Not found: Tablet not found: 6bc23872c76d4ca082d9dc6c655f742a
I20260808 15:50:33.952791 25679 leader_election.cc:302] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb58936031334fd9b040449fef479585; no voters: 04bb6523a01742b0b084067990825339, e46deffb10e14cd7b30dcd1a4291e836
I20260808 15:50:33.952981 26114 raft_consensus.cc:2726] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 15:50:34.253885 26115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:34.253341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.65:55721)
0808 15:50:34.253687 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:34.253760 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":98,"threads_started":1}
I20260808 15:50:34.375591 26116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:34.375072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.66:52029)
0808 15:50:34.375426 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:34.375487 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":119,"threads_started":1}
I20260808 15:50:34.589244 26117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:34.588678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.67:34231)
0808 15:50:34.589071 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:34.589141 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":98,"threads_started":1}
I20260808 15:50:35.255575 26118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:35.255073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.65:38999)
0808 15:50:35.255384 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:35.255475 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":108,"threads_started":1}
I20260808 15:50:35.377105 26119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:35.376596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.66:54523)
0808 15:50:35.376926 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:35.376999 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":90,"threads_started":1}
I20260808 15:50:35.591042 26120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:35.590456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.67:40597)
0808 15:50:35.590812 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:35.590871 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":101,"threads_started":1}
I20260808 15:50:36.257053 26121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:36.256543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.65:37235)
0808 15:50:36.256873 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:36.256940 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":93,"threads_started":1}
I20260808 15:50:36.378626 26122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:36.378146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.66:43295)
0808 15:50:36.378451 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:36.378521 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":84,"threads_started":1}
I20260808 15:50:36.592437 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:36.591959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.67:56359)
0808 15:50:36.592246 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:36.592307 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":79,"threads_started":1}
I20260808 15:50:37.258438 26124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:37.257962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.65:45217)
0808 15:50:37.258268 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:37.258332 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":85,"threads_started":1}
I20260808 15:50:37.380000 26125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:37.379526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.66:33415)
0808 15:50:37.379794 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:37.379857 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":74,"threads_started":1}
I20260808 15:50:37.593948 26126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:37.593402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.67:50241)
0808 15:50:37.593719 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:37.593782 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":102,"threads_started":1}
I20260808 15:50:38.235826 26127 raft_consensus.cc:482] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:50:38.235978 26127 raft_consensus.cc:504] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04bb6523a01742b0b084067990825339" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 37889 } } peers { permanent_uuid: "e46deffb10e14cd7b30dcd1a4291e836" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33605 } } peers { permanent_uuid: "eb58936031334fd9b040449fef479585" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 37077 } }
I20260808 15:50:38.236359 26127 leader_election.cc:288] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04bb6523a01742b0b084067990825339 (127.8.39.67:37889), e46deffb10e14cd7b30dcd1a4291e836 (127.8.39.66:33605)
W20260808 15:50:38.237340 25679 leader_election.cc:341] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e46deffb10e14cd7b30dcd1a4291e836 (127.8.39.66:33605): Not found: Tablet not found: 6bc23872c76d4ca082d9dc6c655f742a
W20260808 15:50:38.237504 25682 leader_election.cc:341] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 04bb6523a01742b0b084067990825339 (127.8.39.67:37889): Not found: Tablet not found: 6bc23872c76d4ca082d9dc6c655f742a
I20260808 15:50:38.237584 25682 leader_election.cc:302] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb58936031334fd9b040449fef479585; no voters: 04bb6523a01742b0b084067990825339, e46deffb10e14cd7b30dcd1a4291e836
I20260808 15:50:38.237771 26127 raft_consensus.cc:2726] T 6bc23872c76d4ca082d9dc6c655f742a P eb58936031334fd9b040449fef479585 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 15:50:38.259830 26128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:38.259348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.65:47435)
0808 15:50:38.259659 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:38.259731 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":158,"threads_started":1}
I20260808 15:50:38.381469 26129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:38.380960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.66:57877)
0808 15:50:38.381294 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:38.381361 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":103,"threads_started":1}
I20260808 15:50:38.595376 26130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:38.594928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.67:58093)
0808 15:50:38.595218 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:38.595273 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":103,"threads_started":1}
I20260808 15:50:39.261183 26131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:39.260705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.65:34781)
0808 15:50:39.261024 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:39.261084 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":84,"threads_started":1}
I20260808 15:50:39.386912 26132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:39.386366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.66:57861)
0808 15:50:39.386708 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:39.386783 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":97,"threads_started":1}
I20260808 15:50:39.596735 26133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:39.596271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.67:35109)
0808 15:50:39.596572 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:39.596634 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":101,"threads_started":1}
I20260808 15:50:40.262897 26134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:40.262325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.65:40295)
0808 15:50:40.262724 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:40.262798 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":163,"threads_started":1}
I20260808 15:50:40.388403 26135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:40.387962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.66:53345)
0808 15:50:40.388240 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:40.388303 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":79,"threads_started":1}
I20260808 15:50:40.584723 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 25621
I20260808 15:50:40.593463 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 25802
I20260808 15:50:40.598309 26136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:40.597832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:35009 (local address 127.8.39.67:50107)
0808 15:50:40.598142 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:40.598207 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.126:35009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":95,"threads_started":1}
I20260808 15:50:40.601118 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 25943
2026-08-08T15:50:40Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59484 ms)
[----------] 30 tests from SecurityITest (253566 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:50:40 dist-test-slave-8tdl krb5kdc[26139](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:50:40 dist-test-slave-8tdl krb5kdc[26139](info): set up 2 sockets
Aug 08 15:50:40 dist-test-slave-8tdl krb5kdc[26139](info): commencing operation
krb5kdc: starting...
W20260808 15:50:41.720307 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.094s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:50:41 dist-test-slave-8tdl krb5kdc[26139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204241, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:50:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:50:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:50:41.872105 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:36537
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:41121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:36537
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:50:41.990880 26153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:41.991170 26153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:41.991214 26153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:41.995311 26153 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:50:41.995393 26153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:41.995414 26153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:41.995431 26153 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:50:41.995452 26153 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:50:42.001116 26153 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:41121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:36537
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:36537
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:42.002286 26153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:42.003364 26153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 15:50:42.013031 26153 server_base.cc:1034] running on GCE node
W20260808 15:50:42.013048 26161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:42.013056 26158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:42.013051 26159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:42.014060 26153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:42.015368 26153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:42.016572 26153 hybrid_clock.cc:648] HybridClock initialized: now 1786204242016548 us; error 38 us; skew 500 ppm
Aug 08 15:50:42 dist-test-slave-8tdl krb5kdc[26139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204242, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:50:42.020139 26153 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:50:42.021303 26153 webserver.cc:460] Webserver started at http://127.8.39.126:46265/ using document root <none> and password file <none>
I20260808 15:50:42.021921 26153 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:42.022001 26153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:42.022250 26153 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:42.024600 26153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "5fbace8c80e8409c96856871cbd515ed"
format_stamp: "Formatted at 2026-08-08 15:50:42 on dist-test-slave-8tdl"
server_key: "25fa6a870928f88e5333815513a7824a"
server_key_iv: "18629423f3cd89029beaeeec020ddf72"
server_key_version: "encryptionkey@0"
I20260808 15:50:42.025298 26153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "5fbace8c80e8409c96856871cbd515ed"
format_stamp: "Formatted at 2026-08-08 15:50:42 on dist-test-slave-8tdl"
server_key: "25fa6a870928f88e5333815513a7824a"
server_key_iv: "18629423f3cd89029beaeeec020ddf72"
server_key_version: "encryptionkey@0"
I20260808 15:50:42.029543 26153 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260808 15:50:42.032377 26169 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:42.033910 26153 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 15:50:42.034143 26153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "5fbace8c80e8409c96856871cbd515ed"
format_stamp: "Formatted at 2026-08-08 15:50:42 on dist-test-slave-8tdl"
server_key: "25fa6a870928f88e5333815513a7824a"
server_key_iv: "18629423f3cd89029beaeeec020ddf72"
server_key_version: "encryptionkey@0"
I20260808 15:50:42.034291 26153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:42.059556 26153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:42.062974 26153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:42.063212 26153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:42.071281 26153 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:36537
I20260808 15:50:42.071309 26224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:36537 every 8 connection(s)
I20260808 15:50:42.072381 26153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:50:42.075587 26225 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:42.081966 26225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5fbace8c80e8409c96856871cbd515ed: Bootstrap starting.
I20260808 15:50:42.082366 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 26153
I20260808 15:50:42.082518 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:50:42.082911 8349 external_mini_cluster.cc:1428] Setting key 0fd040ad2302d2a47919ab7f398da860
I20260808 15:50:42.085269 26225 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5fbace8c80e8409c96856871cbd515ed: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:42.086273 26225 log.cc:824] T 00000000000000000000000000000000 P 5fbace8c80e8409c96856871cbd515ed: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:42.088855 26225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5fbace8c80e8409c96856871cbd515ed: No bootstrap required, opened a new log
Aug 08 15:50:42 dist-test-slave-8tdl krb5kdc[26139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204241, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:50:42.094208 26225 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5fbace8c80e8409c96856871cbd515ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fbace8c80e8409c96856871cbd515ed" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 36537 } }
I20260808 15:50:42.094498 26225 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5fbace8c80e8409c96856871cbd515ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:42.094597 26225 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5fbace8c80e8409c96856871cbd515ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fbace8c80e8409c96856871cbd515ed, State: Initialized, Role: FOLLOWER
I20260808 15:50:42.095194 26225 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5fbace8c80e8409c96856871cbd515ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fbace8c80e8409c96856871cbd515ed" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 36537 } }
I20260808 15:50:42.095362 26225 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5fbace8c80e8409c96856871cbd515ed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:50:42.095466 26225 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5fbace8c80e8409c96856871cbd515ed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:50:42.095579 26225 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5fbace8c80e8409c96856871cbd515ed [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:42.096638 26225 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5fbace8c80e8409c96856871cbd515ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fbace8c80e8409c96856871cbd515ed" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 36537 } }
I20260808 15:50:42.097100 26225 leader_election.cc:302] T 00000000000000000000000000000000 P 5fbace8c80e8409c96856871cbd515ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5fbace8c80e8409c96856871cbd515ed; no voters:
I20260808 15:50:42.097568 26225 leader_election.cc:288] T 00000000000000000000000000000000 P 5fbace8c80e8409c96856871cbd515ed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:50:42.097848 26230 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5fbace8c80e8409c96856871cbd515ed [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:50:42.098258 26230 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5fbace8c80e8409c96856871cbd515ed [term 1 LEADER]: Becoming Leader. State: Replica: 5fbace8c80e8409c96856871cbd515ed, State: Running, Role: LEADER
I20260808 15:50:42.098795 26230 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5fbace8c80e8409c96856871cbd515ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fbace8c80e8409c96856871cbd515ed" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 36537 } }
I20260808 15:50:42.099215 26225 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5fbace8c80e8409c96856871cbd515ed [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:50:42.100111 26230 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5fbace8c80e8409c96856871cbd515ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5fbace8c80e8409c96856871cbd515ed. Latest consensus state: current_term: 1 leader_uuid: "5fbace8c80e8409c96856871cbd515ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fbace8c80e8409c96856871cbd515ed" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 36537 } } }
I20260808 15:50:42.100222 26230 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5fbace8c80e8409c96856871cbd515ed [sys.catalog]: This master's current role is: LEADER
I20260808 15:50:42.100512 26228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:42.084634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51950 (local address 127.8.39.126:36537)
0808 15:50:42.085180 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:42.085196 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:42.085235 (+ 39us) server_negotiation.cc:407] Connection header received
0808 15:50:42.086184 (+ 949us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:42.086205 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:42.086623 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:42.087092 (+ 469us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:42.088069 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.089126 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.090400 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.091028 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.091153 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:42.094322 (+ 3169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:42.094328 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:42.094343 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:42.094377 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:42.096338 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:42.096828 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:42.096839 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:42.096844 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:42.096972 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:42.097452 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:42.097457 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:42.097460 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:42.098083 (+ 623us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:42.098971 (+ 888us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:42.099139 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 15:50:42.099463 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":158,"threads_started":1}
I20260808 15:50:42.100884 26231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5fbace8c80e8409c96856871cbd515ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5fbace8c80e8409c96856871cbd515ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fbace8c80e8409c96856871cbd515ed" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 36537 } } }
I20260808 15:50:42.100972 26231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5fbace8c80e8409c96856871cbd515ed [sys.catalog]: This master's current role is: LEADER
W20260808 15:50:42.105551 26245 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5fbace8c80e8409c96856871cbd515ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:50:42.105656 26245 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:50:42.105731 26239 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:50:42.106456 26239 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:50:42.112462 26239 catalog_manager.cc:1347] Generated new cluster ID: 6d993a3a0d6a4dcbb95cccd4a81e5469
I20260808 15:50:42.112545 26239 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:50:42.134621 26239 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:50:42.136044 26239 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:50:42.149535 26239 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5fbace8c80e8409c96856871cbd515ed: Generated new TSK 0
I20260808 15:50:42.150559 26239 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.39.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
I20260808 15:50:42.194057 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:0
--local_ip_for_outbound_sockets=127.8.39.65
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:36537
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:41121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:50:42.317073 26252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:42.317384 26252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:42.317431 26252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:42.321777 26252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:42.321866 26252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:42.321980 26252 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:50:42.327986 26252 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:41121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:36537
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26252
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:42.329252 26252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:42.330348 26252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:42.340791 26258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:42.340864 26252 server_base.cc:1034] running on GCE node
W20260808 15:50:42.340794 26257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:42.340791 26260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:42.341603 26252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:42.342411 26252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:42.343664 26252 hybrid_clock.cc:648] HybridClock initialized: now 1786204242343636 us; error 43 us; skew 500 ppm
Aug 08 15:50:42 dist-test-slave-8tdl krb5kdc[26139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204242, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:50:42.346961 26252 init.cc:377] Logged in from keytab as kudu/127.8.39.65@KRBTEST.COM (short username kudu)
I20260808 15:50:42.348021 26252 webserver.cc:460] Webserver started at http://127.8.39.65:36057/ using document root <none> and password file <none>
I20260808 15:50:42.348642 26252 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:42.348740 26252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:42.349005 26252 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:42.351307 26252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-0/data/instance:
uuid: "c75cc55ab59e4ddb941e5a4166fd28a7"
format_stamp: "Formatted at 2026-08-08 15:50:42 on dist-test-slave-8tdl"
server_key: "46a7d35968abb696b67e23ad46fa66f6"
server_key_iv: "2bb341b17bc89e5d3cebff10b22aa625"
server_key_version: "encryptionkey@0"
I20260808 15:50:42.351945 26252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance:
uuid: "c75cc55ab59e4ddb941e5a4166fd28a7"
format_stamp: "Formatted at 2026-08-08 15:50:42 on dist-test-slave-8tdl"
server_key: "46a7d35968abb696b67e23ad46fa66f6"
server_key_iv: "2bb341b17bc89e5d3cebff10b22aa625"
server_key_version: "encryptionkey@0"
I20260808 15:50:42.356140 26252 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260808 15:50:42.359079 26267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:42.360560 26252 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 15:50:42.360752 26252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "c75cc55ab59e4ddb941e5a4166fd28a7"
format_stamp: "Formatted at 2026-08-08 15:50:42 on dist-test-slave-8tdl"
server_key: "46a7d35968abb696b67e23ad46fa66f6"
server_key_iv: "2bb341b17bc89e5d3cebff10b22aa625"
server_key_version: "encryptionkey@0"
I20260808 15:50:42.360895 26252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:42.383217 26252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:42.386904 26252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:42.387171 26252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:42.387883 26252 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:50:42.388885 26252 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:50:42.389079 26252 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:42.389204 26252 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:50:42.389258 26252 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:42.399163 26252 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:42975
I20260808 15:50:42.399217 26383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:42975 every 8 connection(s)
I20260808 15:50:42.400333 26252 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:50:42.403050 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 26252
I20260808 15:50:42.403172 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance
I20260808 15:50:42.403577 8349 external_mini_cluster.cc:1428] Setting key 6c8df97342819cbc9c5409876cd04cdc
Aug 08 15:50:42 dist-test-slave-8tdl krb5kdc[26139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204242, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.39.66@KRBTEST.COM; defaulting to no policy
I20260808 15:50:42.416339 26228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:42.402558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:53265 (local address 127.8.39.126:36537)
0808 15:50:42.402768 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:42.402774 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:42.403857 (+ 1083us) server_negotiation.cc:407] Connection header received
0808 15:50:42.405174 (+ 1317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:42.405177 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:42.405234 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:42.405318 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:42.406636 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.407340 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.408580 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.408833 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.408958 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:42.412161 (+ 3203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:42.412165 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:42.412168 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:42.412199 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:42.413832 (+ 1633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:42.414507 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:42.414511 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:42.414513 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:42.414630 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:42.415067 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:42.415071 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:42.415073 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:42.415278 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:42.415389 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:42.416012 (+ 623us) server_negotiation.cc:299] Negotiation successful
0808 15:50:42.416164 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 15:50:42.417303 26386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:42.403009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:36537 (local address 127.8.39.65:53265)
0808 15:50:42.403643 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:42.403714 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:42.404800 (+ 1086us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:42.405501 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:42.405508 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:42.405926 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:50:42.406471 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:42.406487 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.407487 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.407490 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:42.408415 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:42.408425 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.409045 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.409053 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:42.409237 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:42.409903 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:50:42.409922 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:50:42.411908 (+ 1986us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:50:42.414048 (+ 2140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:42.414055 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:42.414073 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:42.414390 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:42.414760 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:42.414764 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:42.414766 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:42.414957 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:42.415413 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:50:42.415421 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:50:42.415695 (+ 274us) client_negotiation.cc:769] Sending connection context
0808 15:50:42.415970 (+ 275us) client_negotiation.cc:240] Negotiation successful
0808 15:50:42.416334 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":174,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.66@KRBTEST.COM" created.
I20260808 15:50:42.419088 26384 heartbeater.cc:347] Connected to a master server at 127.8.39.126:36537
I20260808 15:50:42.419359 26384 heartbeater.cc:464] Registering TS with master...
I20260808 15:50:42.419924 26384 heartbeater.cc:511] Master 127.8.39.126:36537 requested a full tablet report, sending...
I20260808 15:50:42.421592 26187 ts_manager.cc:194] Registered new tserver with Master: c75cc55ab59e4ddb941e5a4166fd28a7 (127.8.39.65:42975)
I20260808 15:50:42.422879 26187 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.65@KRBTEST.COM'} at 127.8.39.65:53265
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
I20260808 15:50:42.439164 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:0
--local_ip_for_outbound_sockets=127.8.39.66
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:36537
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:41121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:50:42.556445 26390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:42.556770 26390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:42.556816 26390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:42.561190 26390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:42.561264 26390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:42.561358 26390 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:50:42.567081 26390 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:41121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:36537
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:42.568222 26390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:42.569286 26390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:42.579387 26396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:42.579411 26398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:42.579411 26395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:42.579766 26390 server_base.cc:1034] running on GCE node
I20260808 15:50:42.580302 26390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:42.580979 26390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:42.582185 26390 hybrid_clock.cc:648] HybridClock initialized: now 1786204242582167 us; error 28 us; skew 500 ppm
Aug 08 15:50:42 dist-test-slave-8tdl krb5kdc[26139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204242, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:50:42.585264 26390 init.cc:377] Logged in from keytab as kudu/127.8.39.66@KRBTEST.COM (short username kudu)
I20260808 15:50:42.586274 26390 webserver.cc:460] Webserver started at http://127.8.39.66:40169/ using document root <none> and password file <none>
I20260808 15:50:42.586943 26390 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:42.587060 26390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:42.587313 26390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:42.589552 26390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-1/data/instance:
uuid: "08738ef7d026482f9972da5c90898aa4"
format_stamp: "Formatted at 2026-08-08 15:50:42 on dist-test-slave-8tdl"
server_key: "9ecd0be006476d0eeef55d548e6b81d7"
server_key_iv: "8894cfb7bf476d8f4985535373dd3a4b"
server_key_version: "encryptionkey@0"
I20260808 15:50:42.590092 26390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance:
uuid: "08738ef7d026482f9972da5c90898aa4"
format_stamp: "Formatted at 2026-08-08 15:50:42 on dist-test-slave-8tdl"
server_key: "9ecd0be006476d0eeef55d548e6b81d7"
server_key_iv: "8894cfb7bf476d8f4985535373dd3a4b"
server_key_version: "encryptionkey@0"
I20260808 15:50:42.594092 26390 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 15:50:42.596724 26405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:42.598384 26390 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 15:50:42.598508 26390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "08738ef7d026482f9972da5c90898aa4"
format_stamp: "Formatted at 2026-08-08 15:50:42 on dist-test-slave-8tdl"
server_key: "9ecd0be006476d0eeef55d548e6b81d7"
server_key_iv: "8894cfb7bf476d8f4985535373dd3a4b"
server_key_version: "encryptionkey@0"
I20260808 15:50:42.598605 26390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:42.612632 26390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:42.616206 26390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:42.616405 26390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:42.617009 26390 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:50:42.617858 26390 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:50:42.617909 26390 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:42.617954 26390 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:50:42.617972 26390 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:42.628746 26390 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:40111
I20260808 15:50:42.628770 26524 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:40111 every 8 connection(s)
I20260808 15:50:42.629830 26390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:50:42.637470 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 26390
I20260808 15:50:42.637578 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance
I20260808 15:50:42.637924 8349 external_mini_cluster.cc:1428] Setting key b4e721ca2c6d4724c4df777ea441abfd
Aug 08 15:50:42 dist-test-slave-8tdl krb5kdc[26139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204242, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:50:42.646188 26228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:42.632041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:58373 (local address 127.8.39.126:36537)
0808 15:50:42.632204 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:42.632208 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:42.633192 (+ 984us) server_negotiation.cc:407] Connection header received
0808 15:50:42.634203 (+ 1011us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:42.634207 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:42.634272 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:42.634433 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:42.635810 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.636400 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.637778 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.638117 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.638249 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:42.641494 (+ 3245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:42.641499 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:42.641501 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:42.641535 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:42.643230 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:42.644063 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:42.644066 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:42.644067 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:42.644164 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:42.644669 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:42.644672 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:42.644674 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:42.644890 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:42.645072 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:42.645911 (+ 839us) server_negotiation.cc:299] Negotiation successful
0808 15:50:42.646049 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 15:50:42.647679 26527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:42.632445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:36537 (local address 127.8.39.66:58373)
0808 15:50:42.633010 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:42.633059 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:42.633973 (+ 914us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:42.634615 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:42.634623 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:42.635128 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:50:42.635644 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:42.635658 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.636549 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.636558 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:42.637632 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:42.637649 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.638300 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.638305 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:42.638545 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:42.639409 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:50:42.639441 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:50:42.641305 (+ 1864us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:50:42.643373 (+ 2068us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:42.643383 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:42.643406 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:42.643862 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:42.644309 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:42.644315 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:42.644321 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:42.644547 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:42.645097 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:50:42.645109 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:50:42.645541 (+ 432us) client_negotiation.cc:769] Sending connection context
0808 15:50:42.645817 (+ 276us) client_negotiation.cc:240] Negotiation successful
0808 15:50:42.646288 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":127,"threads_started":1}
I20260808 15:50:42.649163 26525 heartbeater.cc:347] Connected to a master server at 127.8.39.126:36537
I20260808 15:50:42.649466 26525 heartbeater.cc:464] Registering TS with master...
I20260808 15:50:42.650190 26525 heartbeater.cc:511] Master 127.8.39.126:36537 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.8.39.67@KRBTEST.COM; defaulting to no policy
I20260808 15:50:42.651700 26187 ts_manager.cc:194] Registered new tserver with Master: 08738ef7d026482f9972da5c90898aa4 (127.8.39.66:40111)
I20260808 15:50:42.652406 26187 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.66@KRBTEST.COM'} at 127.8.39.66:58373
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
I20260808 15:50:42.674053 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:0
--local_ip_for_outbound_sockets=127.8.39.67
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:36537
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:41121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:50:42.793591 26530 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:42.793895 26530 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:42.793942 26530 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:42.798243 26530 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:42.798318 26530 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:42.798425 26530 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:50:42.804356 26530 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:41121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:36537
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26530
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:42.805552 26530 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:42.806697 26530 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:42.817135 26538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:42.817111 26535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:42.817157 26536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:42.817761 26530 server_base.cc:1034] running on GCE node
I20260808 15:50:42.818394 26530 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:42.819325 26530 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:42.820544 26530 hybrid_clock.cc:648] HybridClock initialized: now 1786204242820509 us; error 58 us; skew 500 ppm
Aug 08 15:50:42 dist-test-slave-8tdl krb5kdc[26139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204242, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:50:42.823817 26530 init.cc:377] Logged in from keytab as kudu/127.8.39.67@KRBTEST.COM (short username kudu)
I20260808 15:50:42.824807 26530 webserver.cc:460] Webserver started at http://127.8.39.67:36765/ using document root <none> and password file <none>
I20260808 15:50:42.825453 26530 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:42.825551 26530 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:42.825788 26530 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:42.828047 26530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-2/data/instance:
uuid: "f88d89a3770049269bdf7e223df0d932"
format_stamp: "Formatted at 2026-08-08 15:50:42 on dist-test-slave-8tdl"
server_key: "d131442c180f4cf2ea75b7638ef41bf1"
server_key_iv: "b4a4e598de325381696b8d9fb78ed97a"
server_key_version: "encryptionkey@0"
I20260808 15:50:42.828639 26530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance:
uuid: "f88d89a3770049269bdf7e223df0d932"
format_stamp: "Formatted at 2026-08-08 15:50:42 on dist-test-slave-8tdl"
server_key: "d131442c180f4cf2ea75b7638ef41bf1"
server_key_iv: "b4a4e598de325381696b8d9fb78ed97a"
server_key_version: "encryptionkey@0"
I20260808 15:50:42.832788 26530 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 15:50:42.835491 26546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:42.836910 26530 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:50:42.837077 26530 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "f88d89a3770049269bdf7e223df0d932"
format_stamp: "Formatted at 2026-08-08 15:50:42 on dist-test-slave-8tdl"
server_key: "d131442c180f4cf2ea75b7638ef41bf1"
server_key_iv: "b4a4e598de325381696b8d9fb78ed97a"
server_key_version: "encryptionkey@0"
I20260808 15:50:42.837216 26530 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:42.857890 26530 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:42.861550 26530 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:42.861793 26530 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:42.862514 26530 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:50:42.863492 26530 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:50:42.863574 26530 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:42.863646 26530 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:50:42.863694 26530 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:42.874116 26530 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:40323
I20260808 15:50:42.874140 26663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:40323 every 8 connection(s)
I20260808 15:50:42.875288 26530 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:50:42.883008 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 26530
I20260808 15:50:42.883138 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance
I20260808 15:50:42.883464 8349 external_mini_cluster.cc:1428] Setting key fb1b6e06322566d8c05f9d49a4de31db
Aug 08 15:50:42 dist-test-slave-8tdl krb5kdc[26139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204242, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:50:42.890723 26228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:42.877358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:36689 (local address 127.8.39.126:36537)
0808 15:50:42.877518 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:42.877522 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:42.878654 (+ 1132us) server_negotiation.cc:407] Connection header received
0808 15:50:42.879721 (+ 1067us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:42.879724 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:42.879792 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:42.879911 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:42.881331 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.881935 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.883459 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.883793 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.883927 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:42.886890 (+ 2963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:42.886893 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:42.886895 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:42.886921 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:42.888568 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:42.889159 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:42.889162 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:42.889163 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:42.889242 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:42.889586 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:42.889588 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:42.889589 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:42.889783 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:42.889860 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:42.890437 (+ 577us) server_negotiation.cc:299] Negotiation successful
0808 15:50:42.890551 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 15:50:42.891736 26666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:42.877704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:36537 (local address 127.8.39.67:36689)
0808 15:50:42.878436 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:42.878512 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:42.879480 (+ 968us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:42.880104 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:42.880111 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:42.880526 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:50:42.881162 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:42.881177 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.882094 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.882100 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:42.883310 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:42.883323 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.883983 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.883988 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:42.884198 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:42.884913 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:50:42.884932 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:50:42.886653 (+ 1721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:50:42.888719 (+ 2066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:42.888724 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:42.888745 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:42.889052 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:42.889324 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:42.889326 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:42.889327 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:42.889480 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:42.889940 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:50:42.889945 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:50:42.890208 (+ 263us) client_negotiation.cc:769] Sending connection context
0808 15:50:42.890371 (+ 163us) client_negotiation.cc:240] Negotiation successful
0808 15:50:42.890664 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":125,"threads_started":1}
I20260808 15:50:42.892999 26664 heartbeater.cc:347] Connected to a master server at 127.8.39.126:36537
I20260808 15:50:42.893270 26664 heartbeater.cc:464] Registering TS with master...
I20260808 15:50:42.893833 26664 heartbeater.cc:511] Master 127.8.39.126:36537 requested a full tablet report, sending...
I20260808 15:50:42.895066 26187 ts_manager.cc:194] Registered new tserver with Master: f88d89a3770049269bdf7e223df0d932 (127.8.39.67:40323)
I20260808 15:50:42.895684 26187 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.67@KRBTEST.COM'} at 127.8.39.67:36689
I20260808 15:50:42.897774 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:50:42.908839 26228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:42.900085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51952 (local address 127.8.39.126:36537)
0808 15:50:42.900298 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:42.900305 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:42.900501 (+ 196us) server_negotiation.cc:407] Connection header received
0808 15:50:42.900623 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:42.900625 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:42.900662 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:42.900728 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:42.901768 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.902378 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.903383 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.903670 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.903754 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:42.905427 (+ 1673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:42.905430 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:42.905432 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:42.905456 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:42.907036 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:42.907521 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:42.907524 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:42.907525 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:42.907601 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:42.907881 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:42.907884 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:42.907885 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:42.908141 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:42.908253 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:42.908546 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 15:50:42.908647 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126}
I20260808 15:50:42.912194 26187 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51952:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:50:42.915452 26187 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:50:42.931214 26675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:42.925015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:40111 (local address 127.0.0.1:58192)
0808 15:50:42.925387 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:42.925436 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:42.925571 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:42.927088 (+ 1517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:42.927095 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:42.927120 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:42.927287 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:42.927297 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.928422 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.928428 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:42.929684 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:42.929693 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.930546 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.930550 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:42.930664 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:42.930760 (+ 96us) client_negotiation.cc:769] Sending connection context
0808 15:50:42.930895 (+ 135us) client_negotiation.cc:240] Negotiation successful
0808 15:50:42.931038 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":94,"threads_started":1}
I20260808 15:50:42.931221 26678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:42.925148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58192 (local address 127.8.39.66:40111)
0808 15:50:42.926365 (+ 1217us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:42.926380 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:42.926407 (+ 27us) server_negotiation.cc:407] Connection header received
0808 15:50:42.926536 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:42.926543 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:42.926833 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:42.927008 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:42.927452 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.928278 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.929815 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.930409 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.930541 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:42.930728 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:42.930929 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 15:50:42.931038 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1069,"thread_start_us":156,"threads_started":1}
I20260808 15:50:42.932927 26677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:42.925043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:42975 (local address 127.0.0.1:58640)
0808 15:50:42.925928 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:42.925944 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:42.926051 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:42.927187 (+ 1136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:42.927191 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:42.927209 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:42.927459 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:42.927469 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.929069 (+ 1600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.929073 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:42.930807 (+ 1734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:42.930819 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.932352 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.932356 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:42.932512 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:42.932570 (+ 58us) client_negotiation.cc:769] Sending connection context
0808 15:50:42.932652 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 15:50:42.932761 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":817,"mutex_wait_us":368,"thread_start_us":122,"threads_started":1}
I20260808 15:50:42.933090 26681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:42.925930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34070 (local address 127.8.39.67:40323)
0808 15:50:42.926787 (+ 857us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:42.926803 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:42.926824 (+ 21us) server_negotiation.cc:407] Connection header received
0808 15:50:42.926898 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:42.926906 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:42.927080 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:42.927214 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:42.927519 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.928894 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.930984 (+ 2090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.931916 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.932055 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:42.932230 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:42.932754 (+ 524us) server_negotiation.cc:299] Negotiation successful
0808 15:50:42.932861 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":760,"thread_start_us":165,"threads_started":1}
I20260808 15:50:42.933439 26679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:42.925755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:40323 (local address 127.0.0.1:34070)
0808 15:50:42.926404 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:42.926426 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:42.926517 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:42.927218 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:42.927221 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:42.927236 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:42.927395 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:42.927405 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.929069 (+ 1664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.929073 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:42.930807 (+ 1734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:42.930819 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.932309 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.932316 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:42.932474 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:42.932570 (+ 96us) client_negotiation.cc:769] Sending connection context
0808 15:50:42.932651 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 15:50:42.933315 (+ 664us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"mutex_wait_us":840,"thread_start_us":110,"threads_started":1}
I20260808 15:50:42.933694 26680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:42.925878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58640 (local address 127.8.39.65:42975)
0808 15:50:42.926424 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:42.926433 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:42.926460 (+ 27us) server_negotiation.cc:407] Connection header received
0808 15:50:42.926553 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:42.926561 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:42.926821 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:42.927006 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:42.927594 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.928894 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.930977 (+ 2083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:42.932064 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:42.932169 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:42.932296 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:42.933306 (+ 1010us) server_negotiation.cc:299] Negotiation successful
0808 15:50:42.933413 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":102,"threads_started":1}
I20260808 15:50:42.934749 26457 tablet_service.cc:1467] Processing CreateTablet for tablet c9ac013db1e644d3bbabd28c52f60dc4 (DEFAULT_TABLE table=test-table [id=9fa5f87c43884b8aab04e076fba61f75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:50:42.935963 26457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9ac013db1e644d3bbabd28c52f60dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:42.936517 26316 tablet_service.cc:1467] Processing CreateTablet for tablet c9ac013db1e644d3bbabd28c52f60dc4 (DEFAULT_TABLE table=test-table [id=9fa5f87c43884b8aab04e076fba61f75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:50:42.937059 26595 tablet_service.cc:1467] Processing CreateTablet for tablet c9ac013db1e644d3bbabd28c52f60dc4 (DEFAULT_TABLE table=test-table [id=9fa5f87c43884b8aab04e076fba61f75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:50:42.937543 26316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9ac013db1e644d3bbabd28c52f60dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:42.938136 26595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9ac013db1e644d3bbabd28c52f60dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:42.943919 26682 tablet_bootstrap.cc:492] T c9ac013db1e644d3bbabd28c52f60dc4 P 08738ef7d026482f9972da5c90898aa4: Bootstrap starting.
I20260808 15:50:42.945035 26684 tablet_bootstrap.cc:492] T c9ac013db1e644d3bbabd28c52f60dc4 P c75cc55ab59e4ddb941e5a4166fd28a7: Bootstrap starting.
I20260808 15:50:42.945302 26683 tablet_bootstrap.cc:492] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932: Bootstrap starting.
I20260808 15:50:42.946976 26682 tablet_bootstrap.cc:654] T c9ac013db1e644d3bbabd28c52f60dc4 P 08738ef7d026482f9972da5c90898aa4: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:42.947492 26684 tablet_bootstrap.cc:654] T c9ac013db1e644d3bbabd28c52f60dc4 P c75cc55ab59e4ddb941e5a4166fd28a7: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:42.947515 26683 tablet_bootstrap.cc:654] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:42.947850 26682 log.cc:824] T c9ac013db1e644d3bbabd28c52f60dc4 P 08738ef7d026482f9972da5c90898aa4: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:42.948808 26684 log.cc:824] T c9ac013db1e644d3bbabd28c52f60dc4 P c75cc55ab59e4ddb941e5a4166fd28a7: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:42.949319 26683 log.cc:824] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:42.950171 26682 tablet_bootstrap.cc:492] T c9ac013db1e644d3bbabd28c52f60dc4 P 08738ef7d026482f9972da5c90898aa4: No bootstrap required, opened a new log
I20260808 15:50:42.950382 26682 ts_tablet_manager.cc:1397] T c9ac013db1e644d3bbabd28c52f60dc4 P 08738ef7d026482f9972da5c90898aa4: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.003s
I20260808 15:50:42.951184 26684 tablet_bootstrap.cc:492] T c9ac013db1e644d3bbabd28c52f60dc4 P c75cc55ab59e4ddb941e5a4166fd28a7: No bootstrap required, opened a new log
I20260808 15:50:42.951416 26684 ts_tablet_manager.cc:1397] T c9ac013db1e644d3bbabd28c52f60dc4 P c75cc55ab59e4ddb941e5a4166fd28a7: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 15:50:42.951653 26683 tablet_bootstrap.cc:492] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932: No bootstrap required, opened a new log
I20260808 15:50:42.951841 26683 ts_tablet_manager.cc:1397] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260808 15:50:42.953715 26682 raft_consensus.cc:348] T c9ac013db1e644d3bbabd28c52f60dc4 P 08738ef7d026482f9972da5c90898aa4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08738ef7d026482f9972da5c90898aa4" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40111 } } peers { permanent_uuid: "c75cc55ab59e4ddb941e5a4166fd28a7" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 42975 } } peers { permanent_uuid: "f88d89a3770049269bdf7e223df0d932" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 40323 } }
I20260808 15:50:42.953989 26682 raft_consensus.cc:374] T c9ac013db1e644d3bbabd28c52f60dc4 P 08738ef7d026482f9972da5c90898aa4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:42.954044 26682 raft_consensus.cc:729] T c9ac013db1e644d3bbabd28c52f60dc4 P 08738ef7d026482f9972da5c90898aa4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08738ef7d026482f9972da5c90898aa4, State: Initialized, Role: FOLLOWER
I20260808 15:50:42.954507 26682 consensus_queue.cc:260] T c9ac013db1e644d3bbabd28c52f60dc4 P 08738ef7d026482f9972da5c90898aa4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08738ef7d026482f9972da5c90898aa4" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40111 } } peers { permanent_uuid: "c75cc55ab59e4ddb941e5a4166fd28a7" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 42975 } } peers { permanent_uuid: "f88d89a3770049269bdf7e223df0d932" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 40323 } }
I20260808 15:50:42.955255 26525 heartbeater.cc:503] Master 127.8.39.126:36537 was elected leader, sending a full tablet report...
I20260808 15:50:42.955556 26682 ts_tablet_manager.cc:1428] T c9ac013db1e644d3bbabd28c52f60dc4 P 08738ef7d026482f9972da5c90898aa4: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
I20260808 15:50:42.956305 26683 raft_consensus.cc:348] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08738ef7d026482f9972da5c90898aa4" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40111 } } peers { permanent_uuid: "c75cc55ab59e4ddb941e5a4166fd28a7" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 42975 } } peers { permanent_uuid: "f88d89a3770049269bdf7e223df0d932" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 40323 } }
I20260808 15:50:42.956641 26683 raft_consensus.cc:374] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:42.956717 26683 raft_consensus.cc:729] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f88d89a3770049269bdf7e223df0d932, State: Initialized, Role: FOLLOWER
I20260808 15:50:42.957216 26683 consensus_queue.cc:260] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08738ef7d026482f9972da5c90898aa4" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40111 } } peers { permanent_uuid: "c75cc55ab59e4ddb941e5a4166fd28a7" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 42975 } } peers { permanent_uuid: "f88d89a3770049269bdf7e223df0d932" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 40323 } }
I20260808 15:50:42.957949 26664 heartbeater.cc:503] Master 127.8.39.126:36537 was elected leader, sending a full tablet report...
I20260808 15:50:42.958453 26683 ts_tablet_manager.cc:1428] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260808 15:50:42.960457 26684 raft_consensus.cc:348] T c9ac013db1e644d3bbabd28c52f60dc4 P c75cc55ab59e4ddb941e5a4166fd28a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08738ef7d026482f9972da5c90898aa4" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40111 } } peers { permanent_uuid: "c75cc55ab59e4ddb941e5a4166fd28a7" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 42975 } } peers { permanent_uuid: "f88d89a3770049269bdf7e223df0d932" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 40323 } }
I20260808 15:50:42.960793 26684 raft_consensus.cc:374] T c9ac013db1e644d3bbabd28c52f60dc4 P c75cc55ab59e4ddb941e5a4166fd28a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:42.960867 26684 raft_consensus.cc:729] T c9ac013db1e644d3bbabd28c52f60dc4 P c75cc55ab59e4ddb941e5a4166fd28a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c75cc55ab59e4ddb941e5a4166fd28a7, State: Initialized, Role: FOLLOWER
I20260808 15:50:42.961397 26684 consensus_queue.cc:260] T c9ac013db1e644d3bbabd28c52f60dc4 P c75cc55ab59e4ddb941e5a4166fd28a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08738ef7d026482f9972da5c90898aa4" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40111 } } peers { permanent_uuid: "c75cc55ab59e4ddb941e5a4166fd28a7" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 42975 } } peers { permanent_uuid: "f88d89a3770049269bdf7e223df0d932" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 40323 } }
I20260808 15:50:42.962150 26384 heartbeater.cc:503] Master 127.8.39.126:36537 was elected leader, sending a full tablet report...
I20260808 15:50:42.962600 26684 ts_tablet_manager.cc:1428] T c9ac013db1e644d3bbabd28c52f60dc4 P c75cc55ab59e4ddb941e5a4166fd28a7: Time spent starting tablet: real 0.011s user 0.007s sys 0.000s
I20260808 15:50:43.105850 26689 raft_consensus.cc:482] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:50:43.106101 26689 raft_consensus.cc:504] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08738ef7d026482f9972da5c90898aa4" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40111 } } peers { permanent_uuid: "c75cc55ab59e4ddb941e5a4166fd28a7" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 42975 } } peers { permanent_uuid: "f88d89a3770049269bdf7e223df0d932" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 40323 } }
I20260808 15:50:43.107632 26689 leader_election.cc:288] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08738ef7d026482f9972da5c90898aa4 (127.8.39.66:40111), c75cc55ab59e4ddb941e5a4166fd28a7 (127.8.39.65:42975)
I20260808 15:50:43.111446 26666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:43.107987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:40111 (local address 127.8.39.67:38713)
0808 15:50:43.108118 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:43.108135 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:43.108248 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:43.108526 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:43.108529 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:43.108548 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:43.108675 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:43.108681 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:43.109430 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:43.109435 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:43.110256 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:43.110264 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:43.110976 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:43.110980 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:43.111107 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:43.111135 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 15:50:43.111235 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 15:50:43.111309 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 15:50:43.111454 26678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:43.108093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:38713 (local address 127.8.39.66:40111)
0808 15:50:43.108219 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:43.108224 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:43.108240 (+ 16us) server_negotiation.cc:407] Connection header received
0808 15:50:43.108368 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:43.108371 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:43.108425 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:43.108510 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:43.108788 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:43.109317 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:43.110393 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:43.110855 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:43.110969 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:43.111043 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:43.111254 (+ 211us) server_negotiation.cc:299] Negotiation successful
0808 15:50:43.111323 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 15:50:43.111838 26680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:43.108115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:43589 (local address 127.8.39.65:42975)
0808 15:50:43.108266 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:43.108273 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:43.108637 (+ 364us) server_negotiation.cc:407] Connection header received
0808 15:50:43.108765 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:43.108768 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:43.108812 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:43.108971 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:43.109240 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:43.109738 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:43.110817 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:43.111249 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:43.111369 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:43.111427 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:43.111637 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 15:50:43.111716 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 15:50:43.112226 26691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:43.107983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:42975 (local address 127.8.39.67:43589)
0808 15:50:43.108529 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:43.108541 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:43.108670 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:43.108977 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:43.108980 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:43.108996 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:43.109113 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:43.109120 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:43.109851 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:43.109854 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:43.110647 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:43.110655 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:43.111380 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:43.111383 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:43.111482 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:43.111505 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 15:50:43.111999 (+ 494us) client_negotiation.cc:240] Negotiation successful
0808 15:50:43.112073 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"mutex_wait_us":128,"thread_start_us":164,"threads_started":1}
I20260808 15:50:43.112450 26478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9ac013db1e644d3bbabd28c52f60dc4" candidate_uuid: "f88d89a3770049269bdf7e223df0d932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08738ef7d026482f9972da5c90898aa4" is_pre_election: true
I20260808 15:50:43.112787 26478 raft_consensus.cc:2454] T c9ac013db1e644d3bbabd28c52f60dc4 P 08738ef7d026482f9972da5c90898aa4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f88d89a3770049269bdf7e223df0d932 in term 0.
I20260808 15:50:43.112793 26336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9ac013db1e644d3bbabd28c52f60dc4" candidate_uuid: "f88d89a3770049269bdf7e223df0d932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c75cc55ab59e4ddb941e5a4166fd28a7" is_pre_election: true
I20260808 15:50:43.113071 26336 raft_consensus.cc:2454] T c9ac013db1e644d3bbabd28c52f60dc4 P c75cc55ab59e4ddb941e5a4166fd28a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f88d89a3770049269bdf7e223df0d932 in term 0.
I20260808 15:50:43.113313 26550 leader_election.cc:302] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08738ef7d026482f9972da5c90898aa4, f88d89a3770049269bdf7e223df0d932; no voters:
I20260808 15:50:43.113596 26689 raft_consensus.cc:2781] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:50:43.113696 26689 raft_consensus.cc:482] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:50:43.113756 26689 raft_consensus.cc:3037] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:43.114884 26689 raft_consensus.cc:504] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08738ef7d026482f9972da5c90898aa4" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40111 } } peers { permanent_uuid: "c75cc55ab59e4ddb941e5a4166fd28a7" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 42975 } } peers { permanent_uuid: "f88d89a3770049269bdf7e223df0d932" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 40323 } }
I20260808 15:50:43.115238 26689 leader_election.cc:288] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932 [CANDIDATE]: Term 1 election: Requested vote from peers 08738ef7d026482f9972da5c90898aa4 (127.8.39.66:40111), c75cc55ab59e4ddb941e5a4166fd28a7 (127.8.39.65:42975)
I20260808 15:50:43.115653 26336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9ac013db1e644d3bbabd28c52f60dc4" candidate_uuid: "f88d89a3770049269bdf7e223df0d932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c75cc55ab59e4ddb941e5a4166fd28a7"
I20260808 15:50:43.115764 26336 raft_consensus.cc:3037] T c9ac013db1e644d3bbabd28c52f60dc4 P c75cc55ab59e4ddb941e5a4166fd28a7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:43.116847 26336 raft_consensus.cc:2454] T c9ac013db1e644d3bbabd28c52f60dc4 P c75cc55ab59e4ddb941e5a4166fd28a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88d89a3770049269bdf7e223df0d932 in term 1.
I20260808 15:50:43.117144 26549 leader_election.cc:302] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c75cc55ab59e4ddb941e5a4166fd28a7, f88d89a3770049269bdf7e223df0d932; no voters:
I20260808 15:50:43.117125 26478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9ac013db1e644d3bbabd28c52f60dc4" candidate_uuid: "f88d89a3770049269bdf7e223df0d932" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08738ef7d026482f9972da5c90898aa4"
I20260808 15:50:43.117316 26689 raft_consensus.cc:2781] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:50:43.117287 26478 raft_consensus.cc:3037] T c9ac013db1e644d3bbabd28c52f60dc4 P 08738ef7d026482f9972da5c90898aa4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:43.117558 26689 raft_consensus.cc:686] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932 [term 1 LEADER]: Becoming Leader. State: Replica: f88d89a3770049269bdf7e223df0d932, State: Running, Role: LEADER
I20260808 15:50:43.117906 26689 consensus_queue.cc:237] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08738ef7d026482f9972da5c90898aa4" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40111 } } peers { permanent_uuid: "c75cc55ab59e4ddb941e5a4166fd28a7" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 42975 } } peers { permanent_uuid: "f88d89a3770049269bdf7e223df0d932" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 40323 } }
I20260808 15:50:43.118498 26478 raft_consensus.cc:2454] T c9ac013db1e644d3bbabd28c52f60dc4 P 08738ef7d026482f9972da5c90898aa4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88d89a3770049269bdf7e223df0d932 in term 1.
I20260808 15:50:43.121160 26187 catalog_manager.cc:5495] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932 reported cstate change: term changed from 0 to 1, leader changed from <none> to f88d89a3770049269bdf7e223df0d932 (127.8.39.67). New cstate: current_term: 1 leader_uuid: "f88d89a3770049269bdf7e223df0d932" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08738ef7d026482f9972da5c90898aa4" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c75cc55ab59e4ddb941e5a4166fd28a7" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f88d89a3770049269bdf7e223df0d932" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 40323 } health_report { overall_health: HEALTHY } } }
W20260808 15:50:43.126365 26665 tablet.cc:2369] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:50:43.131147 26526 tablet.cc:2369] T c9ac013db1e644d3bbabd28c52f60dc4 P 08738ef7d026482f9972da5c90898aa4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:50:43.151926 26385 tablet.cc:2369] T c9ac013db1e644d3bbabd28c52f60dc4 P c75cc55ab59e4ddb941e5a4166fd28a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:50:43.177595 26681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:43.173758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34086 (local address 127.8.39.67:40323)
0808 15:50:43.173984 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:43.173990 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:43.174007 (+ 17us) server_negotiation.cc:407] Connection header received
0808 15:50:43.174099 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:43.174101 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:43.174158 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:43.174277 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:50:43.174551 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:43.175112 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:43.176007 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:43.176234 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:43.176359 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:43.176686 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:50:43.177142 (+ 456us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:50:43.177280 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:43.177355 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 15:50:43.177417 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 15:50:43.183991 26478 raft_consensus.cc:1261] T c9ac013db1e644d3bbabd28c52f60dc4 P 08738ef7d026482f9972da5c90898aa4 [term 1 FOLLOWER]: Refusing update from remote peer f88d89a3770049269bdf7e223df0d932: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:50:43.184037 26336 raft_consensus.cc:1261] T c9ac013db1e644d3bbabd28c52f60dc4 P c75cc55ab59e4ddb941e5a4166fd28a7 [term 1 FOLLOWER]: Refusing update from remote peer f88d89a3770049269bdf7e223df0d932: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:50:43.184739 26689 consensus_queue.cc:1035] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c75cc55ab59e4ddb941e5a4166fd28a7" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:50:43.184959 26692 consensus_queue.cc:1035] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08738ef7d026482f9972da5c90898aa4" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:50:43.195020 26696 mvcc.cc:205] Tried to move back new op lower bound from 7316292580073095168 to 7316292579814240256. Current Snapshot: MvccSnapshot[applied={T|T < 7316292580073095168}]
I20260808 15:50:43.202137 26187 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51952:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:50:43.202303 26187 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51952:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:50:43.204772 26187 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5fbace8c80e8409c96856871cbd515ed: Sending DeleteTablet for 3 replicas of tablet c9ac013db1e644d3bbabd28c52f60dc4
I20260808 15:50:43.205576 26457 tablet_service.cc:1514] Processing DeleteTablet for tablet c9ac013db1e644d3bbabd28c52f60dc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:50:43 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:58192
I20260808 15:50:43.205646 26595 tablet_service.cc:1514] Processing DeleteTablet for tablet c9ac013db1e644d3bbabd28c52f60dc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:50:43 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:34070
I20260808 15:50:43.205909 26316 tablet_service.cc:1514] Processing DeleteTablet for tablet c9ac013db1e644d3bbabd28c52f60dc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:50:43 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:58640
I20260808 15:50:43.206096 26706 tablet_replica.cc:330] T c9ac013db1e644d3bbabd28c52f60dc4 P 08738ef7d026482f9972da5c90898aa4: stopping tablet replica
I20260808 15:50:43.206406 26706 raft_consensus.cc:2229] T c9ac013db1e644d3bbabd28c52f60dc4 P 08738ef7d026482f9972da5c90898aa4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:50:43.206431 26707 tablet_replica.cc:330] T c9ac013db1e644d3bbabd28c52f60dc4 P c75cc55ab59e4ddb941e5a4166fd28a7: stopping tablet replica
I20260808 15:50:43.206719 26707 raft_consensus.cc:2229] T c9ac013db1e644d3bbabd28c52f60dc4 P c75cc55ab59e4ddb941e5a4166fd28a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:50:43.206782 26706 raft_consensus.cc:2258] T c9ac013db1e644d3bbabd28c52f60dc4 P 08738ef7d026482f9972da5c90898aa4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:50:43.207193 26707 raft_consensus.cc:2258] T c9ac013db1e644d3bbabd28c52f60dc4 P c75cc55ab59e4ddb941e5a4166fd28a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:50:43.207269 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 26252
I20260808 15:50:43.207159 26705 tablet_replica.cc:330] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932: stopping tablet replica
I20260808 15:50:43.212954 26705 raft_consensus.cc:2229] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:50:43.213382 26705 raft_consensus.cc:2258] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:50:43.214990 26706 ts_tablet_manager.cc:1905] T c9ac013db1e644d3bbabd28c52f60dc4 P 08738ef7d026482f9972da5c90898aa4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:50:43.217336 26706 ts_tablet_manager.cc:1918] T c9ac013db1e644d3bbabd28c52f60dc4 P 08738ef7d026482f9972da5c90898aa4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:50:43.217483 26706 log.cc:1196] T c9ac013db1e644d3bbabd28c52f60dc4 P 08738ef7d026482f9972da5c90898aa4: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-1/wal/wals/c9ac013db1e644d3bbabd28c52f60dc4
I20260808 15:50:43.217844 26706 ts_tablet_manager.cc:1939] T c9ac013db1e644d3bbabd28c52f60dc4 P 08738ef7d026482f9972da5c90898aa4: Deleting consensus metadata
I20260808 15:50:43.218825 26705 ts_tablet_manager.cc:1905] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 15:50:43.218807 26172 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.39.65:42975 (error 108)
I20260808 15:50:43.219244 26173 catalog_manager.cc:4841] TS 08738ef7d026482f9972da5c90898aa4 (127.8.39.66:40111): tablet c9ac013db1e644d3bbabd28c52f60dc4 (table test-table [id=9fa5f87c43884b8aab04e076fba61f75]) successfully deleted
I20260808 15:50:43.219744 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 26390
I20260808 15:50:43.224790 26675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:43.224418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:42975 (local address 127.0.0.1:58650)
0808 15:50:43.224577 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:43.224672 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.65:42975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 15:50:43.224985 26172 catalog_manager.cc:4584] TS c75cc55ab59e4ddb941e5a4166fd28a7 (127.8.39.65:42975): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c9ac013db1e644d3bbabd28c52f60dc4: Network error: Client connection negotiation failed: client connection to 127.8.39.65:42975: connect: Connection refused (error 111)
I20260808 15:50:43.226157 26705 ts_tablet_manager.cc:1918] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:50:43.226301 26705 log.cc:1196] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/c9ac013db1e644d3bbabd28c52f60dc4
I20260808 15:50:43.226730 26705 ts_tablet_manager.cc:1939] T c9ac013db1e644d3bbabd28c52f60dc4 P f88d89a3770049269bdf7e223df0d932: Deleting consensus metadata
I20260808 15:50:43.228202 26172 catalog_manager.cc:4841] TS f88d89a3770049269bdf7e223df0d932 (127.8.39.67:40323): tablet c9ac013db1e644d3bbabd28c52f60dc4 (table test-table [id=9fa5f87c43884b8aab04e076fba61f75]) successfully deleted
I20260808 15:50:43.229846 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 26530
I20260808 15:50:43.236873 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 26153
2026-08-08T15:50:43Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2635 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T15:50:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:50:43Z Disabled control of system clock
I20260808 15:50:43.271598 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:41623
--webserver_interface=127.8.39.126
--webserver_port=0
--builtin_ntp_servers=127.8.39.84:44549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:41623
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 15:50:43.392882 26712 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:43.393234 26712 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:43.393322 26712 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:43.398186 26712 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:50:43.398262 26712 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:43.398278 26712 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:43.398298 26712 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:50:43.398316 26712 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:50:43.403627 26712 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:44549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:41623
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:41623
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26712
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:43.404983 26712 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:43.406531 26712 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:43.415884 26717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:43.415887 26718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:43.415927 26712 server_base.cc:1034] running on GCE node
W20260808 15:50:43.415884 26720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:43.416759 26712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:43.417965 26712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:43.419167 26712 hybrid_clock.cc:648] HybridClock initialized: now 1786204243419155 us; error 34 us; skew 500 ppm
I20260808 15:50:43.421343 26712 webserver.cc:460] Webserver started at http://127.8.39.126:43301/ using document root <none> and password file <none>
I20260808 15:50:43.421993 26712 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:43.422098 26712 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:43.422354 26712 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:43.424657 26712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "c53fa0c94ccc41e996606cf4883788c9"
format_stamp: "Formatted at 2026-08-08 15:50:43 on dist-test-slave-8tdl"
server_key: "c1674a1a344350c28b504ad57eda0e95"
server_key_iv: "d13949480b5005c8e559cd5ba9469502"
server_key_version: "encryptionkey@0"
I20260808 15:50:43.425264 26712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "c53fa0c94ccc41e996606cf4883788c9"
format_stamp: "Formatted at 2026-08-08 15:50:43 on dist-test-slave-8tdl"
server_key: "c1674a1a344350c28b504ad57eda0e95"
server_key_iv: "d13949480b5005c8e559cd5ba9469502"
server_key_version: "encryptionkey@0"
I20260808 15:50:43.429304 26712 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 15:50:43.431988 26726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:43.433341 26712 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 15:50:43.433514 26712 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "c53fa0c94ccc41e996606cf4883788c9"
format_stamp: "Formatted at 2026-08-08 15:50:43 on dist-test-slave-8tdl"
server_key: "c1674a1a344350c28b504ad57eda0e95"
server_key_iv: "d13949480b5005c8e559cd5ba9469502"
server_key_version: "encryptionkey@0"
I20260808 15:50:43.433653 26712 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:43.450831 26712 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:43.451635 26712 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:43.451860 26712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:43.459619 26712 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:41623
I20260808 15:50:43.459640 26781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:41623 every 8 connection(s)
I20260808 15:50:43.460666 26712 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:50:43.464115 26782 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:43.469204 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 26712
I20260808 15:50:43.469374 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:50:43.469673 8349 external_mini_cluster.cc:1428] Setting key eb4d60301e697ae8a17a60ff54f024bf
I20260808 15:50:43.470319 26782 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c53fa0c94ccc41e996606cf4883788c9: Bootstrap starting.
I20260808 15:50:43.472906 26782 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c53fa0c94ccc41e996606cf4883788c9: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:43.473878 26782 log.cc:824] T 00000000000000000000000000000000 P c53fa0c94ccc41e996606cf4883788c9: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:43.476310 26782 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c53fa0c94ccc41e996606cf4883788c9: No bootstrap required, opened a new log
I20260808 15:50:43.479708 26785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:43.471224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36870 (local address 127.8.39.126:41623)
0808 15:50:43.471881 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:43.471896 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:43.471934 (+ 38us) server_negotiation.cc:407] Connection header received
0808 15:50:43.472607 (+ 673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:43.472624 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:43.473093 (+ 469us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:43.473385 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:43.473752 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:43.475062 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:43.476269 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:43.476796 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:43.476919 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:43.477829 (+ 910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:43.477834 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:43.477847 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:50:43.478278 (+ 431us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:43.478336 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:50:43.478356 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:43.478436 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:43.478611 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 15:50:43.478965 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":142,"threads_started":1}
I20260808 15:50:43.480625 26782 raft_consensus.cc:348] T 00000000000000000000000000000000 P c53fa0c94ccc41e996606cf4883788c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c53fa0c94ccc41e996606cf4883788c9" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41623 } }
I20260808 15:50:43.480861 26782 raft_consensus.cc:374] T 00000000000000000000000000000000 P c53fa0c94ccc41e996606cf4883788c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:43.480932 26782 raft_consensus.cc:729] T 00000000000000000000000000000000 P c53fa0c94ccc41e996606cf4883788c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c53fa0c94ccc41e996606cf4883788c9, State: Initialized, Role: FOLLOWER
I20260808 15:50:43.481359 26782 consensus_queue.cc:260] T 00000000000000000000000000000000 P c53fa0c94ccc41e996606cf4883788c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c53fa0c94ccc41e996606cf4883788c9" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41623 } }
I20260808 15:50:43.481491 26782 raft_consensus.cc:388] T 00000000000000000000000000000000 P c53fa0c94ccc41e996606cf4883788c9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:50:43.481580 26782 raft_consensus.cc:482] T 00000000000000000000000000000000 P c53fa0c94ccc41e996606cf4883788c9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:50:43.481725 26782 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c53fa0c94ccc41e996606cf4883788c9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:43.482770 26782 raft_consensus.cc:504] T 00000000000000000000000000000000 P c53fa0c94ccc41e996606cf4883788c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c53fa0c94ccc41e996606cf4883788c9" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41623 } }
I20260808 15:50:43.483115 26782 leader_election.cc:302] T 00000000000000000000000000000000 P c53fa0c94ccc41e996606cf4883788c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c53fa0c94ccc41e996606cf4883788c9; no voters:
I20260808 15:50:43.483433 26782 leader_election.cc:288] T 00000000000000000000000000000000 P c53fa0c94ccc41e996606cf4883788c9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:50:43.483582 26787 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c53fa0c94ccc41e996606cf4883788c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:50:43.483839 26787 raft_consensus.cc:686] T 00000000000000000000000000000000 P c53fa0c94ccc41e996606cf4883788c9 [term 1 LEADER]: Becoming Leader. State: Replica: c53fa0c94ccc41e996606cf4883788c9, State: Running, Role: LEADER
I20260808 15:50:43.484158 26787 consensus_queue.cc:237] T 00000000000000000000000000000000 P c53fa0c94ccc41e996606cf4883788c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c53fa0c94ccc41e996606cf4883788c9" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41623 } }
I20260808 15:50:43.484722 26782 sys_catalog.cc:564] T 00000000000000000000000000000000 P c53fa0c94ccc41e996606cf4883788c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:50:43.485833 26789 sys_catalog.cc:455] T 00000000000000000000000000000000 P c53fa0c94ccc41e996606cf4883788c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c53fa0c94ccc41e996606cf4883788c9. Latest consensus state: current_term: 1 leader_uuid: "c53fa0c94ccc41e996606cf4883788c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c53fa0c94ccc41e996606cf4883788c9" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41623 } } }
I20260808 15:50:43.485961 26789 sys_catalog.cc:458] T 00000000000000000000000000000000 P c53fa0c94ccc41e996606cf4883788c9 [sys.catalog]: This master's current role is: LEADER
I20260808 15:50:43.486371 26788 sys_catalog.cc:455] T 00000000000000000000000000000000 P c53fa0c94ccc41e996606cf4883788c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c53fa0c94ccc41e996606cf4883788c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c53fa0c94ccc41e996606cf4883788c9" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41623 } } }
I20260808 15:50:43.486549 26788 sys_catalog.cc:458] T 00000000000000000000000000000000 P c53fa0c94ccc41e996606cf4883788c9 [sys.catalog]: This master's current role is: LEADER
I20260808 15:50:43.487353 26796 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:50:43.490247 26796 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:50:43.496265 26796 catalog_manager.cc:1347] Generated new cluster ID: 2ab133329e134a269a887969d8a5409f
I20260808 15:50:43.496366 26796 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:50:43.535007 26796 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:50:43.536314 26796 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:50:43.542225 26796 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c53fa0c94ccc41e996606cf4883788c9: Generated new TSK 0
I20260808 15:50:43.543133 26796 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:50:43.560619 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:0
--local_ip_for_outbound_sockets=127.8.39.65
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41623
--builtin_ntp_servers=127.8.39.84:44549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 15:50:43.685318 26806 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:43.685727 26806 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:43.685806 26806 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:43.690234 26806 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:43.690327 26806 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:43.690421 26806 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:50:43.695326 26806 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:44549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41623
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26806
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:43.696502 26806 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:43.697933 26806 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:43.707886 26814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:43.707945 26806 server_base.cc:1034] running on GCE node
W20260808 15:50:43.707906 26811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:43.707904 26812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:43.708518 26806 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:43.709244 26806 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:43.710445 26806 hybrid_clock.cc:648] HybridClock initialized: now 1786204243710420 us; error 36 us; skew 500 ppm
I20260808 15:50:43.712472 26806 webserver.cc:460] Webserver started at http://127.8.39.65:38773/ using document root <none> and password file <none>
I20260808 15:50:43.713070 26806 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:43.713163 26806 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:43.713387 26806 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:43.715607 26806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-0/data/instance:
uuid: "0634c8d9f00c4da78bf47542dacf52b6"
format_stamp: "Formatted at 2026-08-08 15:50:43 on dist-test-slave-8tdl"
server_key: "cc1d595c7ba68a89f04010d052ff7b66"
server_key_iv: "401cb24c330739b9cb36fc7dafe9224d"
server_key_version: "encryptionkey@0"
I20260808 15:50:43.716198 26806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance:
uuid: "0634c8d9f00c4da78bf47542dacf52b6"
format_stamp: "Formatted at 2026-08-08 15:50:43 on dist-test-slave-8tdl"
server_key: "cc1d595c7ba68a89f04010d052ff7b66"
server_key_iv: "401cb24c330739b9cb36fc7dafe9224d"
server_key_version: "encryptionkey@0"
I20260808 15:50:43.720269 26806 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 15:50:43.723987 26820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:43.725618 26806 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:50:43.725746 26806 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "0634c8d9f00c4da78bf47542dacf52b6"
format_stamp: "Formatted at 2026-08-08 15:50:43 on dist-test-slave-8tdl"
server_key: "cc1d595c7ba68a89f04010d052ff7b66"
server_key_iv: "401cb24c330739b9cb36fc7dafe9224d"
server_key_version: "encryptionkey@0"
I20260808 15:50:43.725885 26806 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:43.752338 26806 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:43.753129 26806 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:43.753347 26806 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:43.753993 26806 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:50:43.755064 26806 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:50:43.755138 26806 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:43.755213 26806 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:50:43.755276 26806 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:43.764871 26806 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:45251
I20260808 15:50:43.765007 26939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:45251 every 8 connection(s)
I20260808 15:50:43.765877 26806 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:50:43.769425 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 26806
I20260808 15:50:43.769570 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance
I20260808 15:50:43.769910 8349 external_mini_cluster.cc:1428] Setting key e6377376518ca0a3da6a3afa78d5514c
I20260808 15:50:43.772171 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:0
--local_ip_for_outbound_sockets=127.8.39.66
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41623
--builtin_ntp_servers=127.8.39.84:44549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 15:50:43.776201 26785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:43.767907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:46629 (local address 127.8.39.126:41623)
0808 15:50:43.768188 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:43.768192 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:43.769231 (+ 1039us) server_negotiation.cc:407] Connection header received
0808 15:50:43.771028 (+ 1797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:43.771031 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:43.771089 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:43.771197 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:43.772213 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:43.772846 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:43.774015 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:43.774243 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:43.774354 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:43.775668 (+ 1314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:43.775672 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:43.775677 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:50:43.775697 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:43.775717 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:50:43.775725 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:43.775805 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:43.775974 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 15:50:43.776051 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176}
I20260808 15:50:43.777140 26942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:43.768356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41623 (local address 127.8.39.65:46629)
0808 15:50:43.769076 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:43.769118 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:43.770803 (+ 1685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:43.771405 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:43.771415 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:43.771540 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:50:43.772075 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:43.772088 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:43.772987 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:43.772991 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:43.773877 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:43.773886 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:43.774404 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:43.774408 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:43.774584 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:43.775365 (+ 781us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:50:43.775367 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:50:43.775410 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:50:43.775479 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:50:43.775807 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:50:43.775820 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:50:43.775829 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 15:50:43.775986 (+ 157us) client_negotiation.cc:240] Negotiation successful
0808 15:50:43.776306 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":130,"threads_started":1}
I20260808 15:50:43.778795 26940 heartbeater.cc:347] Connected to a master server at 127.8.39.126:41623
I20260808 15:50:43.779062 26940 heartbeater.cc:464] Registering TS with master...
I20260808 15:50:43.779621 26940 heartbeater.cc:511] Master 127.8.39.126:41623 requested a full tablet report, sending...
I20260808 15:50:43.781620 26743 ts_manager.cc:194] Registered new tserver with Master: 0634c8d9f00c4da78bf47542dacf52b6 (127.8.39.65:45251)
I20260808 15:50:43.783610 26743 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.39.65:46629
W20260808 15:50:43.896221 26943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:43.896557 26943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:43.896602 26943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:43.900841 26943 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:43.900903 26943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:43.900965 26943 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:50:43.906241 26943 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:44549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41623
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26943
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:43.907410 26943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:43.908793 26943 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:43.918807 26951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:43.918802 26948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:43.919137 26943 server_base.cc:1034] running on GCE node
W20260808 15:50:43.918807 26949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:43.919591 26943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:43.920291 26943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:43.921489 26943 hybrid_clock.cc:648] HybridClock initialized: now 1786204243921474 us; error 29 us; skew 500 ppm
I20260808 15:50:43.923641 26943 webserver.cc:460] Webserver started at http://127.8.39.66:42765/ using document root <none> and password file <none>
I20260808 15:50:43.924284 26943 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:43.924388 26943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:43.924651 26943 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:43.927024 26943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-1/data/instance:
uuid: "2dda51dac94a4279b5b48550dc0b5e66"
format_stamp: "Formatted at 2026-08-08 15:50:43 on dist-test-slave-8tdl"
server_key: "a0e58aaae77c4978be5361ea3fd9211c"
server_key_iv: "a60d3554188627d5025904a663fc60d3"
server_key_version: "encryptionkey@0"
I20260808 15:50:43.927659 26943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance:
uuid: "2dda51dac94a4279b5b48550dc0b5e66"
format_stamp: "Formatted at 2026-08-08 15:50:43 on dist-test-slave-8tdl"
server_key: "a0e58aaae77c4978be5361ea3fd9211c"
server_key_iv: "a60d3554188627d5025904a663fc60d3"
server_key_version: "encryptionkey@0"
I20260808 15:50:43.931879 26943 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 15:50:43.934474 26957 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:43.935910 26943 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 15:50:43.936070 26943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "2dda51dac94a4279b5b48550dc0b5e66"
format_stamp: "Formatted at 2026-08-08 15:50:43 on dist-test-slave-8tdl"
server_key: "a0e58aaae77c4978be5361ea3fd9211c"
server_key_iv: "a60d3554188627d5025904a663fc60d3"
server_key_version: "encryptionkey@0"
I20260808 15:50:43.936204 26943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:43.974653 26943 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:43.975529 26943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:43.975764 26943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:43.976434 26943 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:50:43.977500 26943 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:50:43.977578 26943 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:43.977658 26943 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:50:43.977715 26943 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:43.988077 26943 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:33993
I20260808 15:50:43.988101 27073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:33993 every 8 connection(s)
I20260808 15:50:43.989104 26943 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:50:43.991194 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 26943
I20260808 15:50:43.991326 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance
I20260808 15:50:43.991629 8349 external_mini_cluster.cc:1428] Setting key 8acfa080cd56635294794bc015f30b36
I20260808 15:50:43.993800 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:0
--local_ip_for_outbound_sockets=127.8.39.67
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41623
--builtin_ntp_servers=127.8.39.84:44549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 15:50:43.999131 26785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:43.991159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:47331 (local address 127.8.39.126:41623)
0808 15:50:43.991318 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:43.991323 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:43.992757 (+ 1434us) server_negotiation.cc:407] Connection header received
0808 15:50:43.994272 (+ 1515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:43.994275 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:43.994330 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:43.994408 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:43.995385 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:43.996013 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:43.997148 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:43.997368 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:43.997482 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:43.998614 (+ 1132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:43.998618 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:43.998621 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:50:43.998641 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:43.998658 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:50:43.998666 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:43.998772 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:43.998925 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 15:50:43.998985 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 15:50:44.000007 27076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:43.991639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41623 (local address 127.8.39.66:47331)
0808 15:50:43.992618 (+ 979us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:43.992660 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:43.994072 (+ 1412us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:43.994590 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:43.994599 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:43.994735 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:50:43.995244 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:43.995256 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:43.996144 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:43.996148 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:43.997018 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:43.997027 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:43.997521 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:43.997525 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:43.997706 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:43.998355 (+ 649us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:50:43.998356 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:50:43.998396 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:50:43.998459 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:50:43.998774 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:50:43.998786 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:50:43.998792 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 15:50:43.998924 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 15:50:43.999213 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":137,"threads_started":1}
I20260808 15:50:44.001332 27074 heartbeater.cc:347] Connected to a master server at 127.8.39.126:41623
I20260808 15:50:44.001636 27074 heartbeater.cc:464] Registering TS with master...
I20260808 15:50:44.002435 27074 heartbeater.cc:511] Master 127.8.39.126:41623 requested a full tablet report, sending...
I20260808 15:50:44.003924 26743 ts_manager.cc:194] Registered new tserver with Master: 2dda51dac94a4279b5b48550dc0b5e66 (127.8.39.66:33993)
I20260808 15:50:44.004949 26743 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.39.66:47331
W20260808 15:50:44.115399 27078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:44.115684 27078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:44.115725 27078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:44.119899 27078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:44.119967 27078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:44.120028 27078 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:50:44.125073 27078 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:44549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41623
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27078
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:44.126194 27078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:44.127658 27078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:44.138477 27083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:44.138545 27078 server_base.cc:1034] running on GCE node
W20260808 15:50:44.138648 27084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:44.138477 27086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:44.139289 27078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:44.140060 27078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:44.141220 27078 hybrid_clock.cc:648] HybridClock initialized: now 1786204244141178 us; error 61 us; skew 500 ppm
I20260808 15:50:44.143247 27078 webserver.cc:460] Webserver started at http://127.8.39.67:41741/ using document root <none> and password file <none>
I20260808 15:50:44.143844 27078 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:44.143910 27078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:44.144158 27078 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:44.146298 27078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-2/data/instance:
uuid: "1da8fe8f7d4f466f87034cc4e2e46cf8"
format_stamp: "Formatted at 2026-08-08 15:50:44 on dist-test-slave-8tdl"
server_key: "715c58894dd298a5cedcf9b9979fdbbc"
server_key_iv: "5104815df7460fa626368da8f8fd45ae"
server_key_version: "encryptionkey@0"
I20260808 15:50:44.146955 27078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance:
uuid: "1da8fe8f7d4f466f87034cc4e2e46cf8"
format_stamp: "Formatted at 2026-08-08 15:50:44 on dist-test-slave-8tdl"
server_key: "715c58894dd298a5cedcf9b9979fdbbc"
server_key_iv: "5104815df7460fa626368da8f8fd45ae"
server_key_version: "encryptionkey@0"
I20260808 15:50:44.150895 27078 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 15:50:44.153507 27092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:44.154913 27078 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:50:44.155066 27078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "1da8fe8f7d4f466f87034cc4e2e46cf8"
format_stamp: "Formatted at 2026-08-08 15:50:44 on dist-test-slave-8tdl"
server_key: "715c58894dd298a5cedcf9b9979fdbbc"
server_key_iv: "5104815df7460fa626368da8f8fd45ae"
server_key_version: "encryptionkey@0"
I20260808 15:50:44.155195 27078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:44.167452 27078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:44.168181 27078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:44.168383 27078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:44.169003 27078 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:50:44.169983 27078 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:50:44.170065 27078 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:44.170142 27078 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:50:44.170195 27078 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:44.179512 27078 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:43747
I20260808 15:50:44.179589 27211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:43747 every 8 connection(s)
I20260808 15:50:44.180541 27078 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:50:44.181506 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 27078
I20260808 15:50:44.181644 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance
I20260808 15:50:44.182025 8349 external_mini_cluster.cc:1428] Setting key 5b7672a367f8b28fe4f6d393bdb5f196
I20260808 15:50:44.191367 26785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:44.182933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:38525 (local address 127.8.39.126:41623)
0808 15:50:44.183100 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:44.183107 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:44.184716 (+ 1609us) server_negotiation.cc:407] Connection header received
0808 15:50:44.186280 (+ 1564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:44.186283 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:44.186339 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:44.186419 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:44.187467 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.188001 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.189162 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.189386 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.189505 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:44.190766 (+ 1261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:44.190769 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:44.190771 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:50:44.190784 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:44.190802 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:50:44.190810 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:44.190876 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:44.191119 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 15:50:44.191184 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 15:50:44.192239 27214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:44.183423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41623 (local address 127.8.39.67:38525)
0808 15:50:44.184565 (+ 1142us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:44.184627 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:44.186028 (+ 1401us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:44.186587 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:44.186594 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:44.186748 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:50:44.187317 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:44.187331 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.188133 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.188136 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:44.189027 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:44.189036 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.189551 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.189554 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:44.189727 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:44.190452 (+ 725us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:50:44.190454 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:50:44.190495 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:50:44.190560 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:50:44.190954 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:50:44.190962 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:50:44.190967 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 15:50:44.191119 (+ 152us) client_negotiation.cc:240] Negotiation successful
0808 15:50:44.191419 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":195,"threads_started":1}
I20260808 15:50:44.193493 27212 heartbeater.cc:347] Connected to a master server at 127.8.39.126:41623
I20260808 15:50:44.193768 27212 heartbeater.cc:464] Registering TS with master...
I20260808 15:50:44.194348 27212 heartbeater.cc:511] Master 127.8.39.126:41623 requested a full tablet report, sending...
I20260808 15:50:44.195549 26743 ts_manager.cc:194] Registered new tserver with Master: 1da8fe8f7d4f466f87034cc4e2e46cf8 (127.8.39.67:43747)
I20260808 15:50:44.196305 26743 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.39.67:38525
I20260808 15:50:44.196521 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:50:44.202466 26785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:44.198856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36874 (local address 127.8.39.126:41623)
0808 15:50:44.198995 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:44.198999 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:44.199237 (+ 238us) server_negotiation.cc:407] Connection header received
0808 15:50:44.199317 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:44.199319 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:44.199355 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:44.199421 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:44.199661 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.200186 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.201023 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.201228 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.201306 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:44.202126 (+ 820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:44.202129 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:44.202131 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:50:44.202143 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:44.202162 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:50:44.202170 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:44.202230 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:44.202307 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 15:50:44.202356 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 15:50:44.205261 26743 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36874:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:50:44.208376 26743 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:50:44.222605 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:44.216639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:45251 (local address 127.0.0.1:53128)
0808 15:50:44.217955 (+ 1316us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:44.217998 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:44.218143 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:44.218705 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:44.218710 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:44.218736 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:44.218934 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:44.218950 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.220135 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.220141 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:44.221231 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:44.221241 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.222037 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.222040 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:44.222145 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:44.222181 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 15:50:44.222308 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 15:50:44.222434 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1130,"mutex_wait_us":62,"spinlock_wait_cycles":9728,"thread_start_us":117,"threads_started":1}
I20260808 15:50:44.222628 27228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:44.216765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53128 (local address 127.8.39.65:45251)
0808 15:50:44.217459 (+ 694us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:44.217473 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:44.218103 (+ 630us) server_negotiation.cc:407] Connection header received
0808 15:50:44.218316 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:44.218320 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:44.218522 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:44.218701 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:44.219125 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.220015 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.221354 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.221903 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.222028 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:44.222237 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:44.222375 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 15:50:44.222474 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":99,"threads_started":1}
I20260808 15:50:44.223728 27225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:44.216961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:43747 (local address 127.0.0.1:34450)
0808 15:50:44.218377 (+ 1416us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:44.218390 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:44.218480 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:44.218901 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:44.218904 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:44.218921 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:44.219099 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:44.219109 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.220553 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.220556 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:44.221928 (+ 1372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:44.221946 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.223281 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.223285 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:44.223374 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:44.223402 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 15:50:44.223490 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 15:50:44.223560 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1360,"mutex_wait_us":105,"thread_start_us":93,"threads_started":1}
I20260808 15:50:44.224030 27224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:44.216701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:33993 (local address 127.0.0.1:58038)
0808 15:50:44.217945 (+ 1244us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:44.218030 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:44.218157 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:44.218745 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:44.218748 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:44.218760 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:44.219112 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:44.219120 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.220553 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.220556 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:44.221930 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:44.221940 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.223464 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.223470 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:44.223563 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:44.223583 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 15:50:44.223647 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 15:50:44.223700 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1108,"mutex_wait_us":286,"thread_start_us":105,"threads_started":1}
I20260808 15:50:44.224216 27230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:44.217467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34450 (local address 127.8.39.67:43747)
0808 15:50:44.217873 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:44.217887 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:44.218489 (+ 602us) server_negotiation.cc:407] Connection header received
0808 15:50:44.218574 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:44.218582 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:44.218767 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:44.218906 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:44.219233 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.220416 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.222076 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.222909 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.223028 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:44.223214 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:44.223931 (+ 717us) server_negotiation.cc:299] Negotiation successful
0808 15:50:44.224052 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":109,"threads_started":1}
I20260808 15:50:44.224407 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:44.217486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58038 (local address 127.8.39.66:33993)
0808 15:50:44.217921 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:44.217933 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:44.218158 (+ 225us) server_negotiation.cc:407] Connection header received
0808 15:50:44.218312 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:44.218318 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:44.218529 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:44.218897 (+ 368us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:44.219259 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.220407 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.222076 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.223107 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.223200 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:44.223365 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:44.223803 (+ 438us) server_negotiation.cc:299] Negotiation successful
0808 15:50:44.224240 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":123,"threads_started":1}
I20260808 15:50:44.226154 26870 tablet_service.cc:1467] Processing CreateTablet for tablet 9f5cbb107b7d4d899aa266f80b35dab3 (DEFAULT_TABLE table=test-table [id=7817de74533f4024b2d7edee4be30cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:50:44.226423 27142 tablet_service.cc:1467] Processing CreateTablet for tablet 9f5cbb107b7d4d899aa266f80b35dab3 (DEFAULT_TABLE table=test-table [id=7817de74533f4024b2d7edee4be30cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:50:44.227212 26870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f5cbb107b7d4d899aa266f80b35dab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:44.227371 27142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f5cbb107b7d4d899aa266f80b35dab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:44.233790 27232 tablet_bootstrap.cc:492] T 9f5cbb107b7d4d899aa266f80b35dab3 P 1da8fe8f7d4f466f87034cc4e2e46cf8: Bootstrap starting.
I20260808 15:50:44.233616 27006 tablet_service.cc:1467] Processing CreateTablet for tablet 9f5cbb107b7d4d899aa266f80b35dab3 (DEFAULT_TABLE table=test-table [id=7817de74533f4024b2d7edee4be30cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:50:44.234799 27006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f5cbb107b7d4d899aa266f80b35dab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:44.235044 27233 tablet_bootstrap.cc:492] T 9f5cbb107b7d4d899aa266f80b35dab3 P 0634c8d9f00c4da78bf47542dacf52b6: Bootstrap starting.
I20260808 15:50:44.237098 27233 tablet_bootstrap.cc:654] T 9f5cbb107b7d4d899aa266f80b35dab3 P 0634c8d9f00c4da78bf47542dacf52b6: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:44.237098 27232 tablet_bootstrap.cc:654] T 9f5cbb107b7d4d899aa266f80b35dab3 P 1da8fe8f7d4f466f87034cc4e2e46cf8: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:44.238032 27233 log.cc:824] T 9f5cbb107b7d4d899aa266f80b35dab3 P 0634c8d9f00c4da78bf47542dacf52b6: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:44.238178 27232 log.cc:824] T 9f5cbb107b7d4d899aa266f80b35dab3 P 1da8fe8f7d4f466f87034cc4e2e46cf8: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:44.240415 27233 tablet_bootstrap.cc:492] T 9f5cbb107b7d4d899aa266f80b35dab3 P 0634c8d9f00c4da78bf47542dacf52b6: No bootstrap required, opened a new log
I20260808 15:50:44.240415 27232 tablet_bootstrap.cc:492] T 9f5cbb107b7d4d899aa266f80b35dab3 P 1da8fe8f7d4f466f87034cc4e2e46cf8: No bootstrap required, opened a new log
I20260808 15:50:44.240625 27233 ts_tablet_manager.cc:1397] T 9f5cbb107b7d4d899aa266f80b35dab3 P 0634c8d9f00c4da78bf47542dacf52b6: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 15:50:44.240625 27232 ts_tablet_manager.cc:1397] T 9f5cbb107b7d4d899aa266f80b35dab3 P 1da8fe8f7d4f466f87034cc4e2e46cf8: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 15:50:44.241472 27236 tablet_bootstrap.cc:492] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66: Bootstrap starting.
I20260808 15:50:44.243546 27236 tablet_bootstrap.cc:654] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:44.244262 27236 log.cc:824] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:44.245227 27233 raft_consensus.cc:348] T 9f5cbb107b7d4d899aa266f80b35dab3 P 0634c8d9f00c4da78bf47542dacf52b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0634c8d9f00c4da78bf47542dacf52b6" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 45251 } } peers { permanent_uuid: "2dda51dac94a4279b5b48550dc0b5e66" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33993 } } peers { permanent_uuid: "1da8fe8f7d4f466f87034cc4e2e46cf8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 43747 } }
I20260808 15:50:44.245227 27232 raft_consensus.cc:348] T 9f5cbb107b7d4d899aa266f80b35dab3 P 1da8fe8f7d4f466f87034cc4e2e46cf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0634c8d9f00c4da78bf47542dacf52b6" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 45251 } } peers { permanent_uuid: "2dda51dac94a4279b5b48550dc0b5e66" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33993 } } peers { permanent_uuid: "1da8fe8f7d4f466f87034cc4e2e46cf8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 43747 } }
I20260808 15:50:44.245513 27233 raft_consensus.cc:374] T 9f5cbb107b7d4d899aa266f80b35dab3 P 0634c8d9f00c4da78bf47542dacf52b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:44.245513 27232 raft_consensus.cc:374] T 9f5cbb107b7d4d899aa266f80b35dab3 P 1da8fe8f7d4f466f87034cc4e2e46cf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:44.245572 27232 raft_consensus.cc:729] T 9f5cbb107b7d4d899aa266f80b35dab3 P 1da8fe8f7d4f466f87034cc4e2e46cf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da8fe8f7d4f466f87034cc4e2e46cf8, State: Initialized, Role: FOLLOWER
I20260808 15:50:44.245572 27233 raft_consensus.cc:729] T 9f5cbb107b7d4d899aa266f80b35dab3 P 0634c8d9f00c4da78bf47542dacf52b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0634c8d9f00c4da78bf47542dacf52b6, State: Initialized, Role: FOLLOWER
I20260808 15:50:44.246038 27233 consensus_queue.cc:260] T 9f5cbb107b7d4d899aa266f80b35dab3 P 0634c8d9f00c4da78bf47542dacf52b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0634c8d9f00c4da78bf47542dacf52b6" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 45251 } } peers { permanent_uuid: "2dda51dac94a4279b5b48550dc0b5e66" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33993 } } peers { permanent_uuid: "1da8fe8f7d4f466f87034cc4e2e46cf8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 43747 } }
I20260808 15:50:44.246038 27232 consensus_queue.cc:260] T 9f5cbb107b7d4d899aa266f80b35dab3 P 1da8fe8f7d4f466f87034cc4e2e46cf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0634c8d9f00c4da78bf47542dacf52b6" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 45251 } } peers { permanent_uuid: "2dda51dac94a4279b5b48550dc0b5e66" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33993 } } peers { permanent_uuid: "1da8fe8f7d4f466f87034cc4e2e46cf8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 43747 } }
I20260808 15:50:44.246817 27236 tablet_bootstrap.cc:492] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66: No bootstrap required, opened a new log
I20260808 15:50:44.247131 27212 heartbeater.cc:503] Master 127.8.39.126:41623 was elected leader, sending a full tablet report...
I20260808 15:50:44.247134 27233 ts_tablet_manager.cc:1428] T 9f5cbb107b7d4d899aa266f80b35dab3 P 0634c8d9f00c4da78bf47542dacf52b6: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260808 15:50:44.247131 26940 heartbeater.cc:503] Master 127.8.39.126:41623 was elected leader, sending a full tablet report...
I20260808 15:50:44.247134 27232 ts_tablet_manager.cc:1428] T 9f5cbb107b7d4d899aa266f80b35dab3 P 1da8fe8f7d4f466f87034cc4e2e46cf8: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 15:50:44.248092 27236 ts_tablet_manager.cc:1397] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 15:50:44.252390 27236 raft_consensus.cc:348] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0634c8d9f00c4da78bf47542dacf52b6" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 45251 } } peers { permanent_uuid: "2dda51dac94a4279b5b48550dc0b5e66" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33993 } } peers { permanent_uuid: "1da8fe8f7d4f466f87034cc4e2e46cf8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 43747 } }
I20260808 15:50:44.252677 27236 raft_consensus.cc:374] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:44.252739 27236 raft_consensus.cc:729] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dda51dac94a4279b5b48550dc0b5e66, State: Initialized, Role: FOLLOWER
I20260808 15:50:44.253261 27236 consensus_queue.cc:260] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0634c8d9f00c4da78bf47542dacf52b6" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 45251 } } peers { permanent_uuid: "2dda51dac94a4279b5b48550dc0b5e66" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33993 } } peers { permanent_uuid: "1da8fe8f7d4f466f87034cc4e2e46cf8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 43747 } }
I20260808 15:50:44.254006 27074 heartbeater.cc:503] Master 127.8.39.126:41623 was elected leader, sending a full tablet report...
I20260808 15:50:44.254470 27236 ts_tablet_manager.cc:1428] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20260808 15:50:44.267128 26941 tablet.cc:2369] T 9f5cbb107b7d4d899aa266f80b35dab3 P 0634c8d9f00c4da78bf47542dacf52b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:50:44.337872 27240 raft_consensus.cc:482] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:50:44.338065 27240 raft_consensus.cc:504] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0634c8d9f00c4da78bf47542dacf52b6" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 45251 } } peers { permanent_uuid: "2dda51dac94a4279b5b48550dc0b5e66" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33993 } } peers { permanent_uuid: "1da8fe8f7d4f466f87034cc4e2e46cf8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 43747 } }
I20260808 15:50:44.339442 27240 leader_election.cc:288] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0634c8d9f00c4da78bf47542dacf52b6 (127.8.39.65:45251), 1da8fe8f7d4f466f87034cc4e2e46cf8 (127.8.39.67:43747)
I20260808 15:50:44.343809 27230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:44.339921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:59605 (local address 127.8.39.67:43747)
0808 15:50:44.340108 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:44.340113 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:44.340130 (+ 17us) server_negotiation.cc:407] Connection header received
0808 15:50:44.340189 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:44.340192 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:44.340241 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:44.340315 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:44.340713 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.341345 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.342659 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.343150 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.343233 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:44.343282 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:44.343591 (+ 309us) server_negotiation.cc:299] Negotiation successful
0808 15:50:44.343668 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 15:50:44.343825 27076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:44.339684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:43747 (local address 127.8.39.66:59605)
0808 15:50:44.339817 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:44.339834 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:44.339933 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:44.340419 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:44.340423 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:44.340450 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:44.340587 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:44.340597 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.341488 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.341492 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:44.342528 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:44.342538 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.343286 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.343293 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:44.343428 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:44.343458 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 15:50:44.343556 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 15:50:44.343638 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 15:50:44.344044 27241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:44.339709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:45251 (local address 127.8.39.66:49237)
0808 15:50:44.340316 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:44.340329 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:44.340424 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:44.340701 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:44.340704 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:44.340721 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:44.340842 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:44.340848 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.341898 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.341901 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:44.342726 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:44.342737 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.343619 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.343623 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:44.343721 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:44.343744 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 15:50:44.343825 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 15:50:44.343897 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"mutex_wait_us":142,"thread_start_us":169,"threads_started":1}
I20260808 15:50:44.344097 27228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:44.340120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:49237 (local address 127.8.39.65:45251)
0808 15:50:44.340288 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:44.340294 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:44.340410 (+ 116us) server_negotiation.cc:407] Connection header received
0808 15:50:44.340516 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:44.340519 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:44.340574 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:44.340672 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:44.341030 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.341782 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.342859 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.343498 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.343604 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:44.343668 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:44.343862 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 15:50:44.343956 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 15:50:44.344619 27163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f5cbb107b7d4d899aa266f80b35dab3" candidate_uuid: "2dda51dac94a4279b5b48550dc0b5e66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da8fe8f7d4f466f87034cc4e2e46cf8" is_pre_election: true
I20260808 15:50:44.344882 27163 raft_consensus.cc:2454] T 9f5cbb107b7d4d899aa266f80b35dab3 P 1da8fe8f7d4f466f87034cc4e2e46cf8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dda51dac94a4279b5b48550dc0b5e66 in term 0.
I20260808 15:50:44.345369 26892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f5cbb107b7d4d899aa266f80b35dab3" candidate_uuid: "2dda51dac94a4279b5b48550dc0b5e66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0634c8d9f00c4da78bf47542dacf52b6" is_pre_election: true
I20260808 15:50:44.345398 26959 leader_election.cc:302] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da8fe8f7d4f466f87034cc4e2e46cf8, 2dda51dac94a4279b5b48550dc0b5e66; no voters:
I20260808 15:50:44.345660 26892 raft_consensus.cc:2454] T 9f5cbb107b7d4d899aa266f80b35dab3 P 0634c8d9f00c4da78bf47542dacf52b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dda51dac94a4279b5b48550dc0b5e66 in term 0.
I20260808 15:50:44.345702 27240 raft_consensus.cc:2781] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:50:44.345829 27240 raft_consensus.cc:482] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:50:44.345901 27240 raft_consensus.cc:3037] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:44.347193 27240 raft_consensus.cc:504] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0634c8d9f00c4da78bf47542dacf52b6" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 45251 } } peers { permanent_uuid: "2dda51dac94a4279b5b48550dc0b5e66" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33993 } } peers { permanent_uuid: "1da8fe8f7d4f466f87034cc4e2e46cf8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 43747 } }
I20260808 15:50:44.347568 27240 leader_election.cc:288] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66 [CANDIDATE]: Term 1 election: Requested vote from peers 0634c8d9f00c4da78bf47542dacf52b6 (127.8.39.65:45251), 1da8fe8f7d4f466f87034cc4e2e46cf8 (127.8.39.67:43747)
I20260808 15:50:44.348007 27163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f5cbb107b7d4d899aa266f80b35dab3" candidate_uuid: "2dda51dac94a4279b5b48550dc0b5e66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da8fe8f7d4f466f87034cc4e2e46cf8"
I20260808 15:50:44.348155 27163 raft_consensus.cc:3037] T 9f5cbb107b7d4d899aa266f80b35dab3 P 1da8fe8f7d4f466f87034cc4e2e46cf8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:44.349337 27163 raft_consensus.cc:2454] T 9f5cbb107b7d4d899aa266f80b35dab3 P 1da8fe8f7d4f466f87034cc4e2e46cf8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dda51dac94a4279b5b48550dc0b5e66 in term 1.
I20260808 15:50:44.349665 26892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f5cbb107b7d4d899aa266f80b35dab3" candidate_uuid: "2dda51dac94a4279b5b48550dc0b5e66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0634c8d9f00c4da78bf47542dacf52b6"
I20260808 15:50:44.349714 26959 leader_election.cc:302] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da8fe8f7d4f466f87034cc4e2e46cf8, 2dda51dac94a4279b5b48550dc0b5e66; no voters:
I20260808 15:50:44.349826 26892 raft_consensus.cc:3037] T 9f5cbb107b7d4d899aa266f80b35dab3 P 0634c8d9f00c4da78bf47542dacf52b6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:44.349918 27240 raft_consensus.cc:2781] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:50:44.350195 27240 raft_consensus.cc:686] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66 [term 1 LEADER]: Becoming Leader. State: Replica: 2dda51dac94a4279b5b48550dc0b5e66, State: Running, Role: LEADER
I20260808 15:50:44.350595 27240 consensus_queue.cc:237] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0634c8d9f00c4da78bf47542dacf52b6" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 45251 } } peers { permanent_uuid: "2dda51dac94a4279b5b48550dc0b5e66" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33993 } } peers { permanent_uuid: "1da8fe8f7d4f466f87034cc4e2e46cf8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 43747 } }
I20260808 15:50:44.351349 26892 raft_consensus.cc:2454] T 9f5cbb107b7d4d899aa266f80b35dab3 P 0634c8d9f00c4da78bf47542dacf52b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dda51dac94a4279b5b48550dc0b5e66 in term 1.
I20260808 15:50:44.354485 26745 catalog_manager.cc:5495] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2dda51dac94a4279b5b48550dc0b5e66 (127.8.39.66). New cstate: current_term: 1 leader_uuid: "2dda51dac94a4279b5b48550dc0b5e66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0634c8d9f00c4da78bf47542dacf52b6" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2dda51dac94a4279b5b48550dc0b5e66" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 33993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1da8fe8f7d4f466f87034cc4e2e46cf8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 43747 } health_report { overall_health: UNKNOWN } } }
I20260808 15:50:44.376287 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:44.372560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37822 (local address 127.8.39.66:33993)
0808 15:50:44.372712 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:44.372717 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:44.372731 (+ 14us) server_negotiation.cc:407] Connection header received
0808 15:50:44.372839 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:44.372842 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:44.372897 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:44.373013 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:50:44.373268 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.373791 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.374696 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:44.374989 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:44.375103 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:44.375414 (+ 311us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:50:44.375838 (+ 424us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:50:44.375966 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:44.376047 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 15:50:44.376102 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 15:50:44.382426 27163 raft_consensus.cc:1261] T 9f5cbb107b7d4d899aa266f80b35dab3 P 1da8fe8f7d4f466f87034cc4e2e46cf8 [term 1 FOLLOWER]: Refusing update from remote peer 2dda51dac94a4279b5b48550dc0b5e66: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:50:44.382431 26892 raft_consensus.cc:1261] T 9f5cbb107b7d4d899aa266f80b35dab3 P 0634c8d9f00c4da78bf47542dacf52b6 [term 1 FOLLOWER]: Refusing update from remote peer 2dda51dac94a4279b5b48550dc0b5e66: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:50:44.383237 27240 consensus_queue.cc:1035] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0634c8d9f00c4da78bf47542dacf52b6" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:50:44.383435 27242 consensus_queue.cc:1035] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da8fe8f7d4f466f87034cc4e2e46cf8" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 43747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:50:44.390237 27245 mvcc.cc:205] Tried to move back new op lower bound from 7316292584982724608 to 7316292584863862784. Current Snapshot: MvccSnapshot[applied={T|T < 7316292584982724608}]
I20260808 15:50:44.394426 27248 mvcc.cc:205] Tried to move back new op lower bound from 7316292584982724608 to 7316292584863862784. Current Snapshot: MvccSnapshot[applied={T|T < 7316292584982724608}]
I20260808 15:50:44.400038 26743 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36874:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:50:44.400199 26743 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36874:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:50:44.402736 26743 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c53fa0c94ccc41e996606cf4883788c9: Sending DeleteTablet for 3 replicas of tablet 9f5cbb107b7d4d899aa266f80b35dab3
I20260808 15:50:44.403607 26870 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f5cbb107b7d4d899aa266f80b35dab3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:50:44 UTC) from {username='slave'} at 127.0.0.1:53128
I20260808 15:50:44.403918 27006 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f5cbb107b7d4d899aa266f80b35dab3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:50:44 UTC) from {username='slave'} at 127.0.0.1:58038
I20260808 15:50:44.404233 27257 tablet_replica.cc:330] T 9f5cbb107b7d4d899aa266f80b35dab3 P 0634c8d9f00c4da78bf47542dacf52b6: stopping tablet replica
I20260808 15:50:44.404232 27142 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f5cbb107b7d4d899aa266f80b35dab3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:50:44 UTC) from {username='slave'} at 127.0.0.1:34450
I20260808 15:50:44.404596 27257 raft_consensus.cc:2229] T 9f5cbb107b7d4d899aa266f80b35dab3 P 0634c8d9f00c4da78bf47542dacf52b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:50:44.404865 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 26806
I20260808 15:50:44.404953 27257 raft_consensus.cc:2258] T 9f5cbb107b7d4d899aa266f80b35dab3 P 0634c8d9f00c4da78bf47542dacf52b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:50:44.404887 27259 tablet_replica.cc:330] T 9f5cbb107b7d4d899aa266f80b35dab3 P 1da8fe8f7d4f466f87034cc4e2e46cf8: stopping tablet replica
I20260808 15:50:44.406980 27259 raft_consensus.cc:2229] T 9f5cbb107b7d4d899aa266f80b35dab3 P 1da8fe8f7d4f466f87034cc4e2e46cf8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:50:44.407338 27259 raft_consensus.cc:2258] T 9f5cbb107b7d4d899aa266f80b35dab3 P 1da8fe8f7d4f466f87034cc4e2e46cf8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:50:44.407730 27258 tablet_replica.cc:330] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66: stopping tablet replica
I20260808 15:50:44.408025 27258 raft_consensus.cc:2229] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:50:44.408376 27258 raft_consensus.cc:2258] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:50:44.409922 27259 ts_tablet_manager.cc:1905] T 9f5cbb107b7d4d899aa266f80b35dab3 P 1da8fe8f7d4f466f87034cc4e2e46cf8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:50:44.409930 27258 ts_tablet_manager.cc:1905] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:50:44.412849 27259 ts_tablet_manager.cc:1918] T 9f5cbb107b7d4d899aa266f80b35dab3 P 1da8fe8f7d4f466f87034cc4e2e46cf8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:50:44.412961 27259 log.cc:1196] T 9f5cbb107b7d4d899aa266f80b35dab3 P 1da8fe8f7d4f466f87034cc4e2e46cf8: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/9f5cbb107b7d4d899aa266f80b35dab3
I20260808 15:50:44.413321 27259 ts_tablet_manager.cc:1939] T 9f5cbb107b7d4d899aa266f80b35dab3 P 1da8fe8f7d4f466f87034cc4e2e46cf8: Deleting consensus metadata
I20260808 15:50:44.413772 27258 ts_tablet_manager.cc:1918] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:50:44.413933 27258 log.cc:1196] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786203987027663-8349-0/minicluster-data/ts-1/wal/wals/9f5cbb107b7d4d899aa266f80b35dab3
I20260808 15:50:44.414319 27258 ts_tablet_manager.cc:1939] T 9f5cbb107b7d4d899aa266f80b35dab3 P 2dda51dac94a4279b5b48550dc0b5e66: Deleting consensus metadata
I20260808 15:50:44.414736 26728 catalog_manager.cc:4841] TS 1da8fe8f7d4f466f87034cc4e2e46cf8 (127.8.39.67:43747): tablet 9f5cbb107b7d4d899aa266f80b35dab3 (table test-table [id=7817de74533f4024b2d7edee4be30cd8]) successfully deleted
W20260808 15:50:44.415506 26727 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.39.65:45251 (error 108)
I20260808 15:50:44.415750 26729 catalog_manager.cc:4841] TS 2dda51dac94a4279b5b48550dc0b5e66 (127.8.39.66:33993): tablet 9f5cbb107b7d4d899aa266f80b35dab3 (table test-table [id=7817de74533f4024b2d7edee4be30cd8]) successfully deleted
I20260808 15:50:44.416416 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 26943
I20260808 15:50:44.416664 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:44.416329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:45251 (local address 127.0.0.1:42904)
0808 15:50:44.416472 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:44.416558 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.65:45251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 15:50:44.419997 26727 catalog_manager.cc:4584] TS 0634c8d9f00c4da78bf47542dacf52b6 (127.8.39.65:45251): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9f5cbb107b7d4d899aa266f80b35dab3: Network error: Client connection negotiation failed: client connection to 127.8.39.65:45251: connect: Connection refused (error 111)
I20260808 15:50:44.425549 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 27078
I20260808 15:50:44.432883 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 26712
2026-08-08T15:50:44Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1195 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:50:44 dist-test-slave-8tdl krb5kdc[27263](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:50:44 dist-test-slave-8tdl krb5kdc[27263](info): set up 2 sockets
Aug 08 15:50:44 dist-test-slave-8tdl krb5kdc[27263](info): commencing operation
krb5kdc: starting...
W20260808 15:50:45.516278 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:50:45 dist-test-slave-8tdl krb5kdc[27263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204245, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:50:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:50:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:50:45.654282 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:38205
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:44637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:38205
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:50:45.778160 27276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:45.778527 27276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:45.778620 27276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:45.782970 27276 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:50:45.783088 27276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:45.783126 27276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:45.783169 27276 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:50:45.783205 27276 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:50:45.788990 27276 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:44637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:38205
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:38205
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:45.790279 27276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:45.791437 27276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:45.800740 27284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:45.800745 27282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:45.800776 27276 server_base.cc:1034] running on GCE node
W20260808 15:50:45.800740 27281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:45.801553 27276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:45.802907 27276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:45.804145 27276 hybrid_clock.cc:648] HybridClock initialized: now 1786204245804114 us; error 44 us; skew 500 ppm
Aug 08 15:50:45 dist-test-slave-8tdl krb5kdc[27263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204245, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:50:45.812987 27276 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:50:45.814141 27276 webserver.cc:460] Webserver started at http://127.8.39.126:44525/ using document root <none> and password file <none>
I20260808 15:50:45.814854 27276 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:45.814982 27276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:45.815231 27276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:45.817512 27276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "4c25b8d7a41c436688592a8ec35997d5"
format_stamp: "Formatted at 2026-08-08 15:50:45 on dist-test-slave-8tdl"
server_key: "6e3cfa4e2ae72616e8515cc56b135a14"
server_key_iv: "ae72f28013b8a8de4dcb591479ebd6f1"
server_key_version: "encryptionkey@0"
I20260808 15:50:45.818146 27276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "4c25b8d7a41c436688592a8ec35997d5"
format_stamp: "Formatted at 2026-08-08 15:50:45 on dist-test-slave-8tdl"
server_key: "6e3cfa4e2ae72616e8515cc56b135a14"
server_key_iv: "ae72f28013b8a8de4dcb591479ebd6f1"
server_key_version: "encryptionkey@0"
I20260808 15:50:45.822383 27276 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 15:50:45.825174 27291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:45.826649 27276 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:50:45.826866 27276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "4c25b8d7a41c436688592a8ec35997d5"
format_stamp: "Formatted at 2026-08-08 15:50:45 on dist-test-slave-8tdl"
server_key: "6e3cfa4e2ae72616e8515cc56b135a14"
server_key_iv: "ae72f28013b8a8de4dcb591479ebd6f1"
server_key_version: "encryptionkey@0"
I20260808 15:50:45.827016 27276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:45.864351 27276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:45.868031 27276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:45.868286 27276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:45.875834 27276 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:38205
I20260808 15:50:45.875867 27348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:38205 every 8 connection(s)
I20260808 15:50:45.876859 27276 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:50:45.879781 27349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:45.883482 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 27276
I20260808 15:50:45.883603 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:50:45.883920 8349 external_mini_cluster.cc:1428] Setting key 4416d06400cd0c3cc27b76ef4139703e
I20260808 15:50:45.886197 27349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c25b8d7a41c436688592a8ec35997d5: Bootstrap starting.
I20260808 15:50:45.889065 27349 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c25b8d7a41c436688592a8ec35997d5: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:45.890019 27349 log.cc:824] T 00000000000000000000000000000000 P 4c25b8d7a41c436688592a8ec35997d5: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:45.892704 27349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c25b8d7a41c436688592a8ec35997d5: No bootstrap required, opened a new log
Aug 08 15:50:45 dist-test-slave-8tdl krb5kdc[27263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204245, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:50:45.897914 27349 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c25b8d7a41c436688592a8ec35997d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c25b8d7a41c436688592a8ec35997d5" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 38205 } }
I20260808 15:50:45.898247 27349 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c25b8d7a41c436688592a8ec35997d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:45.898329 27349 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c25b8d7a41c436688592a8ec35997d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c25b8d7a41c436688592a8ec35997d5, State: Initialized, Role: FOLLOWER
I20260808 15:50:45.898870 27349 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c25b8d7a41c436688592a8ec35997d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c25b8d7a41c436688592a8ec35997d5" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 38205 } }
I20260808 15:50:45.899049 27349 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c25b8d7a41c436688592a8ec35997d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:50:45.899127 27349 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c25b8d7a41c436688592a8ec35997d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:50:45.899230 27349 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c25b8d7a41c436688592a8ec35997d5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:45.900314 27349 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c25b8d7a41c436688592a8ec35997d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c25b8d7a41c436688592a8ec35997d5" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 38205 } }
I20260808 15:50:45.900620 27352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:45.885430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55284 (local address 127.8.39.126:38205)
0808 15:50:45.885891 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:45.885913 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:45.885956 (+ 43us) server_negotiation.cc:407] Connection header received
0808 15:50:45.886840 (+ 884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:45.886863 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:45.887287 (+ 424us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:45.887667 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:45.888394 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:45.889906 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:45.891154 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:45.891818 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:45.891983 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:45.895086 (+ 3103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:45.895092 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:45.895110 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:45.895144 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:45.897325 (+ 2181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:45.897786 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:45.897792 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:45.897799 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:45.897948 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:45.898279 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:45.898283 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:45.898285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:45.898846 (+ 561us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:45.899077 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:45.899434 (+ 357us) server_negotiation.cc:299] Negotiation successful
0808 15:50:45.899786 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":121,"threads_started":1}
I20260808 15:50:45.900700 27349 leader_election.cc:302] T 00000000000000000000000000000000 P 4c25b8d7a41c436688592a8ec35997d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c25b8d7a41c436688592a8ec35997d5; no voters:
I20260808 15:50:45.901096 27349 leader_election.cc:288] T 00000000000000000000000000000000 P 4c25b8d7a41c436688592a8ec35997d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:50:45.901186 27354 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c25b8d7a41c436688592a8ec35997d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:50:45.901381 27354 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c25b8d7a41c436688592a8ec35997d5 [term 1 LEADER]: Becoming Leader. State: Replica: 4c25b8d7a41c436688592a8ec35997d5, State: Running, Role: LEADER
I20260808 15:50:45.901684 27354 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c25b8d7a41c436688592a8ec35997d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c25b8d7a41c436688592a8ec35997d5" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 38205 } }
I20260808 15:50:45.902434 27349 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c25b8d7a41c436688592a8ec35997d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:50:45.903368 27355 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c25b8d7a41c436688592a8ec35997d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c25b8d7a41c436688592a8ec35997d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c25b8d7a41c436688592a8ec35997d5" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 38205 } } }
I20260808 15:50:45.903532 27355 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c25b8d7a41c436688592a8ec35997d5 [sys.catalog]: This master's current role is: LEADER
I20260808 15:50:45.903537 27357 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c25b8d7a41c436688592a8ec35997d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c25b8d7a41c436688592a8ec35997d5. Latest consensus state: current_term: 1 leader_uuid: "4c25b8d7a41c436688592a8ec35997d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c25b8d7a41c436688592a8ec35997d5" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 38205 } } }
I20260808 15:50:45.903895 27357 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c25b8d7a41c436688592a8ec35997d5 [sys.catalog]: This master's current role is: LEADER
I20260808 15:50:45.904098 27364 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:50:45.907335 27364 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:50:45.913220 27364 catalog_manager.cc:1347] Generated new cluster ID: 8882535443d4499dbadc111bf5d86c9b
I20260808 15:50:45.913314 27364 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:50:45.936519 27364 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:50:45.937559 27364 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:50:45.948740 27364 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4c25b8d7a41c436688592a8ec35997d5: Generated new TSK 0
I20260808 15:50:45.949575 27364 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.39.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
I20260808 15:50:45.990168 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:0
--local_ip_for_outbound_sockets=127.8.39.65
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:38205
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:44637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:50:46.122496 27377 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:46.122905 27377 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:46.122996 27377 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:46.127293 27377 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:46.127394 27377 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:46.127496 27377 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:50:46.133395 27377 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:44637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:38205
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27377
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:46.134618 27377 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:46.135756 27377 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 15:50:46.146166 27377 server_base.cc:1034] running on GCE node
W20260808 15:50:46.146111 27382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:46.146134 27383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:46.146106 27385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:46.146919 27377 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:46.147578 27377 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:46.148766 27377 hybrid_clock.cc:648] HybridClock initialized: now 1786204246148747 us; error 30 us; skew 500 ppm
Aug 08 15:50:46 dist-test-slave-8tdl krb5kdc[27263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204246, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:50:46.151876 27377 init.cc:377] Logged in from keytab as kudu/127.8.39.65@KRBTEST.COM (short username kudu)
I20260808 15:50:46.152829 27377 webserver.cc:460] Webserver started at http://127.8.39.65:36051/ using document root <none> and password file <none>
I20260808 15:50:46.153422 27377 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:46.153515 27377 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:46.153762 27377 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:46.155994 27377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-0/data/instance:
uuid: "4085c908151a4f10a0fbcf8efbe29ca7"
format_stamp: "Formatted at 2026-08-08 15:50:46 on dist-test-slave-8tdl"
server_key: "d6a51f0c769d632cfe494b8a3c099dd3"
server_key_iv: "4293ef617a6521823689176078deed43"
server_key_version: "encryptionkey@0"
I20260808 15:50:46.156626 27377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance:
uuid: "4085c908151a4f10a0fbcf8efbe29ca7"
format_stamp: "Formatted at 2026-08-08 15:50:46 on dist-test-slave-8tdl"
server_key: "d6a51f0c769d632cfe494b8a3c099dd3"
server_key_iv: "4293ef617a6521823689176078deed43"
server_key_version: "encryptionkey@0"
I20260808 15:50:46.160637 27377 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260808 15:50:46.163640 27392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:46.164953 27377 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 15:50:46.165129 27377 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "4085c908151a4f10a0fbcf8efbe29ca7"
format_stamp: "Formatted at 2026-08-08 15:50:46 on dist-test-slave-8tdl"
server_key: "d6a51f0c769d632cfe494b8a3c099dd3"
server_key_iv: "4293ef617a6521823689176078deed43"
server_key_version: "encryptionkey@0"
I20260808 15:50:46.165257 27377 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:46.176826 27377 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:46.180308 27377 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:46.180492 27377 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:46.181089 27377 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:50:46.182063 27377 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:50:46.182117 27377 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:46.182161 27377 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:50:46.182211 27377 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:46.191584 27377 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:39429
I20260808 15:50:46.191605 27510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:39429 every 8 connection(s)
I20260808 15:50:46.192548 27377 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:50:46.199245 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 27377
I20260808 15:50:46.199410 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance
I20260808 15:50:46.199807 8349 external_mini_cluster.cc:1428] Setting key fc8f35265cb74906d46361a01623b7f9
Aug 08 15:50:46 dist-test-slave-8tdl krb5kdc[27263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204246, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:50:46.208861 27352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:46.194763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:57051 (local address 127.8.39.126:38205)
0808 15:50:46.194961 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:46.194967 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:46.195984 (+ 1017us) server_negotiation.cc:407] Connection header received
0808 15:50:46.197274 (+ 1290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:46.197277 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:46.197327 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:46.197414 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:46.198601 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.199339 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.200944 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.201272 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.201393 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:46.204583 (+ 3190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:46.204589 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:46.204594 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:46.204628 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:46.206240 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:46.207020 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:46.207022 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:46.207024 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:46.207109 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:46.207602 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:46.207604 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:46.207605 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:46.207799 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:46.207875 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:46.208508 (+ 633us) server_negotiation.cc:299] Negotiation successful
0808 15:50:46.208669 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 15:50:46.209769 27514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:46.195320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:38205 (local address 127.8.39.65:57051)
0808 15:50:46.195816 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:46.195861 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:46.197074 (+ 1213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:46.197598 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:46.197605 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:46.197972 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:50:46.198450 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:46.198463 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.199516 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.199519 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:46.200817 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:46.200827 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.201462 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.201467 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:46.201662 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:46.202332 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:50:46.202359 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:50:46.204368 (+ 2009us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:50:46.206382 (+ 2014us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:46.206392 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:46.206413 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:46.206911 (+ 498us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:46.207237 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:46.207240 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:46.207245 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:46.207483 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:46.207917 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:50:46.207923 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:50:46.208235 (+ 312us) client_negotiation.cc:769] Sending connection context
0808 15:50:46.208437 (+ 202us) client_negotiation.cc:240] Negotiation successful
0808 15:50:46.208821 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":138,"threads_started":1}
I20260808 15:50:46.211175 27511 heartbeater.cc:347] Connected to a master server at 127.8.39.126:38205
I20260808 15:50:46.211452 27511 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.8.39.66@KRBTEST.COM; defaulting to no policy
I20260808 15:50:46.211994 27511 heartbeater.cc:511] Master 127.8.39.126:38205 requested a full tablet report, sending...
I20260808 15:50:46.213589 27309 ts_manager.cc:194] Registered new tserver with Master: 4085c908151a4f10a0fbcf8efbe29ca7 (127.8.39.65:39429)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.66@KRBTEST.COM" created.
I20260808 15:50:46.215118 27309 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.65@KRBTEST.COM'} at 127.8.39.65:57051
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
I20260808 15:50:46.233482 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:0
--local_ip_for_outbound_sockets=127.8.39.66
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:38205
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:44637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:50:46.348024 27517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:46.348312 27517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:46.348357 27517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:46.352345 27517 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:46.352406 27517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:46.352468 27517 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:50:46.357800 27517 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:44637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:38205
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27517
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:46.358939 27517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:46.359969 27517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 15:50:46.370208 27517 server_base.cc:1034] running on GCE node
W20260808 15:50:46.370240 27523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:46.370213 27524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:46.370397 27526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:46.371366 27517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:46.372191 27517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:46.373389 27517 hybrid_clock.cc:648] HybridClock initialized: now 1786204246373354 us; error 45 us; skew 500 ppm
Aug 08 15:50:46 dist-test-slave-8tdl krb5kdc[27263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204246, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:50:46.376241 27517 init.cc:377] Logged in from keytab as kudu/127.8.39.66@KRBTEST.COM (short username kudu)
I20260808 15:50:46.377177 27517 webserver.cc:460] Webserver started at http://127.8.39.66:35549/ using document root <none> and password file <none>
I20260808 15:50:46.377772 27517 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:46.377876 27517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:46.378113 27517 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:46.380403 27517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-1/data/instance:
uuid: "60026776a691441885b06986c444173f"
format_stamp: "Formatted at 2026-08-08 15:50:46 on dist-test-slave-8tdl"
server_key: "5817d728e99193842ccea5161e632d5e"
server_key_iv: "728f64cea0c5761d27972a8b12364b4c"
server_key_version: "encryptionkey@0"
I20260808 15:50:46.381250 27517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance:
uuid: "60026776a691441885b06986c444173f"
format_stamp: "Formatted at 2026-08-08 15:50:46 on dist-test-slave-8tdl"
server_key: "5817d728e99193842ccea5161e632d5e"
server_key_iv: "728f64cea0c5761d27972a8b12364b4c"
server_key_version: "encryptionkey@0"
I20260808 15:50:46.385313 27517 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260808 15:50:46.387929 27533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:46.389199 27517 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:50:46.389348 27517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "60026776a691441885b06986c444173f"
format_stamp: "Formatted at 2026-08-08 15:50:46 on dist-test-slave-8tdl"
server_key: "5817d728e99193842ccea5161e632d5e"
server_key_iv: "728f64cea0c5761d27972a8b12364b4c"
server_key_version: "encryptionkey@0"
I20260808 15:50:46.389472 27517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:46.410545 27517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:46.414274 27517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:46.414644 27517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:46.415446 27517 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:50:46.416424 27517 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:50:46.416517 27517 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:46.416620 27517 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:50:46.416677 27517 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:46.427028 27517 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:35035
I20260808 15:50:46.427064 27657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:35035 every 8 connection(s)
I20260808 15:50:46.428041 27517 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:50:46.431744 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 27517
I20260808 15:50:46.431869 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance
I20260808 15:50:46.432185 8349 external_mini_cluster.cc:1428] Setting key 723dfd02c3bbb9ae06e48f3c34490774
Aug 08 15:50:46 dist-test-slave-8tdl krb5kdc[27263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204246, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.39.67@KRBTEST.COM; defaulting to no policy
I20260808 15:50:46.445987 27352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:46.429957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:51319 (local address 127.8.39.126:38205)
0808 15:50:46.430123 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:46.430129 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:46.431293 (+ 1164us) server_negotiation.cc:407] Connection header received
0808 15:50:46.432869 (+ 1576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:46.432874 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:46.432933 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:46.433090 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:46.434551 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.435267 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.436642 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.436890 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.437009 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:46.441127 (+ 4118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:46.441134 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:46.441139 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:46.441181 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:46.443178 (+ 1997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:46.443987 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:46.443992 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:46.443997 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:46.444107 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:46.444582 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:46.444587 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:46.444591 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:46.444887 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:46.445000 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:46.445658 (+ 658us) server_negotiation.cc:299] Negotiation successful
0808 15:50:46.445795 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.67@KRBTEST.COM" created.
I20260808 15:50:46.447662 27660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:46.430517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:38205 (local address 127.8.39.66:51319)
0808 15:50:46.431087 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:46.431155 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:46.432613 (+ 1458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:46.433295 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:46.433304 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:46.433881 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:50:46.434391 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:46.434406 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.435407 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.435413 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:46.436493 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:46.436505 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.437056 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.437060 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:46.437245 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:46.437965 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:50:46.437994 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:50:46.440809 (+ 2815us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:50:46.443307 (+ 2498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:46.443317 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:46.443339 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:46.443813 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:46.444219 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:46.444223 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:46.444228 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:46.444465 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:46.445018 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:50:46.445024 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:50:46.445302 (+ 278us) client_negotiation.cc:769] Sending connection context
0808 15:50:46.446206 (+ 904us) client_negotiation.cc:240] Negotiation successful
0808 15:50:46.446535 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":205,"threads_started":1}
I20260808 15:50:46.451179 27658 heartbeater.cc:347] Connected to a master server at 127.8.39.126:38205
I20260808 15:50:46.451457 27658 heartbeater.cc:464] Registering TS with master...
I20260808 15:50:46.452026 27658 heartbeater.cc:511] Master 127.8.39.126:38205 requested a full tablet report, sending...
I20260808 15:50:46.453307 27309 ts_manager.cc:194] Registered new tserver with Master: 60026776a691441885b06986c444173f (127.8.39.66:35035)
I20260808 15:50:46.454191 27309 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.66@KRBTEST.COM'} at 127.8.39.66:51319
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
I20260808 15:50:46.474015 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:0
--local_ip_for_outbound_sockets=127.8.39.67
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:38205
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:44637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:50:46.603528 27663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:46.603801 27663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:46.603844 27663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:46.607986 27663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:46.608060 27663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:46.608124 27663 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:50:46.613454 27663 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:44637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:38205
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:46.614542 27663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:46.615672 27663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:46.625684 27668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:46.625761 27669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:46.625957 27663 server_base.cc:1034] running on GCE node
W20260808 15:50:46.626168 27671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:46.626577 27663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:46.627303 27663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:46.628496 27663 hybrid_clock.cc:648] HybridClock initialized: now 1786204246628475 us; error 34 us; skew 500 ppm
Aug 08 15:50:46 dist-test-slave-8tdl krb5kdc[27263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204246, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:50:46.631414 27663 init.cc:377] Logged in from keytab as kudu/127.8.39.67@KRBTEST.COM (short username kudu)
I20260808 15:50:46.632450 27663 webserver.cc:460] Webserver started at http://127.8.39.67:43833/ using document root <none> and password file <none>
I20260808 15:50:46.633064 27663 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:46.633128 27663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:46.633349 27663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:46.635577 27663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-2/data/instance:
uuid: "eae829fb7aea40dcbae8fef4b847f40e"
format_stamp: "Formatted at 2026-08-08 15:50:46 on dist-test-slave-8tdl"
server_key: "100424139d65de563dc2dd88b924b9c0"
server_key_iv: "f8d5646c69ad359609e55705111685bf"
server_key_version: "encryptionkey@0"
I20260808 15:50:46.636162 27663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance:
uuid: "eae829fb7aea40dcbae8fef4b847f40e"
format_stamp: "Formatted at 2026-08-08 15:50:46 on dist-test-slave-8tdl"
server_key: "100424139d65de563dc2dd88b924b9c0"
server_key_iv: "f8d5646c69ad359609e55705111685bf"
server_key_version: "encryptionkey@0"
I20260808 15:50:46.640152 27663 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 15:50:46.642992 27678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:46.644304 27663 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:50:46.644412 27663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "eae829fb7aea40dcbae8fef4b847f40e"
format_stamp: "Formatted at 2026-08-08 15:50:46 on dist-test-slave-8tdl"
server_key: "100424139d65de563dc2dd88b924b9c0"
server_key_iv: "f8d5646c69ad359609e55705111685bf"
server_key_version: "encryptionkey@0"
I20260808 15:50:46.644572 27663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:46.668874 27663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:46.672312 27663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:46.672526 27663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:46.673205 27663 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:50:46.674059 27663 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:50:46.674108 27663 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:46.674149 27663 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:50:46.674163 27663 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:46.684376 27663 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:33061
I20260808 15:50:46.684409 27799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:33061 every 8 connection(s)
I20260808 15:50:46.685371 27663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:50:46.693353 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 27663
I20260808 15:50:46.693542 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance
I20260808 15:50:46.694041 8349 external_mini_cluster.cc:1428] Setting key 3a2e0e39b74ff47c17e8f7a2930e93ea
Aug 08 15:50:46 dist-test-slave-8tdl krb5kdc[27263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204246, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:50:46.700973 27352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:46.687620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:34295 (local address 127.8.39.126:38205)
0808 15:50:46.687802 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:46.687808 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:46.688857 (+ 1049us) server_negotiation.cc:407] Connection header received
0808 15:50:46.690247 (+ 1390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:46.690250 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:46.690312 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:46.690420 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:46.691758 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.692419 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.693741 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.694082 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.694216 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:46.697404 (+ 3188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:46.697407 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:46.697409 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:46.697439 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:46.698942 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:46.699447 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:46.699450 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:46.699451 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:46.699537 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:46.699886 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:46.699889 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:46.699890 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:46.700099 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:46.700213 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:46.700702 (+ 489us) server_negotiation.cc:299] Negotiation successful
0808 15:50:46.700830 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 15:50:46.701812 27802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:46.688143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:38205 (local address 127.8.39.67:34295)
0808 15:50:46.688662 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:46.688708 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:46.689996 (+ 1288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:46.690594 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:46.690601 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:46.691076 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:50:46.691581 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:46.691595 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.692548 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.692551 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:46.693594 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:46.693621 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.694389 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.694392 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:46.694645 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:46.695430 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:50:46.695447 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:50:46.697234 (+ 1787us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:50:46.699055 (+ 1821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:46.699060 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:46.699074 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:46.699331 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:46.699625 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:46.699627 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:46.699629 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:46.699762 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:46.700208 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:50:46.700213 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:50:46.700459 (+ 246us) client_negotiation.cc:769] Sending connection context
0808 15:50:46.700627 (+ 168us) client_negotiation.cc:240] Negotiation successful
0808 15:50:46.700895 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":158,"threads_started":1}
I20260808 15:50:46.703224 27800 heartbeater.cc:347] Connected to a master server at 127.8.39.126:38205
I20260808 15:50:46.703533 27800 heartbeater.cc:464] Registering TS with master...
I20260808 15:50:46.704088 27800 heartbeater.cc:511] Master 127.8.39.126:38205 requested a full tablet report, sending...
I20260808 15:50:46.705235 27309 ts_manager.cc:194] Registered new tserver with Master: eae829fb7aea40dcbae8fef4b847f40e (127.8.39.67:33061)
I20260808 15:50:46.705847 27309 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.67@KRBTEST.COM'} at 127.8.39.67:34295
I20260808 15:50:46.708397 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:50:46.718642 27352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:46.710454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55294 (local address 127.8.39.126:38205)
0808 15:50:46.710617 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:46.710622 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:46.710854 (+ 232us) server_negotiation.cc:407] Connection header received
0808 15:50:46.710993 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:46.710996 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:46.711065 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:46.711152 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:46.711870 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.712394 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.713246 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.713483 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.713593 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:46.715379 (+ 1786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:46.715383 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:46.715385 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:46.715413 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:46.716731 (+ 1318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:46.717270 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:46.717273 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:46.717276 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:46.717365 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:46.717704 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:46.717708 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:46.717710 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:46.717935 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:46.718105 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:46.718372 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 15:50:46.718474 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 15:50:46.722474 27309 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55294:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:50:46.728243 27309 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:50:46.746905 27811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:46.739297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:33061 (local address 127.0.0.1:48214)
0808 15:50:46.739743 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:46.739811 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:46.739971 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:46.740633 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:46.740639 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:46.740665 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:46.740833 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:46.740840 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.742494 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.742498 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:46.744172 (+ 1674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:46.744184 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.746276 (+ 2092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.746280 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:46.746402 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:46.746451 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 15:50:46.746557 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 15:50:46.746736 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":22,"thread_start_us":105,"threads_started":1}
I20260808 15:50:46.747782 27815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:46.740452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:39429 (local address 127.0.0.1:46504)
0808 15:50:46.741761 (+ 1309us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:46.741779 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:46.741895 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:46.742840 (+ 945us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:46.742843 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:46.742862 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:46.742939 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:46.742944 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.744440 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.744444 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:46.745790 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:46.745802 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.747324 (+ 1522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.747327 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:46.747414 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:46.747433 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 15:50:46.747545 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 15:50:46.747630 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1227,"mutex_wait_us":208,"thread_start_us":95,"threads_started":1}
I20260808 15:50:46.747875 27817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:46.740979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46504 (local address 127.8.39.65:39429)
0808 15:50:46.741311 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:46.741319 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:46.742258 (+ 939us) server_negotiation.cc:407] Connection header received
0808 15:50:46.742441 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:46.742447 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:46.742667 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:46.742937 (+ 270us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:46.743092 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.744316 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.745933 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.746969 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.747107 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:46.747261 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:46.747586 (+ 325us) server_negotiation.cc:299] Negotiation successful
0808 15:50:46.747699 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":144,"threads_started":1}
I20260808 15:50:46.747926 27812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:46.739492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48214 (local address 127.8.39.67:33061)
0808 15:50:46.739922 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:46.739935 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:46.739965 (+ 30us) server_negotiation.cc:407] Connection header received
0808 15:50:46.740187 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:46.740193 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:46.740418 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:46.740993 (+ 575us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:46.741165 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.742349 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.744605 (+ 2256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.746134 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.747381 (+ 1247us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:46.747553 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:46.747616 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 15:50:46.747730 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":199,"threads_started":1}
I20260808 15:50:46.750557 27813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:46.740089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:35035 (local address 127.0.0.1:36582)
0808 15:50:46.740381 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:46.740398 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:46.740487 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:46.741272 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:46.741275 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:46.741292 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:46.741381 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:46.741386 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.742951 (+ 1565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.742956 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:46.745666 (+ 2710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:46.745679 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.750136 (+ 4457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.750140 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:46.750244 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:46.750268 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 15:50:46.750342 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 15:50:46.750418 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":1,"thread_start_us":118,"threads_started":1}
I20260808 15:50:46.751250 27814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:46.740241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36582 (local address 127.8.39.66:35035)
0808 15:50:46.740668 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:46.740679 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:46.740699 (+ 20us) server_negotiation.cc:407] Connection header received
0808 15:50:46.740770 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:46.740774 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:46.740959 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:46.741109 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:46.741509 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.742568 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.745956 (+ 3388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.746816 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.749892 (+ 3076us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:46.750064 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:46.750964 (+ 900us) server_negotiation.cc:299] Negotiation successful
0808 15:50:46.751098 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":116,"threads_started":1}
I20260808 15:50:46.751467 27443 tablet_service.cc:1467] Processing CreateTablet for tablet 94fee464351b49d89e9ff64d20372b15 (DEFAULT_TABLE table=test-table [id=6ac6caaafa5e4dea82a2296ce393d1fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:50:46.751438 27732 tablet_service.cc:1467] Processing CreateTablet for tablet 94fee464351b49d89e9ff64d20372b15 (DEFAULT_TABLE table=test-table [id=6ac6caaafa5e4dea82a2296ce393d1fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:50:46.752784 27732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94fee464351b49d89e9ff64d20372b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:46.752784 27443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94fee464351b49d89e9ff64d20372b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:46.755975 27586 tablet_service.cc:1467] Processing CreateTablet for tablet 94fee464351b49d89e9ff64d20372b15 (DEFAULT_TABLE table=test-table [id=6ac6caaafa5e4dea82a2296ce393d1fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:50:46.757334 27586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94fee464351b49d89e9ff64d20372b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:46.760283 27818 tablet_bootstrap.cc:492] T 94fee464351b49d89e9ff64d20372b15 P eae829fb7aea40dcbae8fef4b847f40e: Bootstrap starting.
I20260808 15:50:46.762957 27818 tablet_bootstrap.cc:654] T 94fee464351b49d89e9ff64d20372b15 P eae829fb7aea40dcbae8fef4b847f40e: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:46.764231 27818 log.cc:824] T 94fee464351b49d89e9ff64d20372b15 P eae829fb7aea40dcbae8fef4b847f40e: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:46.764966 27819 tablet_bootstrap.cc:492] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7: Bootstrap starting.
I20260808 15:50:46.766491 27821 tablet_bootstrap.cc:492] T 94fee464351b49d89e9ff64d20372b15 P 60026776a691441885b06986c444173f: Bootstrap starting.
I20260808 15:50:46.766737 27818 tablet_bootstrap.cc:492] T 94fee464351b49d89e9ff64d20372b15 P eae829fb7aea40dcbae8fef4b847f40e: No bootstrap required, opened a new log
I20260808 15:50:46.766970 27818 ts_tablet_manager.cc:1397] T 94fee464351b49d89e9ff64d20372b15 P eae829fb7aea40dcbae8fef4b847f40e: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.004s
I20260808 15:50:46.767326 27819 tablet_bootstrap.cc:654] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:46.768296 27819 log.cc:824] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:46.769502 27821 tablet_bootstrap.cc:654] T 94fee464351b49d89e9ff64d20372b15 P 60026776a691441885b06986c444173f: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:46.770278 27821 log.cc:824] T 94fee464351b49d89e9ff64d20372b15 P 60026776a691441885b06986c444173f: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:46.770812 27819 tablet_bootstrap.cc:492] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7: No bootstrap required, opened a new log
I20260808 15:50:46.771057 27819 ts_tablet_manager.cc:1397] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.002s
I20260808 15:50:46.771682 27818 raft_consensus.cc:348] T 94fee464351b49d89e9ff64d20372b15 P eae829fb7aea40dcbae8fef4b847f40e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae829fb7aea40dcbae8fef4b847f40e" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 33061 } } peers { permanent_uuid: "60026776a691441885b06986c444173f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 35035 } } peers { permanent_uuid: "4085c908151a4f10a0fbcf8efbe29ca7" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39429 } }
I20260808 15:50:46.772017 27818 raft_consensus.cc:374] T 94fee464351b49d89e9ff64d20372b15 P eae829fb7aea40dcbae8fef4b847f40e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:46.772097 27818 raft_consensus.cc:729] T 94fee464351b49d89e9ff64d20372b15 P eae829fb7aea40dcbae8fef4b847f40e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae829fb7aea40dcbae8fef4b847f40e, State: Initialized, Role: FOLLOWER
I20260808 15:50:46.772636 27821 tablet_bootstrap.cc:492] T 94fee464351b49d89e9ff64d20372b15 P 60026776a691441885b06986c444173f: No bootstrap required, opened a new log
I20260808 15:50:46.772673 27818 consensus_queue.cc:260] T 94fee464351b49d89e9ff64d20372b15 P eae829fb7aea40dcbae8fef4b847f40e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae829fb7aea40dcbae8fef4b847f40e" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 33061 } } peers { permanent_uuid: "60026776a691441885b06986c444173f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 35035 } } peers { permanent_uuid: "4085c908151a4f10a0fbcf8efbe29ca7" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39429 } }
I20260808 15:50:46.772878 27821 ts_tablet_manager.cc:1397] T 94fee464351b49d89e9ff64d20372b15 P 60026776a691441885b06986c444173f: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 15:50:46.773494 27800 heartbeater.cc:503] Master 127.8.39.126:38205 was elected leader, sending a full tablet report...
I20260808 15:50:46.775197 27818 ts_tablet_manager.cc:1428] T 94fee464351b49d89e9ff64d20372b15 P eae829fb7aea40dcbae8fef4b847f40e: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260808 15:50:46.776167 27819 raft_consensus.cc:348] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae829fb7aea40dcbae8fef4b847f40e" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 33061 } } peers { permanent_uuid: "60026776a691441885b06986c444173f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 35035 } } peers { permanent_uuid: "4085c908151a4f10a0fbcf8efbe29ca7" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39429 } }
I20260808 15:50:46.776400 27819 raft_consensus.cc:374] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:46.776435 27819 raft_consensus.cc:729] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4085c908151a4f10a0fbcf8efbe29ca7, State: Initialized, Role: FOLLOWER
I20260808 15:50:46.776607 27821 raft_consensus.cc:348] T 94fee464351b49d89e9ff64d20372b15 P 60026776a691441885b06986c444173f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae829fb7aea40dcbae8fef4b847f40e" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 33061 } } peers { permanent_uuid: "60026776a691441885b06986c444173f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 35035 } } peers { permanent_uuid: "4085c908151a4f10a0fbcf8efbe29ca7" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39429 } }
I20260808 15:50:46.776865 27821 raft_consensus.cc:374] T 94fee464351b49d89e9ff64d20372b15 P 60026776a691441885b06986c444173f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:46.776953 27821 raft_consensus.cc:729] T 94fee464351b49d89e9ff64d20372b15 P 60026776a691441885b06986c444173f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60026776a691441885b06986c444173f, State: Initialized, Role: FOLLOWER
I20260808 15:50:46.776906 27819 consensus_queue.cc:260] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae829fb7aea40dcbae8fef4b847f40e" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 33061 } } peers { permanent_uuid: "60026776a691441885b06986c444173f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 35035 } } peers { permanent_uuid: "4085c908151a4f10a0fbcf8efbe29ca7" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39429 } }
I20260808 15:50:46.777403 27821 consensus_queue.cc:260] T 94fee464351b49d89e9ff64d20372b15 P 60026776a691441885b06986c444173f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae829fb7aea40dcbae8fef4b847f40e" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 33061 } } peers { permanent_uuid: "60026776a691441885b06986c444173f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 35035 } } peers { permanent_uuid: "4085c908151a4f10a0fbcf8efbe29ca7" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39429 } }
I20260808 15:50:46.778141 27819 ts_tablet_manager.cc:1428] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7: Time spent starting tablet: real 0.007s user 0.004s sys 0.002s
I20260808 15:50:46.778340 27821 ts_tablet_manager.cc:1428] T 94fee464351b49d89e9ff64d20372b15 P 60026776a691441885b06986c444173f: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 15:50:46.778717 27658 heartbeater.cc:503] Master 127.8.39.126:38205 was elected leader, sending a full tablet report...
I20260808 15:50:46.778795 27511 heartbeater.cc:503] Master 127.8.39.126:38205 was elected leader, sending a full tablet report...
W20260808 15:50:46.929412 27659 tablet.cc:2369] T 94fee464351b49d89e9ff64d20372b15 P 60026776a691441885b06986c444173f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:50:46.936451 27801 tablet.cc:2369] T 94fee464351b49d89e9ff64d20372b15 P eae829fb7aea40dcbae8fef4b847f40e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:50:46.944092 27513 tablet.cc:2369] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:50:46.983748 27826 raft_consensus.cc:482] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:50:46.984043 27826 raft_consensus.cc:504] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae829fb7aea40dcbae8fef4b847f40e" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 33061 } } peers { permanent_uuid: "60026776a691441885b06986c444173f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 35035 } } peers { permanent_uuid: "4085c908151a4f10a0fbcf8efbe29ca7" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39429 } }
I20260808 15:50:46.985306 27826 leader_election.cc:288] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae829fb7aea40dcbae8fef4b847f40e (127.8.39.67:33061), 60026776a691441885b06986c444173f (127.8.39.66:35035)
I20260808 15:50:46.989589 27812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:46.985716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:41647 (local address 127.8.39.67:33061)
0808 15:50:46.985888 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:46.985893 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:46.986163 (+ 270us) server_negotiation.cc:407] Connection header received
0808 15:50:46.986413 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:46.986416 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:46.986462 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:46.986569 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:46.986958 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.987464 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.988610 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.989012 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.989133 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:46.989196 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:46.989381 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 15:50:46.989452 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 15:50:46.989629 27828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:46.985656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:33061 (local address 127.8.39.65:41647)
0808 15:50:46.986054 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:46.986068 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:46.986257 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:46.986583 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:46.986586 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:46.986612 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:46.986839 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:46.986845 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.987598 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.987602 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:46.988480 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:46.988490 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.989144 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.989147 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:46.989243 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:46.989273 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 15:50:46.989362 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 15:50:46.989438 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"mutex_wait_us":61,"spinlock_wait_cycles":53376,"thread_start_us":144,"threads_started":1}
I20260808 15:50:46.989863 27814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:46.985706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:52699 (local address 127.8.39.66:35035)
0808 15:50:46.985854 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:46.985861 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:46.986191 (+ 330us) server_negotiation.cc:407] Connection header received
0808 15:50:46.986393 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:46.986399 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:46.986454 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:46.986567 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:46.986973 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.987510 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.988821 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.989226 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.989350 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:46.989415 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:46.989623 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 15:50:46.989709 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 15:50:46.989982 27829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:46.985658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:35035 (local address 127.8.39.65:52699)
0808 15:50:46.986062 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:46.986088 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:46.986266 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:46.986582 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:46.986585 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:46.986618 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:46.986832 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:46.986839 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.987635 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.987640 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:46.988667 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:46.988678 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:46.989357 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:46.989360 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:46.989476 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:46.989505 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 15:50:46.989598 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 15:50:46.989819 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"mutex_wait_us":100,"spinlock_wait_cycles":14336,"thread_start_us":125,"threads_started":1}
I20260808 15:50:46.990778 27752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94fee464351b49d89e9ff64d20372b15" candidate_uuid: "4085c908151a4f10a0fbcf8efbe29ca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae829fb7aea40dcbae8fef4b847f40e" is_pre_election: true
I20260808 15:50:46.990769 27608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94fee464351b49d89e9ff64d20372b15" candidate_uuid: "4085c908151a4f10a0fbcf8efbe29ca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60026776a691441885b06986c444173f" is_pre_election: true
I20260808 15:50:46.991132 27608 raft_consensus.cc:2454] T 94fee464351b49d89e9ff64d20372b15 P 60026776a691441885b06986c444173f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4085c908151a4f10a0fbcf8efbe29ca7 in term 0.
I20260808 15:50:46.991132 27752 raft_consensus.cc:2454] T 94fee464351b49d89e9ff64d20372b15 P eae829fb7aea40dcbae8fef4b847f40e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4085c908151a4f10a0fbcf8efbe29ca7 in term 0.
I20260808 15:50:46.991700 27394 leader_election.cc:302] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4085c908151a4f10a0fbcf8efbe29ca7, 60026776a691441885b06986c444173f, eae829fb7aea40dcbae8fef4b847f40e; no voters:
I20260808 15:50:46.992092 27826 raft_consensus.cc:2781] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:50:46.992192 27826 raft_consensus.cc:482] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:50:46.992251 27826 raft_consensus.cc:3037] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:46.993428 27826 raft_consensus.cc:504] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae829fb7aea40dcbae8fef4b847f40e" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 33061 } } peers { permanent_uuid: "60026776a691441885b06986c444173f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 35035 } } peers { permanent_uuid: "4085c908151a4f10a0fbcf8efbe29ca7" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39429 } }
I20260808 15:50:46.993885 27826 leader_election.cc:288] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7 [CANDIDATE]: Term 1 election: Requested vote from peers eae829fb7aea40dcbae8fef4b847f40e (127.8.39.67:33061), 60026776a691441885b06986c444173f (127.8.39.66:35035)
I20260808 15:50:46.994886 27752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94fee464351b49d89e9ff64d20372b15" candidate_uuid: "4085c908151a4f10a0fbcf8efbe29ca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae829fb7aea40dcbae8fef4b847f40e"
I20260808 15:50:46.995002 27608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94fee464351b49d89e9ff64d20372b15" candidate_uuid: "4085c908151a4f10a0fbcf8efbe29ca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60026776a691441885b06986c444173f"
I20260808 15:50:46.995081 27752 raft_consensus.cc:3037] T 94fee464351b49d89e9ff64d20372b15 P eae829fb7aea40dcbae8fef4b847f40e [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:46.995141 27608 raft_consensus.cc:3037] T 94fee464351b49d89e9ff64d20372b15 P 60026776a691441885b06986c444173f [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:46.996703 27608 raft_consensus.cc:2454] T 94fee464351b49d89e9ff64d20372b15 P 60026776a691441885b06986c444173f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4085c908151a4f10a0fbcf8efbe29ca7 in term 1.
I20260808 15:50:46.996702 27752 raft_consensus.cc:2454] T 94fee464351b49d89e9ff64d20372b15 P eae829fb7aea40dcbae8fef4b847f40e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4085c908151a4f10a0fbcf8efbe29ca7 in term 1.
I20260808 15:50:46.997246 27396 leader_election.cc:302] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4085c908151a4f10a0fbcf8efbe29ca7, eae829fb7aea40dcbae8fef4b847f40e; no voters:
I20260808 15:50:46.997548 27826 raft_consensus.cc:2781] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:50:46.997848 27826 raft_consensus.cc:686] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7 [term 1 LEADER]: Becoming Leader. State: Replica: 4085c908151a4f10a0fbcf8efbe29ca7, State: Running, Role: LEADER
I20260808 15:50:46.998301 27826 consensus_queue.cc:237] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae829fb7aea40dcbae8fef4b847f40e" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 33061 } } peers { permanent_uuid: "60026776a691441885b06986c444173f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 35035 } } peers { permanent_uuid: "4085c908151a4f10a0fbcf8efbe29ca7" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39429 } }
I20260808 15:50:47.002169 27309 catalog_manager.cc:5495] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4085c908151a4f10a0fbcf8efbe29ca7 (127.8.39.65). New cstate: current_term: 1 leader_uuid: "4085c908151a4f10a0fbcf8efbe29ca7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae829fb7aea40dcbae8fef4b847f40e" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 33061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60026776a691441885b06986c444173f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 35035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4085c908151a4f10a0fbcf8efbe29ca7" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 39429 } health_report { overall_health: HEALTHY } } }
I20260808 15:50:47.061118 27817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:47.057309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46512 (local address 127.8.39.65:39429)
0808 15:50:47.057442 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:47.057445 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:47.057460 (+ 15us) server_negotiation.cc:407] Connection header received
0808 15:50:47.057565 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:47.057567 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:47.057623 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:47.057722 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:50:47.058013 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:47.058623 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:47.059541 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:47.059773 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:47.059878 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:47.060181 (+ 303us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:50:47.060633 (+ 452us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:50:47.060752 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:47.060944 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 15:50:47.060989 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 15:50:47.067878 27752 raft_consensus.cc:1261] T 94fee464351b49d89e9ff64d20372b15 P eae829fb7aea40dcbae8fef4b847f40e [term 1 FOLLOWER]: Refusing update from remote peer 4085c908151a4f10a0fbcf8efbe29ca7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:50:47.067878 27608 raft_consensus.cc:1261] T 94fee464351b49d89e9ff64d20372b15 P 60026776a691441885b06986c444173f [term 1 FOLLOWER]: Refusing update from remote peer 4085c908151a4f10a0fbcf8efbe29ca7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:50:47.068830 27826 consensus_queue.cc:1035] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60026776a691441885b06986c444173f" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 35035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:50:47.069073 27830 consensus_queue.cc:1035] T 94fee464351b49d89e9ff64d20372b15 P 4085c908151a4f10a0fbcf8efbe29ca7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eae829fb7aea40dcbae8fef4b847f40e" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 33061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:50:47.078718 27834 mvcc.cc:205] Tried to move back new op lower bound from 7316292595981369344 to 7316292595708039168. Current Snapshot: MvccSnapshot[applied={T|T < 7316292595981369344}]
I20260808 15:50:47.087394 27309 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55294:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:50:47.087596 27309 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55294:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:50:47.090098 27309 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4c25b8d7a41c436688592a8ec35997d5: Sending DeleteTablet for 3 replicas of tablet 94fee464351b49d89e9ff64d20372b15
I20260808 15:50:47.090988 27732 tablet_service.cc:1514] Processing DeleteTablet for tablet 94fee464351b49d89e9ff64d20372b15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:50:47 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:48214
I20260808 15:50:47.091027 27586 tablet_service.cc:1514] Processing DeleteTablet for tablet 94fee464351b49d89e9ff64d20372b15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:50:47 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:36582
I20260808 15:50:47.091022 27443 tablet_service.cc:1514] Processing DeleteTablet for tablet 94fee464351b49d89e9ff64d20372b15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:50:47 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:46504
I20260808 15:50:47.091609 27842 tablet_replica.cc:330] T 94fee464351b49d89e9ff64d20372b15 P eae829fb7aea40dcbae8fef4b847f40e: stopping tablet replica
I20260808 15:50:47.091969 27842 raft_consensus.cc:2229] T 94fee464351b49d89e9ff64d20372b15 P eae829fb7aea40dcbae8fef4b847f40e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:50:47.092296 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 27377
I20260808 15:50:47.092321 27842 raft_consensus.cc:2258] T 94fee464351b49d89e9ff64d20372b15 P eae829fb7aea40dcbae8fef4b847f40e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:50:47.092705 27844 tablet_replica.cc:330] T 94fee464351b49d89e9ff64d20372b15 P 60026776a691441885b06986c444173f: stopping tablet replica
I20260808 15:50:47.092998 27844 raft_consensus.cc:2229] T 94fee464351b49d89e9ff64d20372b15 P 60026776a691441885b06986c444173f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:50:47.093302 27844 raft_consensus.cc:2258] T 94fee464351b49d89e9ff64d20372b15 P 60026776a691441885b06986c444173f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:50:47.095099 27842 ts_tablet_manager.cc:1905] T 94fee464351b49d89e9ff64d20372b15 P eae829fb7aea40dcbae8fef4b847f40e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:50:47.095099 27844 ts_tablet_manager.cc:1905] T 94fee464351b49d89e9ff64d20372b15 P 60026776a691441885b06986c444173f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:50:47.097847 27844 ts_tablet_manager.cc:1918] T 94fee464351b49d89e9ff64d20372b15 P 60026776a691441885b06986c444173f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:50:47.097966 27844 log.cc:1196] T 94fee464351b49d89e9ff64d20372b15 P 60026776a691441885b06986c444173f: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-1/wal/wals/94fee464351b49d89e9ff64d20372b15
I20260808 15:50:47.098312 27844 ts_tablet_manager.cc:1939] T 94fee464351b49d89e9ff64d20372b15 P 60026776a691441885b06986c444173f: Deleting consensus metadata
I20260808 15:50:47.098627 27842 ts_tablet_manager.cc:1918] T 94fee464351b49d89e9ff64d20372b15 P eae829fb7aea40dcbae8fef4b847f40e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:50:47.098753 27842 log.cc:1196] T 94fee464351b49d89e9ff64d20372b15 P eae829fb7aea40dcbae8fef4b847f40e: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/94fee464351b49d89e9ff64d20372b15
I20260808 15:50:47.099126 27842 ts_tablet_manager.cc:1939] T 94fee464351b49d89e9ff64d20372b15 P eae829fb7aea40dcbae8fef4b847f40e: Deleting consensus metadata
I20260808 15:50:47.099668 27293 catalog_manager.cc:4841] TS 60026776a691441885b06986c444173f (127.8.39.66:35035): tablet 94fee464351b49d89e9ff64d20372b15 (table test-table [id=6ac6caaafa5e4dea82a2296ce393d1fc]) successfully deleted
I20260808 15:50:47.100301 27295 catalog_manager.cc:4841] TS eae829fb7aea40dcbae8fef4b847f40e (127.8.39.67:33061): tablet 94fee464351b49d89e9ff64d20372b15 (table test-table [id=6ac6caaafa5e4dea82a2296ce393d1fc]) successfully deleted
W20260808 15:50:47.102339 27293 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.39.65:39429 (error 108)
I20260808 15:50:47.103178 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 27517
I20260808 15:50:47.110047 27813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:47.109669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:39429 (local address 127.0.0.1:46518)
0808 15:50:47.109860 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:47.109957 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.65:39429: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
W20260808 15:50:47.110304 27293 catalog_manager.cc:4584] TS 4085c908151a4f10a0fbcf8efbe29ca7 (127.8.39.65:39429): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 94fee464351b49d89e9ff64d20372b15: Network error: Client connection negotiation failed: client connection to 127.8.39.65:39429: connect: Connection refused (error 111)
I20260808 15:50:47.115535 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 27663
I20260808 15:50:47.123693 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 27276
2026-08-08T15:50:47Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2691 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T15:50:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:50:47Z Disabled control of system clock
I20260808 15:50:47.158733 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:41745
--webserver_interface=127.8.39.126
--webserver_port=0
--builtin_ntp_servers=127.8.39.84:44569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:41745
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 15:50:47.275017 27850 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:47.275295 27850 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:47.275331 27850 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:47.279337 27850 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:50:47.279404 27850 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:47.279420 27850 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:47.279438 27850 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:50:47.279453 27850 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:50:47.284227 27850 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:44569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:41745
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:41745
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27850
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:47.285454 27850 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:47.286996 27850 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:47.295849 27859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:47.295878 27856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:47.295876 27855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:47.296128 27850 server_base.cc:1034] running on GCE node
I20260808 15:50:47.296921 27850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:47.298535 27850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:47.299728 27850 hybrid_clock.cc:648] HybridClock initialized: now 1786204247299690 us; error 57 us; skew 500 ppm
I20260808 15:50:47.301811 27850 webserver.cc:460] Webserver started at http://127.8.39.126:38431/ using document root <none> and password file <none>
I20260808 15:50:47.302428 27850 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:47.302525 27850 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:47.302832 27850 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:47.304981 27850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "87384675c56e4c2cbff4e103b008df5e"
format_stamp: "Formatted at 2026-08-08 15:50:47 on dist-test-slave-8tdl"
server_key: "735e285082e73108652533a86c4d0899"
server_key_iv: "ad64929777a37698a8a29bf6adb594d3"
server_key_version: "encryptionkey@0"
I20260808 15:50:47.305655 27850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "87384675c56e4c2cbff4e103b008df5e"
format_stamp: "Formatted at 2026-08-08 15:50:47 on dist-test-slave-8tdl"
server_key: "735e285082e73108652533a86c4d0899"
server_key_iv: "ad64929777a37698a8a29bf6adb594d3"
server_key_version: "encryptionkey@0"
I20260808 15:50:47.309592 27850 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260808 15:50:47.312381 27865 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:47.313753 27850 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 15:50:47.313947 27850 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "87384675c56e4c2cbff4e103b008df5e"
format_stamp: "Formatted at 2026-08-08 15:50:47 on dist-test-slave-8tdl"
server_key: "735e285082e73108652533a86c4d0899"
server_key_iv: "ad64929777a37698a8a29bf6adb594d3"
server_key_version: "encryptionkey@0"
I20260808 15:50:47.314082 27850 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:47.324061 27850 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:47.324806 27850 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:47.325022 27850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:47.332466 27850 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:41745
I20260808 15:50:47.332482 27921 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:41745 every 8 connection(s)
I20260808 15:50:47.333457 27850 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:50:47.335670 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 27850
I20260808 15:50:47.335814 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:50:47.336169 8349 external_mini_cluster.cc:1428] Setting key 5974027aa8cd1b224f0f1982466722b3
I20260808 15:50:47.337574 27922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:47.345132 27922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87384675c56e4c2cbff4e103b008df5e: Bootstrap starting.
I20260808 15:50:47.346050 27925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:47.337692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49454 (local address 127.8.39.126:41745)
0808 15:50:47.338340 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:47.338357 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:47.338401 (+ 44us) server_negotiation.cc:407] Connection header received
0808 15:50:47.339154 (+ 753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:47.339173 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:47.339577 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:47.339957 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:47.340331 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:47.341305 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:47.342606 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:47.343151 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:47.343277 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:47.344258 (+ 981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:47.344263 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:47.344275 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:50:47.344673 (+ 398us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:47.344731 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:50:47.344751 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:47.344826 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:47.345016 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 15:50:47.345300 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":159,"threads_started":1}
I20260808 15:50:47.347736 27922 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87384675c56e4c2cbff4e103b008df5e: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:47.348577 27922 log.cc:824] T 00000000000000000000000000000000 P 87384675c56e4c2cbff4e103b008df5e: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:47.350775 27922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87384675c56e4c2cbff4e103b008df5e: No bootstrap required, opened a new log
I20260808 15:50:47.354574 27922 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87384675c56e4c2cbff4e103b008df5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87384675c56e4c2cbff4e103b008df5e" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41745 } }
I20260808 15:50:47.354964 27922 raft_consensus.cc:374] T 00000000000000000000000000000000 P 87384675c56e4c2cbff4e103b008df5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:47.355058 27922 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87384675c56e4c2cbff4e103b008df5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87384675c56e4c2cbff4e103b008df5e, State: Initialized, Role: FOLLOWER
I20260808 15:50:47.355538 27922 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87384675c56e4c2cbff4e103b008df5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87384675c56e4c2cbff4e103b008df5e" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41745 } }
I20260808 15:50:47.355701 27922 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87384675c56e4c2cbff4e103b008df5e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:50:47.355800 27922 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87384675c56e4c2cbff4e103b008df5e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:50:47.355952 27922 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87384675c56e4c2cbff4e103b008df5e [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:47.357061 27922 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87384675c56e4c2cbff4e103b008df5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87384675c56e4c2cbff4e103b008df5e" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41745 } }
I20260808 15:50:47.357461 27922 leader_election.cc:302] T 00000000000000000000000000000000 P 87384675c56e4c2cbff4e103b008df5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87384675c56e4c2cbff4e103b008df5e; no voters:
I20260808 15:50:47.357890 27922 leader_election.cc:288] T 00000000000000000000000000000000 P 87384675c56e4c2cbff4e103b008df5e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:50:47.358067 27927 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87384675c56e4c2cbff4e103b008df5e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:50:47.358335 27927 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87384675c56e4c2cbff4e103b008df5e [term 1 LEADER]: Becoming Leader. State: Replica: 87384675c56e4c2cbff4e103b008df5e, State: Running, Role: LEADER
I20260808 15:50:47.358664 27927 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87384675c56e4c2cbff4e103b008df5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87384675c56e4c2cbff4e103b008df5e" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41745 } }
I20260808 15:50:47.359359 27922 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87384675c56e4c2cbff4e103b008df5e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:50:47.360505 27929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87384675c56e4c2cbff4e103b008df5e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87384675c56e4c2cbff4e103b008df5e. Latest consensus state: current_term: 1 leader_uuid: "87384675c56e4c2cbff4e103b008df5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87384675c56e4c2cbff4e103b008df5e" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41745 } } }
I20260808 15:50:47.360628 27929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87384675c56e4c2cbff4e103b008df5e [sys.catalog]: This master's current role is: LEADER
I20260808 15:50:47.360906 27928 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87384675c56e4c2cbff4e103b008df5e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "87384675c56e4c2cbff4e103b008df5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87384675c56e4c2cbff4e103b008df5e" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 41745 } } }
I20260808 15:50:47.360991 27928 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87384675c56e4c2cbff4e103b008df5e [sys.catalog]: This master's current role is: LEADER
W20260808 15:50:47.364677 27945 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 87384675c56e4c2cbff4e103b008df5e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:50:47.364760 27945 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:50:47.364871 27938 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:50:47.365667 27938 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:50:47.372339 27938 catalog_manager.cc:1347] Generated new cluster ID: e8aec15673204152a105976b6e9159c8
I20260808 15:50:47.372439 27938 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:50:47.381968 27938 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:50:47.383327 27938 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:50:47.398001 27938 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 87384675c56e4c2cbff4e103b008df5e: Generated new TSK 0
I20260808 15:50:47.399097 27938 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:50:47.407007 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:0
--local_ip_for_outbound_sockets=127.8.39.65
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41745
--builtin_ntp_servers=127.8.39.84:44569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 15:50:47.538575 27948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:47.538992 27948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:47.539098 27948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:47.543859 27948 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:47.543968 27948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:47.544070 27948 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:50:47.549737 27948 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:44569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41745
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27948
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:47.551169 27948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:47.552796 27948 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:47.564380 27954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:47.564412 27955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:47.564605 27948 server_base.cc:1034] running on GCE node
W20260808 15:50:47.564380 27957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:47.565231 27948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:47.565994 27948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:47.567194 27948 hybrid_clock.cc:648] HybridClock initialized: now 1786204247567175 us; error 32 us; skew 500 ppm
I20260808 15:50:47.569442 27948 webserver.cc:460] Webserver started at http://127.8.39.65:46091/ using document root <none> and password file <none>
I20260808 15:50:47.570060 27948 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:47.570161 27948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:47.570402 27948 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:47.572638 27948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-0/data/instance:
uuid: "7a2c59dd1574411285652206d6330521"
format_stamp: "Formatted at 2026-08-08 15:50:47 on dist-test-slave-8tdl"
server_key: "2aa9c5c0ea27371c17a4c391eec845ce"
server_key_iv: "35a27ded1dbc408b220fa034b903eb71"
server_key_version: "encryptionkey@0"
I20260808 15:50:47.573237 27948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance:
uuid: "7a2c59dd1574411285652206d6330521"
format_stamp: "Formatted at 2026-08-08 15:50:47 on dist-test-slave-8tdl"
server_key: "2aa9c5c0ea27371c17a4c391eec845ce"
server_key_iv: "35a27ded1dbc408b220fa034b903eb71"
server_key_version: "encryptionkey@0"
I20260808 15:50:47.577538 27948 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 15:50:47.580339 27965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:47.581645 27948 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:50:47.581776 27948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "7a2c59dd1574411285652206d6330521"
format_stamp: "Formatted at 2026-08-08 15:50:47 on dist-test-slave-8tdl"
server_key: "2aa9c5c0ea27371c17a4c391eec845ce"
server_key_iv: "35a27ded1dbc408b220fa034b903eb71"
server_key_version: "encryptionkey@0"
I20260808 15:50:47.581902 27948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:47.601933 27948 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:47.602804 27948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:47.603024 27948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:47.603704 27948 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:50:47.604739 27948 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:50:47.604789 27948 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:47.604854 27948 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:50:47.604887 27948 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:47.614068 27948 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:36549
I20260808 15:50:47.614092 28090 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:36549 every 8 connection(s)
I20260808 15:50:47.615098 27948 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:50:47.616189 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 27948
I20260808 15:50:47.616333 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance
I20260808 15:50:47.616618 8349 external_mini_cluster.cc:1428] Setting key 0083efeac00d1d363d8ee9bbc4e26fe4
I20260808 15:50:47.618882 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:0
--local_ip_for_outbound_sockets=127.8.39.66
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41745
--builtin_ntp_servers=127.8.39.84:44569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 15:50:47.627285 27925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:47.617266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:52287 (local address 127.8.39.126:41745)
0808 15:50:47.617434 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:47.617438 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:47.618937 (+ 1499us) server_negotiation.cc:407] Connection header received
0808 15:50:47.621180 (+ 2243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:47.621186 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:47.621262 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:47.621369 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:47.622363 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:47.623271 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:47.624762 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:47.625221 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:47.625359 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:47.626594 (+ 1235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:47.626600 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:47.626606 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:50:47.626627 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:47.626654 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:50:47.626670 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:47.626793 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:47.626947 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 15:50:47.627061 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 15:50:47.628113 28093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:47.617780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41745 (local address 127.8.39.65:52287)
0808 15:50:47.618758 (+ 978us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:47.618821 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:47.620875 (+ 2054us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:47.621535 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:47.621541 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:47.621629 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:50:47.622206 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:47.622218 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:47.623438 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:47.623441 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:47.624614 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:47.624626 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:47.625413 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:47.625416 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:47.625581 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:47.626287 (+ 706us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:50:47.626288 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:50:47.626332 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:50:47.626404 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:50:47.626789 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:50:47.626797 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:50:47.626802 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 15:50:47.626909 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 15:50:47.627160 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":157,"threads_started":1}
I20260808 15:50:47.629505 28091 heartbeater.cc:347] Connected to a master server at 127.8.39.126:41745
I20260808 15:50:47.629765 28091 heartbeater.cc:464] Registering TS with master...
I20260808 15:50:47.630349 28091 heartbeater.cc:511] Master 127.8.39.126:41745 requested a full tablet report, sending...
I20260808 15:50:47.631935 27883 ts_manager.cc:194] Registered new tserver with Master: 7a2c59dd1574411285652206d6330521 (127.8.39.65:36549)
I20260808 15:50:47.633088 27883 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.39.65:52287
W20260808 15:50:47.740520 28094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:47.740887 28094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:47.740939 28094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:47.745342 28094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:47.745426 28094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:47.745486 28094 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:50:47.750784 28094 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:44569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41745
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28094
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:47.752035 28094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:47.753530 28094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:47.764369 28099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:47.764442 28094 server_base.cc:1034] running on GCE node
W20260808 15:50:47.764380 28103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:47.764320 28100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:47.764952 28094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:47.765702 28094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:47.766896 28094 hybrid_clock.cc:648] HybridClock initialized: now 1786204247766875 us; error 34 us; skew 500 ppm
I20260808 15:50:47.769008 28094 webserver.cc:460] Webserver started at http://127.8.39.66:42187/ using document root <none> and password file <none>
I20260808 15:50:47.769641 28094 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:47.769742 28094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:47.769990 28094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:47.772274 28094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-1/data/instance:
uuid: "fce274b6587243b4a202676164541352"
format_stamp: "Formatted at 2026-08-08 15:50:47 on dist-test-slave-8tdl"
server_key: "b43b3f0d2296e30eaf61a61a8a5468c3"
server_key_iv: "8bfb126e190e40e2c3264ef6d50f29e5"
server_key_version: "encryptionkey@0"
I20260808 15:50:47.772902 28094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance:
uuid: "fce274b6587243b4a202676164541352"
format_stamp: "Formatted at 2026-08-08 15:50:47 on dist-test-slave-8tdl"
server_key: "b43b3f0d2296e30eaf61a61a8a5468c3"
server_key_iv: "8bfb126e190e40e2c3264ef6d50f29e5"
server_key_version: "encryptionkey@0"
I20260808 15:50:47.776959 28094 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 15:50:47.779798 28109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:47.781186 28094 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:50:47.781338 28094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "fce274b6587243b4a202676164541352"
format_stamp: "Formatted at 2026-08-08 15:50:47 on dist-test-slave-8tdl"
server_key: "b43b3f0d2296e30eaf61a61a8a5468c3"
server_key_iv: "8bfb126e190e40e2c3264ef6d50f29e5"
server_key_version: "encryptionkey@0"
I20260808 15:50:47.781467 28094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:47.801100 28094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:47.801892 28094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:47.802129 28094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:47.802851 28094 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:50:47.803975 28094 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:50:47.804055 28094 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:47.804119 28094 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:50:47.804171 28094 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:47.813524 28094 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:42731
I20260808 15:50:47.813585 28227 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:42731 every 8 connection(s)
I20260808 15:50:47.814512 28094 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:50:47.817783 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 28094
I20260808 15:50:47.817910 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance
I20260808 15:50:47.818290 8349 external_mini_cluster.cc:1428] Setting key 9e11152708bcc924854b8c30a07e42e9
I20260808 15:50:47.820621 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:0
--local_ip_for_outbound_sockets=127.8.39.67
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41745
--builtin_ntp_servers=127.8.39.84:44569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 15:50:47.825760 27925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:47.816661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:56613 (local address 127.8.39.126:41745)
0808 15:50:47.816816 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:47.816820 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:47.818186 (+ 1366us) server_negotiation.cc:407] Connection header received
0808 15:50:47.819988 (+ 1802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:47.819991 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:47.820035 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:47.820113 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:47.821393 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:47.821990 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:47.823489 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:47.823737 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:47.823864 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:47.825204 (+ 1340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:47.825208 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:47.825210 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:50:47.825226 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:47.825247 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:50:47.825255 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:47.825340 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:47.825515 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 15:50:47.825605 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 15:50:47.826741 28230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:47.817072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41745 (local address 127.8.39.66:56613)
0808 15:50:47.817935 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:47.817996 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:47.819741 (+ 1745us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:47.820303 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:47.820315 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:47.820433 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:50:47.821185 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:47.821208 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:47.822158 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:47.822165 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:47.823349 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:47.823360 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:47.823915 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:47.823920 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:47.824110 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:47.824822 (+ 712us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:50:47.824824 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:50:47.824873 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:50:47.824947 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:50:47.825353 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:50:47.825365 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:50:47.825371 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 15:50:47.825515 (+ 144us) client_negotiation.cc:240] Negotiation successful
0808 15:50:47.825828 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":125,"threads_started":1}
I20260808 15:50:47.828014 28228 heartbeater.cc:347] Connected to a master server at 127.8.39.126:41745
I20260808 15:50:47.828274 28228 heartbeater.cc:464] Registering TS with master...
I20260808 15:50:47.828835 28228 heartbeater.cc:511] Master 127.8.39.126:41745 requested a full tablet report, sending...
I20260808 15:50:47.830014 27883 ts_manager.cc:194] Registered new tserver with Master: fce274b6587243b4a202676164541352 (127.8.39.66:42731)
I20260808 15:50:47.830953 27883 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.39.66:56613
W20260808 15:50:47.939728 28231 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:47.940037 28231 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:47.940075 28231 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:47.944249 28231 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:47.944324 28231 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:47.944383 28231 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:50:47.949533 28231 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:44569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:41745
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28231
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:47.950711 28231 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:47.952109 28231 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 15:50:47.962383 28231 server_base.cc:1034] running on GCE node
W20260808 15:50:47.962298 28237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:47.962314 28240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:47.962298 28238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:47.963171 28231 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:47.963848 28231 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:47.965052 28231 hybrid_clock.cc:648] HybridClock initialized: now 1786204247965023 us; error 49 us; skew 500 ppm
I20260808 15:50:47.967133 28231 webserver.cc:460] Webserver started at http://127.8.39.67:42415/ using document root <none> and password file <none>
I20260808 15:50:47.967742 28231 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:47.967837 28231 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:47.968088 28231 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:47.970244 28231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-2/data/instance:
uuid: "d6ddf16697b347e1b3d32bcb0bd288a1"
format_stamp: "Formatted at 2026-08-08 15:50:47 on dist-test-slave-8tdl"
server_key: "9bc94e36246321573deabc020cba14b5"
server_key_iv: "2726909911758b1facff8fa6bc2fecbe"
server_key_version: "encryptionkey@0"
I20260808 15:50:47.970901 28231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance:
uuid: "d6ddf16697b347e1b3d32bcb0bd288a1"
format_stamp: "Formatted at 2026-08-08 15:50:47 on dist-test-slave-8tdl"
server_key: "9bc94e36246321573deabc020cba14b5"
server_key_iv: "2726909911758b1facff8fa6bc2fecbe"
server_key_version: "encryptionkey@0"
I20260808 15:50:47.974979 28231 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 15:50:47.977526 28246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:47.978919 28231 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:50:47.979146 28231 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "d6ddf16697b347e1b3d32bcb0bd288a1"
format_stamp: "Formatted at 2026-08-08 15:50:47 on dist-test-slave-8tdl"
server_key: "9bc94e36246321573deabc020cba14b5"
server_key_iv: "2726909911758b1facff8fa6bc2fecbe"
server_key_version: "encryptionkey@0"
I20260808 15:50:47.979277 28231 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:48.003815 28231 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:48.004628 28231 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:48.004868 28231 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:48.005549 28231 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:50:48.006630 28231 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:50:48.006728 28231 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:48.006825 28231 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:50:48.006878 28231 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:48.017082 28231 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:43731
I20260808 15:50:48.017099 28369 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:43731 every 8 connection(s)
I20260808 15:50:48.018149 28231 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:50:48.019079 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 28231
I20260808 15:50:48.019212 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance
I20260808 15:50:48.019556 8349 external_mini_cluster.cc:1428] Setting key b1e3641c0e490b7d17c0962826903e9f
I20260808 15:50:48.028187 27925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:48.020236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:43251 (local address 127.8.39.126:41745)
0808 15:50:48.020378 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:48.020381 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:48.021816 (+ 1435us) server_negotiation.cc:407] Connection header received
0808 15:50:48.023307 (+ 1491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:48.023311 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:48.023378 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:48.023454 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:48.024347 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.024889 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.026052 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.026289 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.026400 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:48.027645 (+ 1245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:48.027649 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:48.027652 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:50:48.027670 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:48.027694 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:50:48.027702 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:48.027785 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:48.027951 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 15:50:48.028020 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 15:50:48.029121 28372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:48.020767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:41745 (local address 127.8.39.67:43251)
0808 15:50:48.021651 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:48.021710 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:48.023105 (+ 1395us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:48.023629 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:48.023636 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:48.023717 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:50:48.024212 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:48.024224 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.025026 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.025037 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:48.025914 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:48.025924 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.026468 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.026476 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:48.026643 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:48.027315 (+ 672us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:50:48.027317 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:50:48.027358 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:50:48.027425 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:50:48.027786 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:50:48.027798 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:50:48.027806 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 15:50:48.027937 (+ 131us) client_negotiation.cc:240] Negotiation successful
0808 15:50:48.028232 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":164,"threads_started":1}
I20260808 15:50:48.030382 28370 heartbeater.cc:347] Connected to a master server at 127.8.39.126:41745
I20260808 15:50:48.030632 28370 heartbeater.cc:464] Registering TS with master...
I20260808 15:50:48.031217 28370 heartbeater.cc:511] Master 127.8.39.126:41745 requested a full tablet report, sending...
I20260808 15:50:48.032318 27883 ts_manager.cc:194] Registered new tserver with Master: d6ddf16697b347e1b3d32bcb0bd288a1 (127.8.39.67:43731)
I20260808 15:50:48.033027 27883 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.39.67:43251
I20260808 15:50:48.033907 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:50:48.040068 27925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:48.036071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49462 (local address 127.8.39.126:41745)
0808 15:50:48.036200 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:48.036203 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:48.036367 (+ 164us) server_negotiation.cc:407] Connection header received
0808 15:50:48.036506 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:48.036508 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:48.036551 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:48.036621 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:48.036886 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.037412 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.038327 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.038539 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.038622 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:48.039616 (+ 994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:48.039620 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:48.039622 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:50:48.039633 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:48.039653 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:50:48.039661 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:48.039766 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:48.039891 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 15:50:48.039923 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 15:50:48.043133 27883 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49462:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:50:48.046124 27883 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:50:48.060963 28381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:48.054894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:36549 (local address 127.0.0.1:38612)
0808 15:50:48.055268 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:48.055316 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:48.055444 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:48.056105 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:48.056114 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:48.056145 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:48.056299 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:48.056308 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.057820 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.057823 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:48.059240 (+ 1417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:48.059248 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.060364 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.060368 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:48.060496 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:48.060541 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 15:50:48.060673 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 15:50:48.060798 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":109,"threads_started":1}
I20260808 15:50:48.060986 28383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:48.055124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38612 (local address 127.8.39.65:36549)
0808 15:50:48.055528 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:48.055542 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:48.055574 (+ 32us) server_negotiation.cc:407] Connection header received
0808 15:50:48.055663 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:48.055668 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:48.055914 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:48.056088 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:48.056464 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.057716 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.059388 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.060230 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.060345 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:48.060598 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:48.060708 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 15:50:48.060814 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":194,"threads_started":1}
I20260808 15:50:48.061962 28384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:48.055728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:43731 (local address 127.0.0.1:46908)
0808 15:50:48.056939 (+ 1211us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:48.056954 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:48.057039 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:48.057551 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:48.057554 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:48.057572 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:48.057677 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:48.057685 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.059214 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.059218 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:48.060434 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:48.060444 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.061537 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.061540 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:48.061625 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:48.061685 (+ 60us) client_negotiation.cc:769] Sending connection context
0808 15:50:48.061756 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 15:50:48.061825 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1145,"thread_start_us":134,"threads_started":1}
I20260808 15:50:48.062043 28387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:48.056433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46908 (local address 127.8.39.67:43731)
0808 15:50:48.056983 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:48.056992 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:48.057013 (+ 21us) server_negotiation.cc:407] Connection header received
0808 15:50:48.057194 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:48.057203 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:48.057415 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:48.057577 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:48.057806 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.059081 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.060571 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.061435 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.061534 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:48.061708 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:48.061783 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 15:50:48.061885 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":270,"threads_started":1}
I20260808 15:50:48.062325 28385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:48.055761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:42731 (local address 127.0.0.1:51574)
0808 15:50:48.057163 (+ 1402us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:48.057176 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:48.057273 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:48.057844 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:48.057846 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:48.057873 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:48.057943 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:48.057947 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.059116 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.059122 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:48.060199 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:48.060209 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.061948 (+ 1739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.061952 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:48.062034 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:48.062056 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 15:50:48.062127 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 15:50:48.062198 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1335,"mutex_wait_us":1,"thread_start_us":110,"threads_started":1}
I20260808 15:50:48.062848 28386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:48.056241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51574 (local address 127.8.39.66:42731)
0808 15:50:48.056785 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:48.056802 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:48.057284 (+ 482us) server_negotiation.cc:407] Connection header received
0808 15:50:48.057367 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:48.057371 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:48.057547 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:48.057685 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:48.058067 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.058961 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.060455 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.061611 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.061711 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:48.061872 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:48.062497 (+ 625us) server_negotiation.cc:299] Negotiation successful
0808 15:50:48.062697 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":211,"threads_started":1}
I20260808 15:50:48.064824 28298 tablet_service.cc:1467] Processing CreateTablet for tablet 1ae4612ada6345e3bee10522ce588dc5 (DEFAULT_TABLE table=test-table [id=0c8bc3a9c5dd44dcb0818b97d11ce27f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:50:48.064683 28019 tablet_service.cc:1467] Processing CreateTablet for tablet 1ae4612ada6345e3bee10522ce588dc5 (DEFAULT_TABLE table=test-table [id=0c8bc3a9c5dd44dcb0818b97d11ce27f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:50:48.065306 28162 tablet_service.cc:1467] Processing CreateTablet for tablet 1ae4612ada6345e3bee10522ce588dc5 (DEFAULT_TABLE table=test-table [id=0c8bc3a9c5dd44dcb0818b97d11ce27f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:50:48.065907 28298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ae4612ada6345e3bee10522ce588dc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:48.065909 28019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ae4612ada6345e3bee10522ce588dc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:48.066231 28162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ae4612ada6345e3bee10522ce588dc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:48.073596 28388 tablet_bootstrap.cc:492] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1: Bootstrap starting.
I20260808 15:50:48.074018 28391 tablet_bootstrap.cc:492] T 1ae4612ada6345e3bee10522ce588dc5 P fce274b6587243b4a202676164541352: Bootstrap starting.
I20260808 15:50:48.075076 28389 tablet_bootstrap.cc:492] T 1ae4612ada6345e3bee10522ce588dc5 P 7a2c59dd1574411285652206d6330521: Bootstrap starting.
I20260808 15:50:48.075892 28388 tablet_bootstrap.cc:654] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:48.076210 28391 tablet_bootstrap.cc:654] T 1ae4612ada6345e3bee10522ce588dc5 P fce274b6587243b4a202676164541352: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:48.076720 28388 log.cc:824] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:48.077054 28391 log.cc:824] T 1ae4612ada6345e3bee10522ce588dc5 P fce274b6587243b4a202676164541352: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:48.077301 28389 tablet_bootstrap.cc:654] T 1ae4612ada6345e3bee10522ce588dc5 P 7a2c59dd1574411285652206d6330521: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:48.078182 28389 log.cc:824] T 1ae4612ada6345e3bee10522ce588dc5 P 7a2c59dd1574411285652206d6330521: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:48.079257 28388 tablet_bootstrap.cc:492] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1: No bootstrap required, opened a new log
I20260808 15:50:48.079257 28391 tablet_bootstrap.cc:492] T 1ae4612ada6345e3bee10522ce588dc5 P fce274b6587243b4a202676164541352: No bootstrap required, opened a new log
I20260808 15:50:48.079455 28388 ts_tablet_manager.cc:1397] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 15:50:48.079455 28391 ts_tablet_manager.cc:1397] T 1ae4612ada6345e3bee10522ce588dc5 P fce274b6587243b4a202676164541352: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 15:50:48.080740 28389 tablet_bootstrap.cc:492] T 1ae4612ada6345e3bee10522ce588dc5 P 7a2c59dd1574411285652206d6330521: No bootstrap required, opened a new log
I20260808 15:50:48.080894 28389 ts_tablet_manager.cc:1397] T 1ae4612ada6345e3bee10522ce588dc5 P 7a2c59dd1574411285652206d6330521: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 15:50:48.084182 28388 raft_consensus.cc:348] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2c59dd1574411285652206d6330521" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 36549 } } peers { permanent_uuid: "fce274b6587243b4a202676164541352" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 42731 } } peers { permanent_uuid: "d6ddf16697b347e1b3d32bcb0bd288a1" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 43731 } }
I20260808 15:50:48.084273 28391 raft_consensus.cc:348] T 1ae4612ada6345e3bee10522ce588dc5 P fce274b6587243b4a202676164541352 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2c59dd1574411285652206d6330521" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 36549 } } peers { permanent_uuid: "fce274b6587243b4a202676164541352" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 42731 } } peers { permanent_uuid: "d6ddf16697b347e1b3d32bcb0bd288a1" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 43731 } }
I20260808 15:50:48.084511 28388 raft_consensus.cc:374] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:48.084511 28391 raft_consensus.cc:374] T 1ae4612ada6345e3bee10522ce588dc5 P fce274b6587243b4a202676164541352 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:48.084573 28388 raft_consensus.cc:729] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6ddf16697b347e1b3d32bcb0bd288a1, State: Initialized, Role: FOLLOWER
I20260808 15:50:48.084573 28391 raft_consensus.cc:729] T 1ae4612ada6345e3bee10522ce588dc5 P fce274b6587243b4a202676164541352 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fce274b6587243b4a202676164541352, State: Initialized, Role: FOLLOWER
I20260808 15:50:48.084383 28389 raft_consensus.cc:348] T 1ae4612ada6345e3bee10522ce588dc5 P 7a2c59dd1574411285652206d6330521 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2c59dd1574411285652206d6330521" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 36549 } } peers { permanent_uuid: "fce274b6587243b4a202676164541352" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 42731 } } peers { permanent_uuid: "d6ddf16697b347e1b3d32bcb0bd288a1" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 43731 } }
I20260808 15:50:48.084658 28389 raft_consensus.cc:374] T 1ae4612ada6345e3bee10522ce588dc5 P 7a2c59dd1574411285652206d6330521 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:48.084717 28389 raft_consensus.cc:729] T 1ae4612ada6345e3bee10522ce588dc5 P 7a2c59dd1574411285652206d6330521 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a2c59dd1574411285652206d6330521, State: Initialized, Role: FOLLOWER
I20260808 15:50:48.085050 28391 consensus_queue.cc:260] T 1ae4612ada6345e3bee10522ce588dc5 P fce274b6587243b4a202676164541352 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2c59dd1574411285652206d6330521" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 36549 } } peers { permanent_uuid: "fce274b6587243b4a202676164541352" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 42731 } } peers { permanent_uuid: "d6ddf16697b347e1b3d32bcb0bd288a1" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 43731 } }
I20260808 15:50:48.085050 28388 consensus_queue.cc:260] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2c59dd1574411285652206d6330521" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 36549 } } peers { permanent_uuid: "fce274b6587243b4a202676164541352" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 42731 } } peers { permanent_uuid: "d6ddf16697b347e1b3d32bcb0bd288a1" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 43731 } }
I20260808 15:50:48.085281 28389 consensus_queue.cc:260] T 1ae4612ada6345e3bee10522ce588dc5 P 7a2c59dd1574411285652206d6330521 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2c59dd1574411285652206d6330521" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 36549 } } peers { permanent_uuid: "fce274b6587243b4a202676164541352" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 42731 } } peers { permanent_uuid: "d6ddf16697b347e1b3d32bcb0bd288a1" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 43731 } }
I20260808 15:50:48.086154 28388 ts_tablet_manager.cc:1428] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260808 15:50:48.086165 28391 ts_tablet_manager.cc:1428] T 1ae4612ada6345e3bee10522ce588dc5 P fce274b6587243b4a202676164541352: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260808 15:50:48.086404 28389 ts_tablet_manager.cc:1428] T 1ae4612ada6345e3bee10522ce588dc5 P 7a2c59dd1574411285652206d6330521: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 15:50:48.086529 28370 heartbeater.cc:503] Master 127.8.39.126:41745 was elected leader, sending a full tablet report...
I20260808 15:50:48.086746 28091 heartbeater.cc:503] Master 127.8.39.126:41745 was elected leader, sending a full tablet report...
I20260808 15:50:48.087255 28228 heartbeater.cc:503] Master 127.8.39.126:41745 was elected leader, sending a full tablet report...
I20260808 15:50:48.097323 28397 raft_consensus.cc:482] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:50:48.097576 28397 raft_consensus.cc:504] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2c59dd1574411285652206d6330521" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 36549 } } peers { permanent_uuid: "fce274b6587243b4a202676164541352" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 42731 } } peers { permanent_uuid: "d6ddf16697b347e1b3d32bcb0bd288a1" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 43731 } }
I20260808 15:50:48.098759 28397 leader_election.cc:288] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a2c59dd1574411285652206d6330521 (127.8.39.65:36549), fce274b6587243b4a202676164541352 (127.8.39.66:42731)
I20260808 15:50:48.102857 28383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:48.099123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:53247 (local address 127.8.39.65:36549)
0808 15:50:48.099284 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:48.099290 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:48.099354 (+ 64us) server_negotiation.cc:407] Connection header received
0808 15:50:48.099493 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:48.099497 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:48.099585 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:48.099669 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:48.100082 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.100718 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.101834 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.102258 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.102337 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:48.102427 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:48.102615 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 15:50:48.102731 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 15:50:48.102851 28372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:48.099019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:36549 (local address 127.8.39.67:53247)
0808 15:50:48.099264 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:48.099285 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:48.099398 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:48.099703 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:48.099706 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:48.099726 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:48.099868 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:48.099875 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.100826 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.100829 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:48.101696 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:48.101705 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.102381 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.102386 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:48.102482 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:48.102507 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 15:50:48.102588 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 15:50:48.102667 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105}
I20260808 15:50:48.102933 28386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:48.099499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:36115 (local address 127.8.39.66:42731)
0808 15:50:48.099666 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:48.099683 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:48.099838 (+ 155us) server_negotiation.cc:407] Connection header received
0808 15:50:48.099936 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:48.099939 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:48.100003 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:48.100085 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:48.100349 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.100887 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.101916 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.102286 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.102428 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:48.102493 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:48.102726 (+ 233us) server_negotiation.cc:299] Negotiation successful
0808 15:50:48.102802 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 15:50:48.102909 28399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:48.099347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:42731 (local address 127.8.39.67:36115)
0808 15:50:48.099739 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:48.099754 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:48.099860 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:48.100103 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:48.100106 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:48.100123 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:48.100238 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:48.100246 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.100997 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.101000 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:48.101784 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:48.101797 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.102447 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.102452 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:48.102547 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:48.102591 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 15:50:48.102669 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 15:50:48.102781 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":124,"threads_started":1}
I20260808 15:50:48.103637 28042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ae4612ada6345e3bee10522ce588dc5" candidate_uuid: "d6ddf16697b347e1b3d32bcb0bd288a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a2c59dd1574411285652206d6330521" is_pre_election: true
I20260808 15:50:48.104032 28042 raft_consensus.cc:2454] T 1ae4612ada6345e3bee10522ce588dc5 P 7a2c59dd1574411285652206d6330521 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6ddf16697b347e1b3d32bcb0bd288a1 in term 0.
I20260808 15:50:48.104135 28182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ae4612ada6345e3bee10522ce588dc5" candidate_uuid: "d6ddf16697b347e1b3d32bcb0bd288a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce274b6587243b4a202676164541352" is_pre_election: true
I20260808 15:50:48.104409 28182 raft_consensus.cc:2454] T 1ae4612ada6345e3bee10522ce588dc5 P fce274b6587243b4a202676164541352 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6ddf16697b347e1b3d32bcb0bd288a1 in term 0.
I20260808 15:50:48.104562 28251 leader_election.cc:302] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a2c59dd1574411285652206d6330521, d6ddf16697b347e1b3d32bcb0bd288a1; no voters:
I20260808 15:50:48.104871 28397 raft_consensus.cc:2781] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:50:48.104962 28397 raft_consensus.cc:482] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:50:48.105008 28397 raft_consensus.cc:3037] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:48.106208 28397 raft_consensus.cc:504] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2c59dd1574411285652206d6330521" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 36549 } } peers { permanent_uuid: "fce274b6587243b4a202676164541352" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 42731 } } peers { permanent_uuid: "d6ddf16697b347e1b3d32bcb0bd288a1" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 43731 } }
I20260808 15:50:48.106611 28397 leader_election.cc:288] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7a2c59dd1574411285652206d6330521 (127.8.39.65:36549), fce274b6587243b4a202676164541352 (127.8.39.66:42731)
I20260808 15:50:48.107021 28182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ae4612ada6345e3bee10522ce588dc5" candidate_uuid: "d6ddf16697b347e1b3d32bcb0bd288a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fce274b6587243b4a202676164541352"
I20260808 15:50:48.107035 28042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ae4612ada6345e3bee10522ce588dc5" candidate_uuid: "d6ddf16697b347e1b3d32bcb0bd288a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a2c59dd1574411285652206d6330521"
I20260808 15:50:48.107136 28182 raft_consensus.cc:3037] T 1ae4612ada6345e3bee10522ce588dc5 P fce274b6587243b4a202676164541352 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:48.107183 28042 raft_consensus.cc:3037] T 1ae4612ada6345e3bee10522ce588dc5 P 7a2c59dd1574411285652206d6330521 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:48.108213 28182 raft_consensus.cc:2454] T 1ae4612ada6345e3bee10522ce588dc5 P fce274b6587243b4a202676164541352 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6ddf16697b347e1b3d32bcb0bd288a1 in term 1.
I20260808 15:50:48.108443 28042 raft_consensus.cc:2454] T 1ae4612ada6345e3bee10522ce588dc5 P 7a2c59dd1574411285652206d6330521 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6ddf16697b347e1b3d32bcb0bd288a1 in term 1.
I20260808 15:50:48.108539 28251 leader_election.cc:302] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d6ddf16697b347e1b3d32bcb0bd288a1, fce274b6587243b4a202676164541352; no voters:
I20260808 15:50:48.108703 28397 raft_consensus.cc:2781] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:50:48.108954 28397 raft_consensus.cc:686] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1 [term 1 LEADER]: Becoming Leader. State: Replica: d6ddf16697b347e1b3d32bcb0bd288a1, State: Running, Role: LEADER
I20260808 15:50:48.109295 28397 consensus_queue.cc:237] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2c59dd1574411285652206d6330521" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 36549 } } peers { permanent_uuid: "fce274b6587243b4a202676164541352" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 42731 } } peers { permanent_uuid: "d6ddf16697b347e1b3d32bcb0bd288a1" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 43731 } }
I20260808 15:50:48.112524 27882 catalog_manager.cc:5495] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d6ddf16697b347e1b3d32bcb0bd288a1 (127.8.39.67). New cstate: current_term: 1 leader_uuid: "d6ddf16697b347e1b3d32bcb0bd288a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2c59dd1574411285652206d6330521" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 36549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fce274b6587243b4a202676164541352" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 42731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6ddf16697b347e1b3d32bcb0bd288a1" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 43731 } health_report { overall_health: HEALTHY } } }
W20260808 15:50:48.116369 28092 tablet.cc:2369] T 1ae4612ada6345e3bee10522ce588dc5 P 7a2c59dd1574411285652206d6330521: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:50:48.128665 28387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:48.124058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46922 (local address 127.8.39.67:43731)
0808 15:50:48.124200 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:48.124207 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:48.124225 (+ 18us) server_negotiation.cc:407] Connection header received
0808 15:50:48.124463 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:48.124466 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:48.124531 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:48.124650 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:50:48.125002 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.125806 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.127178 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:48.127424 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:48.127512 (+ 88us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:48.127826 (+ 314us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:50:48.128253 (+ 427us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:50:48.128365 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:48.128493 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 15:50:48.128528 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 15:50:48.135124 28042 raft_consensus.cc:1261] T 1ae4612ada6345e3bee10522ce588dc5 P 7a2c59dd1574411285652206d6330521 [term 1 FOLLOWER]: Refusing update from remote peer d6ddf16697b347e1b3d32bcb0bd288a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:50:48.135128 28182 raft_consensus.cc:1261] T 1ae4612ada6345e3bee10522ce588dc5 P fce274b6587243b4a202676164541352 [term 1 FOLLOWER]: Refusing update from remote peer d6ddf16697b347e1b3d32bcb0bd288a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:50:48.135984 28397 consensus_queue.cc:1035] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a2c59dd1574411285652206d6330521" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 36549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:50:48.136238 28400 consensus_queue.cc:1035] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fce274b6587243b4a202676164541352" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 42731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:50:48.146729 28406 mvcc.cc:205] Tried to move back new op lower bound from 7316292600352874496 to 7316292600258396160. Current Snapshot: MvccSnapshot[applied={T|T < 7316292600352874496}]
I20260808 15:50:48.147766 28405 mvcc.cc:205] Tried to move back new op lower bound from 7316292600352874496 to 7316292600258396160. Current Snapshot: MvccSnapshot[applied={T|T < 7316292600352874496}]
I20260808 15:50:48.154660 27882 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49462:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:50:48.154910 27882 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49462:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:50:48.157716 27882 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 87384675c56e4c2cbff4e103b008df5e: Sending DeleteTablet for 3 replicas of tablet 1ae4612ada6345e3bee10522ce588dc5
I20260808 15:50:48.158627 28298 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ae4612ada6345e3bee10522ce588dc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:50:48 UTC) from {username='slave'} at 127.0.0.1:46908
I20260808 15:50:48.158780 28019 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ae4612ada6345e3bee10522ce588dc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:50:48 UTC) from {username='slave'} at 127.0.0.1:38612
I20260808 15:50:48.158792 28162 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ae4612ada6345e3bee10522ce588dc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:50:48 UTC) from {username='slave'} at 127.0.0.1:51574
I20260808 15:50:48.159354 28415 tablet_replica.cc:330] T 1ae4612ada6345e3bee10522ce588dc5 P 7a2c59dd1574411285652206d6330521: stopping tablet replica
I20260808 15:50:48.159742 28414 tablet_replica.cc:330] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1: stopping tablet replica
I20260808 15:50:48.160050 28414 raft_consensus.cc:2229] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:50:48.160256 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 27948
I20260808 15:50:48.162961 28416 tablet_replica.cc:330] T 1ae4612ada6345e3bee10522ce588dc5 P fce274b6587243b4a202676164541352: stopping tablet replica
I20260808 15:50:48.163240 28414 raft_consensus.cc:2258] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:50:48.163313 28416 raft_consensus.cc:2229] T 1ae4612ada6345e3bee10522ce588dc5 P fce274b6587243b4a202676164541352 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:50:48.163789 28416 raft_consensus.cc:2258] T 1ae4612ada6345e3bee10522ce588dc5 P fce274b6587243b4a202676164541352 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:50:48.164945 28414 ts_tablet_manager.cc:1905] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:50:48.165274 28416 ts_tablet_manager.cc:1905] T 1ae4612ada6345e3bee10522ce588dc5 P fce274b6587243b4a202676164541352: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:50:48.168145 28416 ts_tablet_manager.cc:1918] T 1ae4612ada6345e3bee10522ce588dc5 P fce274b6587243b4a202676164541352: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:50:48.168254 28416 log.cc:1196] T 1ae4612ada6345e3bee10522ce588dc5 P fce274b6587243b4a202676164541352: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-1/wal/wals/1ae4612ada6345e3bee10522ce588dc5
I20260808 15:50:48.168591 28416 ts_tablet_manager.cc:1939] T 1ae4612ada6345e3bee10522ce588dc5 P fce274b6587243b4a202676164541352: Deleting consensus metadata
I20260808 15:50:48.169023 28414 ts_tablet_manager.cc:1918] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:50:48.169194 28414 log.cc:1196] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/1ae4612ada6345e3bee10522ce588dc5
I20260808 15:50:48.169612 28414 ts_tablet_manager.cc:1939] T 1ae4612ada6345e3bee10522ce588dc5 P d6ddf16697b347e1b3d32bcb0bd288a1: Deleting consensus metadata
W20260808 15:50:48.169921 27869 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.39.65:36549 (error 108)
I20260808 15:50:48.170504 27869 catalog_manager.cc:4841] TS fce274b6587243b4a202676164541352 (127.8.39.66:42731): tablet 1ae4612ada6345e3bee10522ce588dc5 (table test-table [id=0c8bc3a9c5dd44dcb0818b97d11ce27f]) successfully deleted
I20260808 15:50:48.170941 27867 catalog_manager.cc:4841] TS d6ddf16697b347e1b3d32bcb0bd288a1 (127.8.39.67:43731): tablet 1ae4612ada6345e3bee10522ce588dc5 (table test-table [id=0c8bc3a9c5dd44dcb0818b97d11ce27f]) successfully deleted
W20260808 15:50:48.171221 28384 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:50:48.170908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:36549 (local address 127.0.0.1:38628)
0808 15:50:48.171036 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:48.171054 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:48.171131 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.65:36549: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 15:50:48.171365 27869 catalog_manager.cc:4584] TS 7a2c59dd1574411285652206d6330521 (127.8.39.65:36549): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1ae4612ada6345e3bee10522ce588dc5: Network error: Client connection negotiation failed: client connection to 127.8.39.65:36549: BlockingWrite error: write error: Connection reset by peer (error 104)
I20260808 15:50:48.171469 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 28094
I20260808 15:50:48.181842 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 28231
I20260808 15:50:48.188829 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 27850
2026-08-08T15:50:48Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1063 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:50:48 dist-test-slave-8tdl krb5kdc[28420](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:50:48 dist-test-slave-8tdl krb5kdc[28420](info): set up 2 sockets
Aug 08 15:50:48 dist-test-slave-8tdl krb5kdc[28420](info): commencing operation
krb5kdc: starting...
W20260808 15:50:49.339900 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:50:49 dist-test-slave-8tdl krb5kdc[28420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204249, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:50:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:50:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:50:49.474565 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:33181
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:40233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:33181
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:50:49.588217 28434 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:49.588550 28434 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:49.588636 28434 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:49.592805 28434 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:50:49.592918 28434 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:49.592957 28434 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:49.592996 28434 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:50:49.593035 28434 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:50:49.598457 28434 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:40233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:33181
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:33181
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28434
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:49.599625 28434 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:49.600701 28434 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:49.609880 28443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:49.609964 28439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:49.609917 28440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:49.610342 28434 server_base.cc:1034] running on GCE node
I20260808 15:50:49.611074 28434 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:49.612373 28434 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:49.613593 28434 hybrid_clock.cc:648] HybridClock initialized: now 1786204249613573 us; error 32 us; skew 500 ppm
Aug 08 15:50:49 dist-test-slave-8tdl krb5kdc[28420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204249, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:50:49.616662 28434 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:50:49.617532 28434 webserver.cc:460] Webserver started at http://127.8.39.126:45755/ using document root <none> and password file <none>
I20260808 15:50:49.618081 28434 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:49.618145 28434 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:49.618310 28434 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:49.620461 28434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "6f1f9d90dda345cea661a693f65e5416"
format_stamp: "Formatted at 2026-08-08 15:50:49 on dist-test-slave-8tdl"
server_key: "7a71264f27d2f21cdeced844f5d03967"
server_key_iv: "415a9bc469e7ad6b6f3c182dbc3d7f6d"
server_key_version: "encryptionkey@0"
I20260808 15:50:49.621004 28434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "6f1f9d90dda345cea661a693f65e5416"
format_stamp: "Formatted at 2026-08-08 15:50:49 on dist-test-slave-8tdl"
server_key: "7a71264f27d2f21cdeced844f5d03967"
server_key_iv: "415a9bc469e7ad6b6f3c182dbc3d7f6d"
server_key_version: "encryptionkey@0"
I20260808 15:50:49.624959 28434 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260808 15:50:49.627589 28450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:49.628906 28434 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 15:50:49.629036 28434 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "6f1f9d90dda345cea661a693f65e5416"
format_stamp: "Formatted at 2026-08-08 15:50:49 on dist-test-slave-8tdl"
server_key: "7a71264f27d2f21cdeced844f5d03967"
server_key_iv: "415a9bc469e7ad6b6f3c182dbc3d7f6d"
server_key_version: "encryptionkey@0"
I20260808 15:50:49.629163 28434 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:49.651152 28434 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:49.654912 28434 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:49.655129 28434 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:49.662628 28434 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:33181
I20260808 15:50:49.662660 28504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:33181 every 8 connection(s)
I20260808 15:50:49.663648 28434 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:50:49.666415 28505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:49.671947 28505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f1f9d90dda345cea661a693f65e5416: Bootstrap starting.
I20260808 15:50:49.672679 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 28434
I20260808 15:50:49.672825 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:50:49.673146 8349 external_mini_cluster.cc:1428] Setting key 505b0c650df8d836f4e4f26edffa134d
I20260808 15:50:49.674795 28505 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f1f9d90dda345cea661a693f65e5416: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:49.675813 28505 log.cc:824] T 00000000000000000000000000000000 P 6f1f9d90dda345cea661a693f65e5416: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:49.678143 28505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f1f9d90dda345cea661a693f65e5416: No bootstrap required, opened a new log
I20260808 15:50:49.682301 28505 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f1f9d90dda345cea661a693f65e5416 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1f9d90dda345cea661a693f65e5416" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 33181 } }
I20260808 15:50:49.682541 28505 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6f1f9d90dda345cea661a693f65e5416 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:49.682577 28505 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f1f9d90dda345cea661a693f65e5416 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f1f9d90dda345cea661a693f65e5416, State: Initialized, Role: FOLLOWER
Aug 08 15:50:49 dist-test-slave-8tdl krb5kdc[28420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204249, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:50:49.683192 28505 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f1f9d90dda345cea661a693f65e5416 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1f9d90dda345cea661a693f65e5416" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 33181 } }
I20260808 15:50:49.683355 28505 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6f1f9d90dda345cea661a693f65e5416 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:50:49.683442 28505 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6f1f9d90dda345cea661a693f65e5416 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:50:49.683573 28505 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f1f9d90dda345cea661a693f65e5416 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:49.684899 28505 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6f1f9d90dda345cea661a693f65e5416 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1f9d90dda345cea661a693f65e5416" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 33181 } }
I20260808 15:50:49.685364 28505 leader_election.cc:302] T 00000000000000000000000000000000 P 6f1f9d90dda345cea661a693f65e5416 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f1f9d90dda345cea661a693f65e5416; no voters:
I20260808 15:50:49.685739 28505 leader_election.cc:288] T 00000000000000000000000000000000 P 6f1f9d90dda345cea661a693f65e5416 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:50:49.685868 28510 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6f1f9d90dda345cea661a693f65e5416 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:50:49.686136 28510 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6f1f9d90dda345cea661a693f65e5416 [term 1 LEADER]: Becoming Leader. State: Replica: 6f1f9d90dda345cea661a693f65e5416, State: Running, Role: LEADER
I20260808 15:50:49.686612 28510 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f1f9d90dda345cea661a693f65e5416 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1f9d90dda345cea661a693f65e5416" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 33181 } }
I20260808 15:50:49.687224 28505 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f1f9d90dda345cea661a693f65e5416 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:50:49.689015 28511 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f1f9d90dda345cea661a693f65e5416 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f1f9d90dda345cea661a693f65e5416. Latest consensus state: current_term: 1 leader_uuid: "6f1f9d90dda345cea661a693f65e5416" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1f9d90dda345cea661a693f65e5416" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 33181 } } }
I20260808 15:50:49.688977 28512 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f1f9d90dda345cea661a693f65e5416 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f1f9d90dda345cea661a693f65e5416" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1f9d90dda345cea661a693f65e5416" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 33181 } } }
I20260808 15:50:49.689201 28512 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f1f9d90dda345cea661a693f65e5416 [sys.catalog]: This master's current role is: LEADER
I20260808 15:50:49.689141 28511 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f1f9d90dda345cea661a693f65e5416 [sys.catalog]: This master's current role is: LEADER
I20260808 15:50:49.690618 28508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:49.674475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53096 (local address 127.8.39.126:33181)
0808 15:50:49.675046 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:49.675066 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:49.675109 (+ 43us) server_negotiation.cc:407] Connection header received
0808 15:50:49.676038 (+ 929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:49.676062 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:49.676440 (+ 378us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:49.676792 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:49.677558 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:49.679055 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:49.680066 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:49.680824 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:49.681021 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:49.684052 (+ 3031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:49.684059 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:49.684076 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:49.684112 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:49.686336 (+ 2224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:49.686974 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:49.686980 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:49.686987 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:49.687130 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:49.687480 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:49.687483 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:49.687485 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:49.688055 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:49.688264 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:49.689257 (+ 993us) server_negotiation.cc:299] Negotiation successful
0808 15:50:49.689609 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":207,"threads_started":1}
W20260808 15:50:49.692291 28526 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6f1f9d90dda345cea661a693f65e5416: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:50:49.692368 28526 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:50:49.692441 28525 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:50:49.693385 28525 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:50:49.699198 28525 catalog_manager.cc:1347] Generated new cluster ID: ab7cb31676244371bb5f7b69b5cd365c
I20260808 15:50:49.699285 28525 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:50:49.705999 28525 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:50:49.707265 28525 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:50:49.720238 28525 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6f1f9d90dda345cea661a693f65e5416: Generated new TSK 0
I20260808 15:50:49.721197 28525 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.39.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
Entry for principal kudu/127.8.39.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab.
I20260808 15:50:49.758255 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:0
--local_ip_for_outbound_sockets=127.8.39.65
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:33181
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:40233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:50:49.881594 28533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:49.881909 28533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:49.881956 28533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:49.886302 28533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:49.886384 28533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:49.886448 28533 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:50:49.892421 28533 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:40233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.65.keytab
--principal=kudu/127.8.39.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:33181
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28533
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:49.893668 28533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:49.894804 28533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:49.905210 28540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:49.905251 28543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:49.905270 28541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:49.905921 28533 server_base.cc:1034] running on GCE node
I20260808 15:50:49.906423 28533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:49.907261 28533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:49.908457 28533 hybrid_clock.cc:648] HybridClock initialized: now 1786204249908430 us; error 52 us; skew 500 ppm
Aug 08 15:50:49 dist-test-slave-8tdl krb5kdc[28420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204249, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:50:49.911451 28533 init.cc:377] Logged in from keytab as kudu/127.8.39.65@KRBTEST.COM (short username kudu)
I20260808 15:50:49.912515 28533 webserver.cc:460] Webserver started at http://127.8.39.65:41391/ using document root <none> and password file <none>
I20260808 15:50:49.913136 28533 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:49.913239 28533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:49.913496 28533 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:49.915830 28533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-0/data/instance:
uuid: "cff49f499f85490c87f87c75df94d321"
format_stamp: "Formatted at 2026-08-08 15:50:49 on dist-test-slave-8tdl"
server_key: "a1f9e081e2d1683c4f51ac6a09dd5a81"
server_key_iv: "63b5ea2abdf79ee5439fd2f074ee907c"
server_key_version: "encryptionkey@0"
I20260808 15:50:49.916523 28533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance:
uuid: "cff49f499f85490c87f87c75df94d321"
format_stamp: "Formatted at 2026-08-08 15:50:49 on dist-test-slave-8tdl"
server_key: "a1f9e081e2d1683c4f51ac6a09dd5a81"
server_key_iv: "63b5ea2abdf79ee5439fd2f074ee907c"
server_key_version: "encryptionkey@0"
I20260808 15:50:49.920588 28533 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260808 15:50:49.923472 28550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:49.924785 28533 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:50:49.924952 28533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "cff49f499f85490c87f87c75df94d321"
format_stamp: "Formatted at 2026-08-08 15:50:49 on dist-test-slave-8tdl"
server_key: "a1f9e081e2d1683c4f51ac6a09dd5a81"
server_key_iv: "63b5ea2abdf79ee5439fd2f074ee907c"
server_key_version: "encryptionkey@0"
I20260808 15:50:49.925107 28533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:49.939388 28533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:49.943264 28533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:49.943528 28533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:49.944262 28533 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:50:49.945266 28533 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:50:49.945348 28533 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:49.945423 28533 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:50:49.945477 28533 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:49.955608 28533 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:46213
I20260808 15:50:49.955693 28668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:46213 every 8 connection(s)
I20260808 15:50:49.956668 28533 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:50:49.967010 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 28533
I20260808 15:50:49.967170 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance
Aug 08 15:50:49 dist-test-slave-8tdl krb5kdc[28420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204249, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.65@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:50:49.967483 8349 external_mini_cluster.cc:1428] Setting key 8bd3caabc8fb4216657b864023f770ab
I20260808 15:50:49.972411 28508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:49.958948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:43715 (local address 127.8.39.126:33181)
0808 15:50:49.959139 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:49.959143 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:49.960100 (+ 957us) server_negotiation.cc:407] Connection header received
0808 15:50:49.961427 (+ 1327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:49.961431 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:49.961494 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:49.961612 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:49.962903 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:49.963449 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:49.964675 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:49.964920 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:49.965038 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:49.968010 (+ 2972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:49.968014 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:49.968016 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:49.968046 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:49.969941 (+ 1895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:49.970515 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:49.970522 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:49.970526 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:49.970696 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:49.971067 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:49.971073 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:49.971078 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:49.971351 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:49.971455 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:49.972016 (+ 561us) server_negotiation.cc:299] Negotiation successful
0808 15:50:49.972186 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 15:50:49.973519 28671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:49.959327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:33181 (local address 127.8.39.65:43715)
0808 15:50:49.959843 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:49.959897 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:49.961195 (+ 1298us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:49.961799 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:49.961806 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:49.962202 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:50:49.962736 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:49.962751 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:49.963595 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:49.963599 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:49.964537 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:49.964548 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:49.965101 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:49.965105 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:49.965278 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:49.965891 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:50:49.965909 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:50:49.967795 (+ 1886us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:50:49.970080 (+ 2285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:49.970087 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:49.970101 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:49.970393 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:49.970796 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:49.970798 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:49.970800 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:49.970959 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:49.971460 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:50:49.971465 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:50:49.971738 (+ 273us) client_negotiation.cc:769] Sending connection context
0808 15:50:49.971907 (+ 169us) client_negotiation.cc:240] Negotiation successful
0808 15:50:49.972314 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":134,"threads_started":1}
I20260808 15:50:49.974969 28669 heartbeater.cc:347] Connected to a master server at 127.8.39.126:33181
I20260808 15:50:49.975318 28669 heartbeater.cc:464] Registering TS with master...
I20260808 15:50:49.975845 28669 heartbeater.cc:511] Master 127.8.39.126:33181 requested a full tablet report, sending...
I20260808 15:50:49.977483 28467 ts_manager.cc:194] Registered new tserver with Master: cff49f499f85490c87f87c75df94d321 (127.8.39.65:46213)
I20260808 15:50:49.978775 28467 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.65@KRBTEST.COM'} at 127.8.39.65:43715
WARNING: no policy specified for kudu/127.8.39.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
Entry for principal kudu/127.8.39.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab.
I20260808 15:50:50.002192 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:0
--local_ip_for_outbound_sockets=127.8.39.66
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:33181
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:40233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:50:50.122354 28674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:50.122745 28674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:50.122859 28674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:50.127127 28674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:50.127249 28674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:50.127357 28674 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:50:50.134262 28674 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:40233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.66.keytab
--principal=kudu/127.8.39.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:33181
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28674
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:50.135700 28674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:50.136865 28674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:50.147382 28681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:50.147413 28685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:50.147383 28680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:50.147796 28674 server_base.cc:1034] running on GCE node
I20260808 15:50:50.148289 28674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:50.148985 28674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:50.150208 28674 hybrid_clock.cc:648] HybridClock initialized: now 1786204250150194 us; error 29 us; skew 500 ppm
Aug 08 15:50:50 dist-test-slave-8tdl krb5kdc[28420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204250, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:50:50.153227 28674 init.cc:377] Logged in from keytab as kudu/127.8.39.66@KRBTEST.COM (short username kudu)
I20260808 15:50:50.154215 28674 webserver.cc:460] Webserver started at http://127.8.39.66:43155/ using document root <none> and password file <none>
I20260808 15:50:50.154872 28674 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:50.154971 28674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:50.155221 28674 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:50.157352 28674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-1/data/instance:
uuid: "302506d664de41bab746f4a63d2b2786"
format_stamp: "Formatted at 2026-08-08 15:50:50 on dist-test-slave-8tdl"
server_key: "7cdfec5b87c0fd07d779ac14dd2719b6"
server_key_iv: "611fc6ddeb47d85f73155c186e3f2d25"
server_key_version: "encryptionkey@0"
I20260808 15:50:50.157975 28674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance:
uuid: "302506d664de41bab746f4a63d2b2786"
format_stamp: "Formatted at 2026-08-08 15:50:50 on dist-test-slave-8tdl"
server_key: "7cdfec5b87c0fd07d779ac14dd2719b6"
server_key_iv: "611fc6ddeb47d85f73155c186e3f2d25"
server_key_version: "encryptionkey@0"
I20260808 15:50:50.162140 28674 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 15:50:50.164830 28692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:50.166178 28674 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:50:50.166328 28674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "302506d664de41bab746f4a63d2b2786"
format_stamp: "Formatted at 2026-08-08 15:50:50 on dist-test-slave-8tdl"
server_key: "7cdfec5b87c0fd07d779ac14dd2719b6"
server_key_iv: "611fc6ddeb47d85f73155c186e3f2d25"
server_key_version: "encryptionkey@0"
I20260808 15:50:50.166456 28674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:50.195653 28674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:50.199115 28674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:50.199344 28674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:50.199980 28674 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:50:50.200867 28674 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:50:50.200943 28674 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:50.201017 28674 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:50:50.201076 28674 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:50.210623 28674 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:40357
I20260808 15:50:50.210645 28815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:40357 every 8 connection(s)
I20260808 15:50:50.211654 28674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:50:50.221436 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 28674
I20260808 15:50:50.221586 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance
I20260808 15:50:50.221872 8349 external_mini_cluster.cc:1428] Setting key 56f5c671adead72dfd53863ef70d339c
Aug 08 15:50:50 dist-test-slave-8tdl krb5kdc[28420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204250, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.66@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:50:50.227695 28508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:50.213689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:45635 (local address 127.8.39.126:33181)
0808 15:50:50.213837 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:50.213842 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:50.214734 (+ 892us) server_negotiation.cc:407] Connection header received
0808 15:50:50.216152 (+ 1418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:50.216155 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:50.216217 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:50.216326 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:50.217541 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.218090 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.219399 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.219737 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.219870 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:50.222811 (+ 2941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:50.222814 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:50.222817 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:50.222853 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:50.224797 (+ 1944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:50.225467 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:50.225471 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:50.225473 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:50.225574 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:50.226178 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:50.226181 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:50.226182 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:50.226444 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:50.226542 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:50.227453 (+ 911us) server_negotiation.cc:299] Negotiation successful
0808 15:50:50.227571 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 15:50:50.229085 28821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:50.214068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:33181 (local address 127.8.39.66:45635)
0808 15:50:50.214542 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:50.214588 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:50.215927 (+ 1339us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:50.216500 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:50.216507 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:50.216894 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:50:50.217384 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:50.217398 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.218232 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.218237 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:50.219258 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:50.219269 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.219926 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.219931 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:50.220139 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:50.220788 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:50:50.220805 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:50:50.222573 (+ 1768us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:50:50.224973 (+ 2400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:50.224981 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:50.225000 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:50.225328 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:50.225689 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:50.225692 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:50.225694 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:50.226035 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:50.226578 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:50:50.226587 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:50:50.227093 (+ 506us) client_negotiation.cc:769] Sending connection context
0808 15:50:50.227358 (+ 265us) client_negotiation.cc:240] Negotiation successful
0808 15:50:50.227803 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":114,"threads_started":1}
I20260808 15:50:50.230902 28816 heartbeater.cc:347] Connected to a master server at 127.8.39.126:33181
I20260808 15:50:50.231226 28816 heartbeater.cc:464] Registering TS with master...
I20260808 15:50:50.231986 28816 heartbeater.cc:511] Master 127.8.39.126:33181 requested a full tablet report, sending...
I20260808 15:50:50.233364 28467 ts_manager.cc:194] Registered new tserver with Master: 302506d664de41bab746f4a63d2b2786 (127.8.39.66:40357)
I20260808 15:50:50.234081 28467 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.66@KRBTEST.COM'} at 127.8.39.66:45635
WARNING: no policy specified for kudu/127.8.39.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
Entry for principal kudu/127.8.39.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab.
I20260808 15:50:50.254422 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:0
--local_ip_for_outbound_sockets=127.8.39.67
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:33181
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:40233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:50:50.373358 28824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:50.373646 28824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:50.373692 28824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:50.377921 28824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:50.378008 28824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:50.378072 28824 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:50:50.383740 28824 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:40233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.67.keytab
--principal=kudu/127.8.39.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:33181
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28824
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:50.384899 28824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:50.385936 28824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:50.396878 28832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:50.396908 28829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:50.396972 28830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:50.397085 28824 server_base.cc:1034] running on GCE node
I20260808 15:50:50.397729 28824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:50.398485 28824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:50.399701 28824 hybrid_clock.cc:648] HybridClock initialized: now 1786204250399660 us; error 58 us; skew 500 ppm
Aug 08 15:50:50 dist-test-slave-8tdl krb5kdc[28420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204250, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:50:50.403218 28824 init.cc:377] Logged in from keytab as kudu/127.8.39.67@KRBTEST.COM (short username kudu)
I20260808 15:50:50.404414 28824 webserver.cc:460] Webserver started at http://127.8.39.67:46115/ using document root <none> and password file <none>
I20260808 15:50:50.405042 28824 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:50.405119 28824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:50.405316 28824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:50.407829 28824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-2/data/instance:
uuid: "0101add69ba64cd5aa781574020fbe7b"
format_stamp: "Formatted at 2026-08-08 15:50:50 on dist-test-slave-8tdl"
server_key: "cb7fe37158844cdf9c5cc629933ab617"
server_key_iv: "25d67e12b8f6e9bdac139e841cee4b61"
server_key_version: "encryptionkey@0"
I20260808 15:50:50.408605 28824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance:
uuid: "0101add69ba64cd5aa781574020fbe7b"
format_stamp: "Formatted at 2026-08-08 15:50:50 on dist-test-slave-8tdl"
server_key: "cb7fe37158844cdf9c5cc629933ab617"
server_key_iv: "25d67e12b8f6e9bdac139e841cee4b61"
server_key_version: "encryptionkey@0"
I20260808 15:50:50.413061 28824 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 15:50:50.416000 28839 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:50.417517 28824 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:50:50.417681 28824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "0101add69ba64cd5aa781574020fbe7b"
format_stamp: "Formatted at 2026-08-08 15:50:50 on dist-test-slave-8tdl"
server_key: "cb7fe37158844cdf9c5cc629933ab617"
server_key_iv: "25d67e12b8f6e9bdac139e841cee4b61"
server_key_version: "encryptionkey@0"
I20260808 15:50:50.417816 28824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:50.434454 28824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:50.437893 28824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:50.438162 28824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:50.438879 28824 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:50:50.439776 28824 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:50:50.439826 28824 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:50.439890 28824 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:50:50.439940 28824 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:50.449753 28824 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:45967
I20260808 15:50:50.449784 28958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:45967 every 8 connection(s)
I20260808 15:50:50.450771 28824 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:50:50.453178 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 28824
I20260808 15:50:50.453322 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance
I20260808 15:50:50.453608 8349 external_mini_cluster.cc:1428] Setting key e155c95b72ae66f5b676ec03b9109c3d
Aug 08 15:50:50 dist-test-slave-8tdl krb5kdc[28420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204250, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.67@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:50:50.466485 28508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:50.452780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:36713 (local address 127.8.39.126:33181)
0808 15:50:50.453045 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:50.453053 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:50.454024 (+ 971us) server_negotiation.cc:407] Connection header received
0808 15:50:50.455510 (+ 1486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:50.455513 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:50.455566 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:50.455657 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:50.457098 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.457635 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.459006 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.459234 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.459318 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:50.462342 (+ 3024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:50.462346 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:50.462348 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:50.462377 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:50.464213 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:50.464777 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:50.464780 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:50.464781 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:50.464867 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:50.465217 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:50.465220 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:50.465221 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:50.465427 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:50.465514 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:50.466155 (+ 641us) server_negotiation.cc:299] Negotiation successful
0808 15:50:50.466298 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 15:50:50.467430 28962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:50.453267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:33181 (local address 127.8.39.67:36713)
0808 15:50:50.453836 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:50.453896 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:50.455303 (+ 1407us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:50.455905 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:50.455913 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:50.456376 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:50:50.456951 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:50.456965 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.457813 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.457816 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:50.458886 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:50.458897 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.459380 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.459383 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:50.459568 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:50.460390 (+ 822us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:50:50.460408 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:50:50.462145 (+ 1737us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:50:50.464347 (+ 2202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:50.464353 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:50.464368 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:50.464679 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:50.464953 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:50:50.464955 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:50:50.464957 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:50:50.465123 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:50:50.465523 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:50:50.465550 (+ 27us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:50:50.465814 (+ 264us) client_negotiation.cc:769] Sending connection context
0808 15:50:50.465990 (+ 176us) client_negotiation.cc:240] Negotiation successful
0808 15:50:50.466286 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":147,"threads_started":1}
I20260808 15:50:50.468792 28959 heartbeater.cc:347] Connected to a master server at 127.8.39.126:33181
I20260808 15:50:50.469044 28959 heartbeater.cc:464] Registering TS with master...
I20260808 15:50:50.469580 28959 heartbeater.cc:511] Master 127.8.39.126:33181 requested a full tablet report, sending...
I20260808 15:50:50.470763 28467 ts_manager.cc:194] Registered new tserver with Master: 0101add69ba64cd5aa781574020fbe7b (127.8.39.67:45967)
I20260808 15:50:50.471422 28467 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.39.67@KRBTEST.COM'} at 127.8.39.67:36713
I20260808 15:50:50.480573 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:50:50.492264 28508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:50.483017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53104 (local address 127.8.39.126:33181)
0808 15:50:50.483256 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:50.483261 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:50.483505 (+ 244us) server_negotiation.cc:407] Connection header received
0808 15:50:50.483634 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:50.483638 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:50.483697 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:50.483799 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:50.484695 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.485286 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.486267 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.486523 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.486654 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:50.488471 (+ 1817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:50.488474 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:50.488477 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:50.488506 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:50.490203 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:50.490781 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:50.490785 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:50.490787 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:50.490898 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:50.491217 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:50.491222 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:50.491224 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:50.491487 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:50.491660 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:50.491935 (+ 275us) server_negotiation.cc:299] Negotiation successful
0808 15:50:50.492081 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129}
I20260808 15:50:50.495605 28467 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53104:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:50:50.499048 28467 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:50:50.515252 28972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:50.508946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:40357 (local address 127.0.0.1:55824)
0808 15:50:50.509700 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:50.509735 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:50.509843 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:50.511014 (+ 1171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:50.511017 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:50.511034 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:50.511129 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:50.511134 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.512383 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.512389 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:50.513442 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:50.513452 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.514525 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.514528 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:50.514644 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:50.514737 (+ 93us) client_negotiation.cc:769] Sending connection context
0808 15:50:50.514891 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 15:50:50.515029 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"thread_start_us":114,"threads_started":1}
I20260808 15:50:50.515226 28975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:50.509766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55824 (local address 127.8.39.66:40357)
0808 15:50:50.510531 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:50.510555 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:50.510577 (+ 22us) server_negotiation.cc:407] Connection header received
0808 15:50:50.510650 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:50.510654 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:50.510858 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:50.511268 (+ 410us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:50.511428 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.512247 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.513599 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.514398 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.514525 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:50.514685 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:50.514937 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 15:50:50.515047 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":133,"threads_started":1}
I20260808 15:50:50.515314 28971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:50.508751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:46213 (local address 127.0.0.1:53020)
0808 15:50:50.509271 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:50.509321 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:50.509459 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:50.510128 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:50.510134 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:50.510158 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:50.510309 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:50.510320 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.511743 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.511747 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:50.513388 (+ 1641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:50.513399 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.514788 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.514792 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:50.514908 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:50.514934 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 15:50:50.515017 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 15:50:50.515108 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":103,"threads_started":1}
I20260808 15:50:50.515802 28973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:50.508956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53020 (local address 127.8.39.65:46213)
0808 15:50:50.509578 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:50.509587 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:50.509615 (+ 28us) server_negotiation.cc:407] Connection header received
0808 15:50:50.509733 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:50.509739 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:50.509980 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:50.510110 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:50.510460 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.511625 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.513541 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.514439 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.514552 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:50.514721 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:50.515520 (+ 799us) server_negotiation.cc:299] Negotiation successful
0808 15:50:50.515628 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":126,"threads_started":1}
I20260808 15:50:50.515919 28974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:50.509533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:45967 (local address 127.0.0.1:39020)
0808 15:50:50.509866 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:50.509884 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:50.509974 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:50.511303 (+ 1329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:50.511306 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:50.511325 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:50.511423 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:50.511430 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.512959 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.512962 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:50.514058 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:50.514067 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.515479 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.515483 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:50.515591 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:50.515615 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 15:50:50.515695 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 15:50:50.515763 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":118,"threads_started":1}
I20260808 15:50:50.516377 28976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:50.510324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39020 (local address 127.8.39.67:45967)
0808 15:50:50.510863 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:50.510878 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:50.510902 (+ 24us) server_negotiation.cc:407] Connection header received
0808 15:50:50.510983 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:50.510988 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:50.511160 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:50.511327 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:50.511569 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.512818 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.514204 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.515155 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.515260 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:50.515407 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:50.516114 (+ 707us) server_negotiation.cc:299] Negotiation successful
0808 15:50:50.516217 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":184,"threads_started":1}
I20260808 15:50:50.518626 28747 tablet_service.cc:1467] Processing CreateTablet for tablet 27df5b2bfef2485eb3c840c465e1393e (DEFAULT_TABLE table=test-table [id=5f0ca771110940a1aba4b1c75ced5a4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:50:50.519183 28889 tablet_service.cc:1467] Processing CreateTablet for tablet 27df5b2bfef2485eb3c840c465e1393e (DEFAULT_TABLE table=test-table [id=5f0ca771110940a1aba4b1c75ced5a4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:50:50.519915 28747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27df5b2bfef2485eb3c840c465e1393e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:50.520254 28889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27df5b2bfef2485eb3c840c465e1393e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:50.520661 28599 tablet_service.cc:1467] Processing CreateTablet for tablet 27df5b2bfef2485eb3c840c465e1393e (DEFAULT_TABLE table=test-table [id=5f0ca771110940a1aba4b1c75ced5a4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:50:50.521667 28599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27df5b2bfef2485eb3c840c465e1393e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:50.527451 28977 tablet_bootstrap.cc:492] T 27df5b2bfef2485eb3c840c465e1393e P 0101add69ba64cd5aa781574020fbe7b: Bootstrap starting.
I20260808 15:50:50.528709 28978 tablet_bootstrap.cc:492] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786: Bootstrap starting.
I20260808 15:50:50.529286 28979 tablet_bootstrap.cc:492] T 27df5b2bfef2485eb3c840c465e1393e P cff49f499f85490c87f87c75df94d321: Bootstrap starting.
I20260808 15:50:50.530092 28977 tablet_bootstrap.cc:654] T 27df5b2bfef2485eb3c840c465e1393e P 0101add69ba64cd5aa781574020fbe7b: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:50.531246 28978 tablet_bootstrap.cc:654] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:50.531639 28977 log.cc:824] T 27df5b2bfef2485eb3c840c465e1393e P 0101add69ba64cd5aa781574020fbe7b: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:50.531910 28979 tablet_bootstrap.cc:654] T 27df5b2bfef2485eb3c840c465e1393e P cff49f499f85490c87f87c75df94d321: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:50.532033 28978 log.cc:824] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:50.532966 28979 log.cc:824] T 27df5b2bfef2485eb3c840c465e1393e P cff49f499f85490c87f87c75df94d321: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:50.534252 28978 tablet_bootstrap.cc:492] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786: No bootstrap required, opened a new log
I20260808 15:50:50.534296 28977 tablet_bootstrap.cc:492] T 27df5b2bfef2485eb3c840c465e1393e P 0101add69ba64cd5aa781574020fbe7b: No bootstrap required, opened a new log
I20260808 15:50:50.534476 28978 ts_tablet_manager.cc:1397] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20260808 15:50:50.534487 28977 ts_tablet_manager.cc:1397] T 27df5b2bfef2485eb3c840c465e1393e P 0101add69ba64cd5aa781574020fbe7b: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260808 15:50:50.535192 28979 tablet_bootstrap.cc:492] T 27df5b2bfef2485eb3c840c465e1393e P cff49f499f85490c87f87c75df94d321: No bootstrap required, opened a new log
I20260808 15:50:50.535384 28979 ts_tablet_manager.cc:1397] T 27df5b2bfef2485eb3c840c465e1393e P cff49f499f85490c87f87c75df94d321: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 15:50:50.537670 28978 raft_consensus.cc:348] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cff49f499f85490c87f87c75df94d321" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 46213 } } peers { permanent_uuid: "302506d664de41bab746f4a63d2b2786" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40357 } } peers { permanent_uuid: "0101add69ba64cd5aa781574020fbe7b" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45967 } }
I20260808 15:50:50.537941 28978 raft_consensus.cc:374] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:50.538026 28978 raft_consensus.cc:729] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 302506d664de41bab746f4a63d2b2786, State: Initialized, Role: FOLLOWER
I20260808 15:50:50.538501 28978 consensus_queue.cc:260] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cff49f499f85490c87f87c75df94d321" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 46213 } } peers { permanent_uuid: "302506d664de41bab746f4a63d2b2786" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40357 } } peers { permanent_uuid: "0101add69ba64cd5aa781574020fbe7b" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45967 } }
I20260808 15:50:50.539274 28816 heartbeater.cc:503] Master 127.8.39.126:33181 was elected leader, sending a full tablet report...
I20260808 15:50:50.539081 28977 raft_consensus.cc:348] T 27df5b2bfef2485eb3c840c465e1393e P 0101add69ba64cd5aa781574020fbe7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cff49f499f85490c87f87c75df94d321" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 46213 } } peers { permanent_uuid: "302506d664de41bab746f4a63d2b2786" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40357 } } peers { permanent_uuid: "0101add69ba64cd5aa781574020fbe7b" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45967 } }
I20260808 15:50:50.539368 28977 raft_consensus.cc:374] T 27df5b2bfef2485eb3c840c465e1393e P 0101add69ba64cd5aa781574020fbe7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:50.539422 28977 raft_consensus.cc:729] T 27df5b2bfef2485eb3c840c465e1393e P 0101add69ba64cd5aa781574020fbe7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0101add69ba64cd5aa781574020fbe7b, State: Initialized, Role: FOLLOWER
I20260808 15:50:50.539912 28977 consensus_queue.cc:260] T 27df5b2bfef2485eb3c840c465e1393e P 0101add69ba64cd5aa781574020fbe7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cff49f499f85490c87f87c75df94d321" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 46213 } } peers { permanent_uuid: "302506d664de41bab746f4a63d2b2786" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40357 } } peers { permanent_uuid: "0101add69ba64cd5aa781574020fbe7b" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45967 } }
I20260808 15:50:50.540319 28979 raft_consensus.cc:348] T 27df5b2bfef2485eb3c840c465e1393e P cff49f499f85490c87f87c75df94d321 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cff49f499f85490c87f87c75df94d321" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 46213 } } peers { permanent_uuid: "302506d664de41bab746f4a63d2b2786" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40357 } } peers { permanent_uuid: "0101add69ba64cd5aa781574020fbe7b" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45967 } }
I20260808 15:50:50.540670 28979 raft_consensus.cc:374] T 27df5b2bfef2485eb3c840c465e1393e P cff49f499f85490c87f87c75df94d321 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:50.540742 28978 ts_tablet_manager.cc:1428] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 15:50:50.540784 28979 raft_consensus.cc:729] T 27df5b2bfef2485eb3c840c465e1393e P cff49f499f85490c87f87c75df94d321 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cff49f499f85490c87f87c75df94d321, State: Initialized, Role: FOLLOWER
I20260808 15:50:50.540966 28977 ts_tablet_manager.cc:1428] T 27df5b2bfef2485eb3c840c465e1393e P 0101add69ba64cd5aa781574020fbe7b: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 15:50:50.541306 28979 consensus_queue.cc:260] T 27df5b2bfef2485eb3c840c465e1393e P cff49f499f85490c87f87c75df94d321 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cff49f499f85490c87f87c75df94d321" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 46213 } } peers { permanent_uuid: "302506d664de41bab746f4a63d2b2786" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40357 } } peers { permanent_uuid: "0101add69ba64cd5aa781574020fbe7b" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45967 } }
I20260808 15:50:50.541390 28959 heartbeater.cc:503] Master 127.8.39.126:33181 was elected leader, sending a full tablet report...
I20260808 15:50:50.542132 28669 heartbeater.cc:503] Master 127.8.39.126:33181 was elected leader, sending a full tablet report...
I20260808 15:50:50.542423 28979 ts_tablet_manager.cc:1428] T 27df5b2bfef2485eb3c840c465e1393e P cff49f499f85490c87f87c75df94d321: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
W20260808 15:50:50.701818 28960 tablet.cc:2369] T 27df5b2bfef2485eb3c840c465e1393e P 0101add69ba64cd5aa781574020fbe7b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:50:50.708199 28670 tablet.cc:2369] T 27df5b2bfef2485eb3c840c465e1393e P cff49f499f85490c87f87c75df94d321: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:50:50.712911 28820 tablet.cc:2369] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:50:50.714174 28983 raft_consensus.cc:482] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:50:50.714346 28983 raft_consensus.cc:504] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cff49f499f85490c87f87c75df94d321" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 46213 } } peers { permanent_uuid: "302506d664de41bab746f4a63d2b2786" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40357 } } peers { permanent_uuid: "0101add69ba64cd5aa781574020fbe7b" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45967 } }
I20260808 15:50:50.715572 28983 leader_election.cc:288] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cff49f499f85490c87f87c75df94d321 (127.8.39.65:46213), 0101add69ba64cd5aa781574020fbe7b (127.8.39.67:45967)
I20260808 15:50:50.719648 28986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:50.715911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:45967 (local address 127.8.39.66:48401)
0808 15:50:50.716313 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:50.716327 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:50.716435 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:50.716707 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:50.716709 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:50.716723 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:50.716899 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:50.716906 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.717653 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.717656 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:50.718495 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:50.718504 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.719197 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.719202 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:50.719297 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:50.719325 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 15:50:50.719396 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 15:50:50.719453 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":26,"thread_start_us":99,"threads_started":1}
I20260808 15:50:50.719660 28976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:50.716154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:48401 (local address 127.8.39.67:45967)
0808 15:50:50.716315 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:50.716320 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:50.716414 (+ 94us) server_negotiation.cc:407] Connection header received
0808 15:50:50.716543 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:50.716546 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:50.716596 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:50.716680 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:50.717011 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.717536 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.718654 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.719074 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.719156 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:50.719249 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:50.719434 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 15:50:50.719532 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 15:50:50.719738 28973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:50.715943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:60391 (local address 127.8.39.65:46213)
0808 15:50:50.716074 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:50.716079 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:50.716117 (+ 38us) server_negotiation.cc:407] Connection header received
0808 15:50:50.716349 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:50.716357 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:50.716422 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:50.716503 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:50.716830 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.717442 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.718598 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.719104 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.719228 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:50.719293 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:50.719529 (+ 236us) server_negotiation.cc:299] Negotiation successful
0808 15:50:50.719603 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 15:50:50.719673 28821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:50.715851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:46213 (local address 127.8.39.66:60391)
0808 15:50:50.716044 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:50.716062 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:50.716170 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:50.716540 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:50.716543 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:50.716563 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:50.716705 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:50.716713 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.717562 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.717568 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:50.718461 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:50.718470 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.719250 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.719254 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:50.719371 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:50.719418 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 15:50:50.719496 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 15:50:50.719566 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"mutex_wait_us":1}
I20260808 15:50:50.720636 28620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27df5b2bfef2485eb3c840c465e1393e" candidate_uuid: "302506d664de41bab746f4a63d2b2786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cff49f499f85490c87f87c75df94d321" is_pre_election: true
I20260808 15:50:50.720640 28911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27df5b2bfef2485eb3c840c465e1393e" candidate_uuid: "302506d664de41bab746f4a63d2b2786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0101add69ba64cd5aa781574020fbe7b" is_pre_election: true
I20260808 15:50:50.720969 28911 raft_consensus.cc:2454] T 27df5b2bfef2485eb3c840c465e1393e P 0101add69ba64cd5aa781574020fbe7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 302506d664de41bab746f4a63d2b2786 in term 0.
I20260808 15:50:50.720994 28620 raft_consensus.cc:2454] T 27df5b2bfef2485eb3c840c465e1393e P cff49f499f85490c87f87c75df94d321 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 302506d664de41bab746f4a63d2b2786 in term 0.
I20260808 15:50:50.721498 28696 leader_election.cc:302] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0101add69ba64cd5aa781574020fbe7b, 302506d664de41bab746f4a63d2b2786; no voters:
I20260808 15:50:50.721804 28983 raft_consensus.cc:2781] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:50:50.721910 28983 raft_consensus.cc:482] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:50:50.721961 28983 raft_consensus.cc:3037] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:50.723145 28983 raft_consensus.cc:504] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cff49f499f85490c87f87c75df94d321" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 46213 } } peers { permanent_uuid: "302506d664de41bab746f4a63d2b2786" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40357 } } peers { permanent_uuid: "0101add69ba64cd5aa781574020fbe7b" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45967 } }
I20260808 15:50:50.723495 28983 leader_election.cc:288] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786 [CANDIDATE]: Term 1 election: Requested vote from peers cff49f499f85490c87f87c75df94d321 (127.8.39.65:46213), 0101add69ba64cd5aa781574020fbe7b (127.8.39.67:45967)
I20260808 15:50:50.723906 28911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27df5b2bfef2485eb3c840c465e1393e" candidate_uuid: "302506d664de41bab746f4a63d2b2786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0101add69ba64cd5aa781574020fbe7b"
I20260808 15:50:50.723906 28620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27df5b2bfef2485eb3c840c465e1393e" candidate_uuid: "302506d664de41bab746f4a63d2b2786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cff49f499f85490c87f87c75df94d321"
I20260808 15:50:50.724051 28911 raft_consensus.cc:3037] T 27df5b2bfef2485eb3c840c465e1393e P 0101add69ba64cd5aa781574020fbe7b [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:50.724051 28620 raft_consensus.cc:3037] T 27df5b2bfef2485eb3c840c465e1393e P cff49f499f85490c87f87c75df94d321 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:50.725469 28911 raft_consensus.cc:2454] T 27df5b2bfef2485eb3c840c465e1393e P 0101add69ba64cd5aa781574020fbe7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 302506d664de41bab746f4a63d2b2786 in term 1.
I20260808 15:50:50.725492 28620 raft_consensus.cc:2454] T 27df5b2bfef2485eb3c840c465e1393e P cff49f499f85490c87f87c75df94d321 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 302506d664de41bab746f4a63d2b2786 in term 1.
I20260808 15:50:50.725814 28694 leader_election.cc:302] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 302506d664de41bab746f4a63d2b2786, cff49f499f85490c87f87c75df94d321; no voters:
I20260808 15:50:50.726022 28983 raft_consensus.cc:2781] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:50:50.726272 28983 raft_consensus.cc:686] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786 [term 1 LEADER]: Becoming Leader. State: Replica: 302506d664de41bab746f4a63d2b2786, State: Running, Role: LEADER
I20260808 15:50:50.726634 28983 consensus_queue.cc:237] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cff49f499f85490c87f87c75df94d321" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 46213 } } peers { permanent_uuid: "302506d664de41bab746f4a63d2b2786" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40357 } } peers { permanent_uuid: "0101add69ba64cd5aa781574020fbe7b" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45967 } }
I20260808 15:50:50.730257 28465 catalog_manager.cc:5495] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786 reported cstate change: term changed from 0 to 1, leader changed from <none> to 302506d664de41bab746f4a63d2b2786 (127.8.39.66). New cstate: current_term: 1 leader_uuid: "302506d664de41bab746f4a63d2b2786" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cff49f499f85490c87f87c75df94d321" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 46213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "302506d664de41bab746f4a63d2b2786" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 40357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0101add69ba64cd5aa781574020fbe7b" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45967 } health_report { overall_health: UNKNOWN } } }
I20260808 15:50:50.753351 28975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:50.749996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55838 (local address 127.8.39.66:40357)
0808 15:50:50.750146 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:50.750149 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:50.750164 (+ 15us) server_negotiation.cc:407] Connection header received
0808 15:50:50.750246 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:50.750248 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:50.750302 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:50.750393 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:50:50.750610 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.751155 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.751987 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:50.752198 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:50.752273 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:50.752544 (+ 271us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:50:50.752977 (+ 433us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:50:50.753069 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:50.753153 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 15:50:50.753213 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 15:50:50.759332 28620 raft_consensus.cc:1261] T 27df5b2bfef2485eb3c840c465e1393e P cff49f499f85490c87f87c75df94d321 [term 1 FOLLOWER]: Refusing update from remote peer 302506d664de41bab746f4a63d2b2786: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:50:50.759332 28911 raft_consensus.cc:1261] T 27df5b2bfef2485eb3c840c465e1393e P 0101add69ba64cd5aa781574020fbe7b [term 1 FOLLOWER]: Refusing update from remote peer 302506d664de41bab746f4a63d2b2786: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:50:50.760167 28983 consensus_queue.cc:1035] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0101add69ba64cd5aa781574020fbe7b" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 45967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:50:50.760450 28987 consensus_queue.cc:1035] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cff49f499f85490c87f87c75df94d321" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 46213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:50:50.770179 28993 mvcc.cc:205] Tried to move back new op lower bound from 7316292611102560256 to 7316292610979545088. Current Snapshot: MvccSnapshot[applied={T|T < 7316292611102560256}]
I20260808 15:50:50.771834 28994 mvcc.cc:205] Tried to move back new op lower bound from 7316292611102560256 to 7316292610979545088. Current Snapshot: MvccSnapshot[applied={T|T < 7316292611102560256}]
I20260808 15:50:50.779253 28465 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:50:50.779488 28465 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:50:50.782318 28465 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6f1f9d90dda345cea661a693f65e5416: Sending DeleteTablet for 3 replicas of tablet 27df5b2bfef2485eb3c840c465e1393e
I20260808 15:50:50.783272 28747 tablet_service.cc:1514] Processing DeleteTablet for tablet 27df5b2bfef2485eb3c840c465e1393e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:50:50 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:55824
I20260808 15:50:50.783288 28599 tablet_service.cc:1514] Processing DeleteTablet for tablet 27df5b2bfef2485eb3c840c465e1393e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:50:50 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:53020
I20260808 15:50:50.783671 28889 tablet_service.cc:1514] Processing DeleteTablet for tablet 27df5b2bfef2485eb3c840c465e1393e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:50:50 UTC) from {username='kudu', principal='kudu/127.8.39.126@KRBTEST.COM'} at 127.0.0.1:39020
I20260808 15:50:50.783855 29004 tablet_replica.cc:330] T 27df5b2bfef2485eb3c840c465e1393e P cff49f499f85490c87f87c75df94d321: stopping tablet replica
I20260808 15:50:50.784200 29005 tablet_replica.cc:330] T 27df5b2bfef2485eb3c840c465e1393e P 0101add69ba64cd5aa781574020fbe7b: stopping tablet replica
I20260808 15:50:50.784212 29004 raft_consensus.cc:2229] T 27df5b2bfef2485eb3c840c465e1393e P cff49f499f85490c87f87c75df94d321 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:50:50.784580 29004 raft_consensus.cc:2258] T 27df5b2bfef2485eb3c840c465e1393e P cff49f499f85490c87f87c75df94d321 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:50:50.784570 29005 raft_consensus.cc:2229] T 27df5b2bfef2485eb3c840c465e1393e P 0101add69ba64cd5aa781574020fbe7b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:50:50.784636 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 28533
I20260808 15:50:50.784876 29005 raft_consensus.cc:2258] T 27df5b2bfef2485eb3c840c465e1393e P 0101add69ba64cd5aa781574020fbe7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:50:50.787652 29003 tablet_replica.cc:330] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786: stopping tablet replica
I20260808 15:50:50.788021 29003 raft_consensus.cc:2229] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:50:50.788308 29005 ts_tablet_manager.cc:1905] T 27df5b2bfef2485eb3c840c465e1393e P 0101add69ba64cd5aa781574020fbe7b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:50:50.788661 29003 raft_consensus.cc:2258] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:50:50.790356 29003 ts_tablet_manager.cc:1905] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:50:50.791525 29005 ts_tablet_manager.cc:1918] T 27df5b2bfef2485eb3c840c465e1393e P 0101add69ba64cd5aa781574020fbe7b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:50:50.791652 29005 log.cc:1196] T 27df5b2bfef2485eb3c840c465e1393e P 0101add69ba64cd5aa781574020fbe7b: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/27df5b2bfef2485eb3c840c465e1393e
I20260808 15:50:50.792013 29005 ts_tablet_manager.cc:1939] T 27df5b2bfef2485eb3c840c465e1393e P 0101add69ba64cd5aa781574020fbe7b: Deleting consensus metadata
I20260808 15:50:50.793442 28454 catalog_manager.cc:4841] TS 0101add69ba64cd5aa781574020fbe7b (127.8.39.67:45967): tablet 27df5b2bfef2485eb3c840c465e1393e (table test-table [id=5f0ca771110940a1aba4b1c75ced5a4c]) successfully deleted
I20260808 15:50:50.793735 29003 ts_tablet_manager.cc:1918] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:50:50.793843 29003 log.cc:1196] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786203987027663-8349-0/minicluster-data/ts-1/wal/wals/27df5b2bfef2485eb3c840c465e1393e
I20260808 15:50:50.794137 29003 ts_tablet_manager.cc:1939] T 27df5b2bfef2485eb3c840c465e1393e P 302506d664de41bab746f4a63d2b2786: Deleting consensus metadata
W20260808 15:50:50.794795 28452 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.39.65:46213 (error 108)
I20260808 15:50:50.795364 28453 catalog_manager.cc:4841] TS 302506d664de41bab746f4a63d2b2786 (127.8.39.66:40357): tablet 27df5b2bfef2485eb3c840c465e1393e (table test-table [id=5f0ca771110940a1aba4b1c75ced5a4c]) successfully deleted
I20260808 15:50:50.796048 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 28674
I20260808 15:50:50.796089 28974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:50.795753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:46213 (local address 127.0.0.1:53034)
0808 15:50:50.795933 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:50.796009 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.65:46213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260808 15:50:50.798112 28452 catalog_manager.cc:4584] TS cff49f499f85490c87f87c75df94d321 (127.8.39.65:46213): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 27df5b2bfef2485eb3c840c465e1393e: Network error: Client connection negotiation failed: client connection to 127.8.39.65:46213: connect: Connection refused (error 111)
I20260808 15:50:50.803723 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 28824
I20260808 15:50:50.810904 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 28434
2026-08-08T15:50:50Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2623 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T15:50:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:50:50Z Disabled control of system clock
I20260808 15:50:50.846086 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:46805
--webserver_interface=127.8.39.126
--webserver_port=0
--builtin_ntp_servers=127.8.39.84:40981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:46805
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 15:50:50.963184 29010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:50.963490 29010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:50.963527 29010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:50.967609 29010 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:50:50.967679 29010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:50.967696 29010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:50.967713 29010 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:50:50.967729 29010 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:50:50.972669 29010 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:40981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:46805
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:46805
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29010
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:50.973820 29010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:50.975385 29010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:50.984766 29016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:50.984777 29020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:50.984830 29010 server_base.cc:1034] running on GCE node
W20260808 15:50:50.984776 29017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:50.985594 29010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:50.986901 29010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:50.988138 29010 hybrid_clock.cc:648] HybridClock initialized: now 1786204250988097 us; error 56 us; skew 500 ppm
I20260808 15:50:50.994129 29010 webserver.cc:460] Webserver started at http://127.8.39.126:44573/ using document root <none> and password file <none>
I20260808 15:50:50.994998 29010 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:50.995122 29010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:50.995375 29010 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:50.997655 29010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "90610c2dc449443d8237fa78a4a3c581"
format_stamp: "Formatted at 2026-08-08 15:50:50 on dist-test-slave-8tdl"
server_key: "97d204c00728ddda179324b8d159add5"
server_key_iv: "857e4ccde0191d11941ff94fe32cf72e"
server_key_version: "encryptionkey@0"
I20260808 15:50:50.998283 29010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "90610c2dc449443d8237fa78a4a3c581"
format_stamp: "Formatted at 2026-08-08 15:50:50 on dist-test-slave-8tdl"
server_key: "97d204c00728ddda179324b8d159add5"
server_key_iv: "857e4ccde0191d11941ff94fe32cf72e"
server_key_version: "encryptionkey@0"
I20260808 15:50:51.002772 29010 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.001s
I20260808 15:50:51.006176 29026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:51.007803 29010 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 15:50:51.008068 29010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "90610c2dc449443d8237fa78a4a3c581"
format_stamp: "Formatted at 2026-08-08 15:50:50 on dist-test-slave-8tdl"
server_key: "97d204c00728ddda179324b8d159add5"
server_key_iv: "857e4ccde0191d11941ff94fe32cf72e"
server_key_version: "encryptionkey@0"
I20260808 15:50:51.008222 29010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:51.028033 29010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:51.028832 29010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:51.029062 29010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:51.036628 29010 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:46805
I20260808 15:50:51.036660 29081 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:46805 every 8 connection(s)
I20260808 15:50:51.037658 29010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:50:51.041785 29082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:51.043784 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 29010
I20260808 15:50:51.043901 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:50:51.044292 8349 external_mini_cluster.cc:1428] Setting key bdf82eea2d02f7f03db90e92fb7387ff
I20260808 15:50:51.049312 29082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90610c2dc449443d8237fa78a4a3c581: Bootstrap starting.
I20260808 15:50:51.052201 29082 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90610c2dc449443d8237fa78a4a3c581: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:51.053107 29082 log.cc:824] T 00000000000000000000000000000000 P 90610c2dc449443d8237fa78a4a3c581: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:51.054730 29085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:51.045951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60096 (local address 127.8.39.126:46805)
0808 15:50:51.046623 (+ 672us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:51.046641 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:51.046734 (+ 93us) server_negotiation.cc:407] Connection header received
0808 15:50:51.047456 (+ 722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:51.047475 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:51.047929 (+ 454us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:51.048233 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:51.048698 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.049774 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.051080 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.051561 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.051683 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:51.052696 (+ 1013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:51.052701 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:51.052714 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:50:51.053129 (+ 415us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:51.053194 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:50:51.053214 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:51.053345 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:51.053495 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 15:50:51.053787 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":162,"threads_started":1}
I20260808 15:50:51.055667 29082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90610c2dc449443d8237fa78a4a3c581: No bootstrap required, opened a new log
I20260808 15:50:51.059625 29082 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90610c2dc449443d8237fa78a4a3c581 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90610c2dc449443d8237fa78a4a3c581" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 46805 } }
I20260808 15:50:51.059897 29082 raft_consensus.cc:374] T 00000000000000000000000000000000 P 90610c2dc449443d8237fa78a4a3c581 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:51.059933 29082 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90610c2dc449443d8237fa78a4a3c581 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90610c2dc449443d8237fa78a4a3c581, State: Initialized, Role: FOLLOWER
I20260808 15:50:51.060366 29082 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90610c2dc449443d8237fa78a4a3c581 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90610c2dc449443d8237fa78a4a3c581" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 46805 } }
I20260808 15:50:51.060492 29082 raft_consensus.cc:388] T 00000000000000000000000000000000 P 90610c2dc449443d8237fa78a4a3c581 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:50:51.060536 29082 raft_consensus.cc:482] T 00000000000000000000000000000000 P 90610c2dc449443d8237fa78a4a3c581 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:50:51.060613 29082 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90610c2dc449443d8237fa78a4a3c581 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:51.061618 29082 raft_consensus.cc:504] T 00000000000000000000000000000000 P 90610c2dc449443d8237fa78a4a3c581 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90610c2dc449443d8237fa78a4a3c581" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 46805 } }
I20260808 15:50:51.061928 29082 leader_election.cc:302] T 00000000000000000000000000000000 P 90610c2dc449443d8237fa78a4a3c581 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 90610c2dc449443d8237fa78a4a3c581; no voters:
I20260808 15:50:51.062220 29082 leader_election.cc:288] T 00000000000000000000000000000000 P 90610c2dc449443d8237fa78a4a3c581 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:50:51.062412 29088 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 90610c2dc449443d8237fa78a4a3c581 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:50:51.062646 29088 raft_consensus.cc:686] T 00000000000000000000000000000000 P 90610c2dc449443d8237fa78a4a3c581 [term 1 LEADER]: Becoming Leader. State: Replica: 90610c2dc449443d8237fa78a4a3c581, State: Running, Role: LEADER
I20260808 15:50:51.063104 29088 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90610c2dc449443d8237fa78a4a3c581 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90610c2dc449443d8237fa78a4a3c581" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 46805 } }
I20260808 15:50:51.063609 29082 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90610c2dc449443d8237fa78a4a3c581 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:50:51.064922 29089 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90610c2dc449443d8237fa78a4a3c581 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "90610c2dc449443d8237fa78a4a3c581" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90610c2dc449443d8237fa78a4a3c581" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 46805 } } }
I20260808 15:50:51.065063 29089 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90610c2dc449443d8237fa78a4a3c581 [sys.catalog]: This master's current role is: LEADER
I20260808 15:50:51.065318 29090 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90610c2dc449443d8237fa78a4a3c581 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90610c2dc449443d8237fa78a4a3c581. Latest consensus state: current_term: 1 leader_uuid: "90610c2dc449443d8237fa78a4a3c581" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90610c2dc449443d8237fa78a4a3c581" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 46805 } } }
I20260808 15:50:51.065469 29097 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:50:51.065568 29090 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90610c2dc449443d8237fa78a4a3c581 [sys.catalog]: This master's current role is: LEADER
I20260808 15:50:51.068948 29097 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:50:51.075994 29097 catalog_manager.cc:1347] Generated new cluster ID: b6ba63af4e1547cea85abbfa66be8b54
I20260808 15:50:51.076150 29097 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:50:51.096321 29097 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:50:51.097352 29097 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:50:51.109889 29097 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 90610c2dc449443d8237fa78a4a3c581: Generated new TSK 0
I20260808 15:50:51.110894 29097 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:50:51.121665 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.65:0
--local_ip_for_outbound_sockets=127.8.39.65
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:46805
--builtin_ntp_servers=127.8.39.84:40981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 15:50:51.246209 29108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:51.246585 29108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:51.246630 29108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:51.250850 29108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:51.250934 29108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:51.250993 29108 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.65
I20260808 15:50:51.255997 29108 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:40981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.39.65
--webserver_port=0
--tserver_master_addrs=127.8.39.126:46805
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29108
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.65
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:51.257258 29108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:51.258697 29108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:51.268967 29114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:51.269011 29113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:51.269078 29108 server_base.cc:1034] running on GCE node
W20260808 15:50:51.269006 29116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:51.270112 29108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:51.270992 29108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:51.272183 29108 hybrid_clock.cc:648] HybridClock initialized: now 1786204251272171 us; error 36 us; skew 500 ppm
I20260808 15:50:51.274211 29108 webserver.cc:460] Webserver started at http://127.8.39.65:40819/ using document root <none> and password file <none>
I20260808 15:50:51.274933 29108 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:51.275031 29108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:51.275276 29108 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:51.277556 29108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-0/data/instance:
uuid: "fbe4558d48bd4c749e54f6e557581f54"
format_stamp: "Formatted at 2026-08-08 15:50:51 on dist-test-slave-8tdl"
server_key: "eba05f9275b9d31fe06da26d4bd06c9b"
server_key_iv: "48483407bd72692f4c44764cb38153d1"
server_key_version: "encryptionkey@0"
I20260808 15:50:51.278172 29108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance:
uuid: "fbe4558d48bd4c749e54f6e557581f54"
format_stamp: "Formatted at 2026-08-08 15:50:51 on dist-test-slave-8tdl"
server_key: "eba05f9275b9d31fe06da26d4bd06c9b"
server_key_iv: "48483407bd72692f4c44764cb38153d1"
server_key_version: "encryptionkey@0"
I20260808 15:50:51.282239 29108 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260808 15:50:51.285022 29123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:51.286351 29108 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 15:50:51.286504 29108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-0/wal
uuid: "fbe4558d48bd4c749e54f6e557581f54"
format_stamp: "Formatted at 2026-08-08 15:50:51 on dist-test-slave-8tdl"
server_key: "eba05f9275b9d31fe06da26d4bd06c9b"
server_key_iv: "48483407bd72692f4c44764cb38153d1"
server_key_version: "encryptionkey@0"
I20260808 15:50:51.286643 29108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:51.298800 29108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:51.299551 29108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:51.299762 29108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:51.300410 29108 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:50:51.301391 29108 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:50:51.301465 29108 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:51.301545 29108 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:50:51.301597 29108 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:51.311101 29108 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.65:41343
I20260808 15:50:51.311125 29243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.65:41343 every 8 connection(s)
I20260808 15:50:51.312148 29108 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-0/data/info.pb
I20260808 15:50:51.317651 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 29108
I20260808 15:50:51.317801 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-0/wal/instance
I20260808 15:50:51.318126 8349 external_mini_cluster.cc:1428] Setting key c18a75b85f93f935ca47884761fa46b1
I20260808 15:50:51.320107 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.66:0
--local_ip_for_outbound_sockets=127.8.39.66
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:46805
--builtin_ntp_servers=127.8.39.84:40981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 15:50:51.322455 29085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:51.314201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.65:53701 (local address 127.8.39.126:46805)
0808 15:50:51.314362 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:51.314366 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:51.315579 (+ 1213us) server_negotiation.cc:407] Connection header received
0808 15:50:51.317071 (+ 1492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:51.317075 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:51.317143 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:51.317259 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:51.318269 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.318947 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.320157 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.320467 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.320581 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:51.321862 (+ 1281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:51.321866 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:51.321868 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:50:51.321883 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:51.321904 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:50:51.321915 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:51.322009 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:51.322241 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 15:50:51.322311 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 15:50:51.324184 29246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:51.314541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:46805 (local address 127.8.39.65:53701)
0808 15:50:51.315375 (+ 834us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:51.315429 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:51.316840 (+ 1411us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:51.317438 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:51.317447 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:51.317531 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:50:51.318120 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:51.318134 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.319103 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.319105 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:51.320017 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:51.320028 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.320633 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.320638 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:51.320818 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:51.321534 (+ 716us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:50:51.321536 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:50:51.321593 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:50:51.321678 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:50:51.322078 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:50:51.322094 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:50:51.322100 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 15:50:51.322722 (+ 622us) client_negotiation.cc:240] Negotiation successful
0808 15:50:51.323039 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":208,"threads_started":1}
I20260808 15:50:51.325662 29244 heartbeater.cc:347] Connected to a master server at 127.8.39.126:46805
I20260808 15:50:51.325971 29244 heartbeater.cc:464] Registering TS with master...
I20260808 15:50:51.326761 29244 heartbeater.cc:511] Master 127.8.39.126:46805 requested a full tablet report, sending...
I20260808 15:50:51.328516 29045 ts_manager.cc:194] Registered new tserver with Master: fbe4558d48bd4c749e54f6e557581f54 (127.8.39.65:41343)
I20260808 15:50:51.329689 29045 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.39.65:53701
W20260808 15:50:51.438004 29248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:51.438525 29248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:51.438607 29248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:51.443069 29248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:51.443137 29248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:51.443195 29248 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.66
I20260808 15:50:51.448607 29248 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:40981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.39.66
--webserver_port=0
--tserver_master_addrs=127.8.39.126:46805
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29248
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.66
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:51.449747 29248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:51.451231 29248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:51.461632 29253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:51.461650 29257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:51.461862 29248 server_base.cc:1034] running on GCE node
W20260808 15:50:51.462116 29254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:51.462582 29248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:51.463312 29248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:51.464506 29248 hybrid_clock.cc:648] HybridClock initialized: now 1786204251464489 us; error 36 us; skew 500 ppm
I20260808 15:50:51.466964 29248 webserver.cc:460] Webserver started at http://127.8.39.66:43117/ using document root <none> and password file <none>
I20260808 15:50:51.467628 29248 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:51.467700 29248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:51.468012 29248 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:51.470376 29248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-1/data/instance:
uuid: "be48e34b607c4188816ff5fa39a43732"
format_stamp: "Formatted at 2026-08-08 15:50:51 on dist-test-slave-8tdl"
server_key: "9328015961e1af6354e07e086f2e7707"
server_key_iv: "fcccc308892e7295beaedd9e942189e0"
server_key_version: "encryptionkey@0"
I20260808 15:50:51.471107 29248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance:
uuid: "be48e34b607c4188816ff5fa39a43732"
format_stamp: "Formatted at 2026-08-08 15:50:51 on dist-test-slave-8tdl"
server_key: "9328015961e1af6354e07e086f2e7707"
server_key_iv: "fcccc308892e7295beaedd9e942189e0"
server_key_version: "encryptionkey@0"
I20260808 15:50:51.475868 29248 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.003s
I20260808 15:50:51.478906 29263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:51.480325 29248 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 15:50:51.480481 29248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-1/wal
uuid: "be48e34b607c4188816ff5fa39a43732"
format_stamp: "Formatted at 2026-08-08 15:50:51 on dist-test-slave-8tdl"
server_key: "9328015961e1af6354e07e086f2e7707"
server_key_iv: "fcccc308892e7295beaedd9e942189e0"
server_key_version: "encryptionkey@0"
I20260808 15:50:51.480618 29248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:51.499545 29248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:51.500322 29248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:51.500557 29248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:51.501215 29248 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:50:51.502269 29248 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:50:51.502344 29248 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:51.502419 29248 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:50:51.502470 29248 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:51.512574 29248 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.66:37677
I20260808 15:50:51.512632 29394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.66:37677 every 8 connection(s)
I20260808 15:50:51.513628 29248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-1/data/info.pb
I20260808 15:50:51.519019 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 29248
I20260808 15:50:51.519182 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-1/wal/instance
I20260808 15:50:51.519510 8349 external_mini_cluster.cc:1428] Setting key b9022b734bcb85497eca542245045d2d
I20260808 15:50:51.521776 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.39.67:0
--local_ip_for_outbound_sockets=127.8.39.67
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:46805
--builtin_ntp_servers=127.8.39.84:40981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 15:50:51.524169 29085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:51.515729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.66:46729 (local address 127.8.39.126:46805)
0808 15:50:51.515887 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:51.515892 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:51.517069 (+ 1177us) server_negotiation.cc:407] Connection header received
0808 15:50:51.518463 (+ 1394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:51.518465 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:51.518518 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:51.518599 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:51.519867 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.520430 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.521829 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.522242 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.522375 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:51.523607 (+ 1232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:51.523613 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:51.523617 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:50:51.523636 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:51.523667 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:50:51.523681 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:51.523756 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:51.523987 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 15:50:51.524051 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 15:50:51.525417 29397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:51.516179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:46805 (local address 127.8.39.66:46729)
0808 15:50:51.516908 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:51.516950 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:51.518243 (+ 1293us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:51.518850 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:51.518860 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:51.518967 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:50:51.519694 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:51.519714 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.520577 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.520581 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:51.521689 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:51.521699 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.522409 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.522412 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:51.522561 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:51.523279 (+ 718us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:50:51.523281 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:50:51.523326 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:50:51.523396 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:50:51.523783 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:50:51.523794 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:50:51.523802 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 15:50:51.523945 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 15:50:51.524315 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":148,"threads_started":1}
I20260808 15:50:51.526763 29395 heartbeater.cc:347] Connected to a master server at 127.8.39.126:46805
I20260808 15:50:51.527029 29395 heartbeater.cc:464] Registering TS with master...
I20260808 15:50:51.527601 29395 heartbeater.cc:511] Master 127.8.39.126:46805 requested a full tablet report, sending...
I20260808 15:50:51.528849 29045 ts_manager.cc:194] Registered new tserver with Master: be48e34b607c4188816ff5fa39a43732 (127.8.39.66:37677)
I20260808 15:50:51.529755 29045 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.39.66:46729
W20260808 15:50:51.642668 29398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:51.643008 29398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:51.643057 29398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:51.647212 29398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:51.647280 29398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:51.647339 29398 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.39.67
I20260808 15:50:51.652379 29398 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:40981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.39.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.39.67
--webserver_port=0
--tserver_master_addrs=127.8.39.126:46805
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.39.67
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:51.653535 29398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:51.654963 29398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:51.666231 29406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:51.666225 29404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:51.666231 29403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:51.666518 29398 server_base.cc:1034] running on GCE node
I20260808 15:50:51.667086 29398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:51.667801 29398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:51.668992 29398 hybrid_clock.cc:648] HybridClock initialized: now 1786204251668965 us; error 46 us; skew 500 ppm
I20260808 15:50:51.671096 29398 webserver.cc:460] Webserver started at http://127.8.39.67:34659/ using document root <none> and password file <none>
I20260808 15:50:51.671757 29398 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:51.671860 29398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:51.672155 29398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:51.674343 29398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-2/data/instance:
uuid: "2f35b1e1ae3942a5ad73bd81a1bf62fe"
format_stamp: "Formatted at 2026-08-08 15:50:51 on dist-test-slave-8tdl"
server_key: "fd82c1602b4d58d8c408cb5a9df60d0d"
server_key_iv: "52a7b989c5a23b344e49f95741200112"
server_key_version: "encryptionkey@0"
I20260808 15:50:51.675007 29398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance:
uuid: "2f35b1e1ae3942a5ad73bd81a1bf62fe"
format_stamp: "Formatted at 2026-08-08 15:50:51 on dist-test-slave-8tdl"
server_key: "fd82c1602b4d58d8c408cb5a9df60d0d"
server_key_iv: "52a7b989c5a23b344e49f95741200112"
server_key_version: "encryptionkey@0"
I20260808 15:50:51.679378 29398 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 15:50:51.682221 29412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:51.683802 29398 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:50:51.683947 29398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-2/wal
uuid: "2f35b1e1ae3942a5ad73bd81a1bf62fe"
format_stamp: "Formatted at 2026-08-08 15:50:51 on dist-test-slave-8tdl"
server_key: "fd82c1602b4d58d8c408cb5a9df60d0d"
server_key_iv: "52a7b989c5a23b344e49f95741200112"
server_key_version: "encryptionkey@0"
I20260808 15:50:51.684079 29398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:51.726383 29398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:51.727598 29398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:51.727841 29398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:51.728507 29398 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:50:51.729489 29398 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:50:51.729547 29398 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:51.729590 29398 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:50:51.729606 29398 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:51.738927 29398 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.67:41883
I20260808 15:50:51.738953 29534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.67:41883 every 8 connection(s)
I20260808 15:50:51.739969 29398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-2/data/info.pb
I20260808 15:50:51.741117 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 29398
I20260808 15:50:51.741218 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-2/wal/instance
I20260808 15:50:51.741462 8349 external_mini_cluster.cc:1428] Setting key d7a8eb4a016772f2ee22e170b7dc2727
I20260808 15:50:51.751164 29085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:51.742529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:53265 (local address 127.8.39.126:46805)
0808 15:50:51.742751 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:51.742757 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:51.744212 (+ 1455us) server_negotiation.cc:407] Connection header received
0808 15:50:51.745783 (+ 1571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:51.745786 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:51.745834 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:51.745906 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:51.747042 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.747588 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.748887 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.749142 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.749228 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:51.750656 (+ 1428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:51.750659 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:51.750661 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:50:51.750727 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:51.750748 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:50:51.750758 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:51.750823 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:51.750976 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 15:50:51.751040 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 15:50:51.752177 29537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:51.743088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:46805 (local address 127.8.39.67:53265)
0808 15:50:51.744040 (+ 952us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:51.744104 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:51.745578 (+ 1474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:51.746093 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:51.746100 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:51.746194 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:50:51.746893 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:51.746911 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.747730 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.747733 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:51.748765 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:51.748776 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.749352 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.749355 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:51.749527 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:51.750378 (+ 851us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:50:51.750379 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:50:51.750427 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:50:51.750504 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:50:51.750841 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:50:51.750849 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:50:51.750853 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 15:50:51.750960 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 15:50:51.751248 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":189,"threads_started":1}
I20260808 15:50:51.753608 29535 heartbeater.cc:347] Connected to a master server at 127.8.39.126:46805
I20260808 15:50:51.753875 29535 heartbeater.cc:464] Registering TS with master...
I20260808 15:50:51.754472 29535 heartbeater.cc:511] Master 127.8.39.126:46805 requested a full tablet report, sending...
I20260808 15:50:51.755746 29045 ts_manager.cc:194] Registered new tserver with Master: 2f35b1e1ae3942a5ad73bd81a1bf62fe (127.8.39.67:41883)
I20260808 15:50:51.756273 8349 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:50:51.756520 29045 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.39.67:53265
I20260808 15:50:51.762537 29085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:51.758507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60104 (local address 127.8.39.126:46805)
0808 15:50:51.758658 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:51.758663 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:51.758874 (+ 211us) server_negotiation.cc:407] Connection header received
0808 15:50:51.758990 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:51.758992 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:51.759039 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:51.759108 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:51.759470 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.759962 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.760845 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.761068 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.761145 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:51.762092 (+ 947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:51.762095 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:51.762097 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:50:51.762110 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:51.762126 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:50:51.762133 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:51.762184 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:51.762297 (+ 113us) server_negotiation.cc:299] Negotiation successful
0808 15:50:51.762351 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 15:50:51.765852 29045 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60104:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:50:51.769094 29045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:50:51.785287 29549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:51.778608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33838 (local address 127.8.39.66:37677)
0808 15:50:51.779464 (+ 856us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:51.779480 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:51.779511 (+ 31us) server_negotiation.cc:407] Connection header received
0808 15:50:51.779597 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:51.779602 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:51.779816 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:51.780056 (+ 240us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:51.780577 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.781797 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.783789 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.784505 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.784649 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:51.784878 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:51.784982 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 15:50:51.785097 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":740,"thread_start_us":172,"threads_started":1}
I20260808 15:50:51.785306 29547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:51.778409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:37677 (local address 127.0.0.1:33838)
0808 15:50:51.778934 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:51.778986 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:51.779135 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:51.780009 (+ 874us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:51.780015 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:51.780042 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:51.780202 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:51.780434 (+ 232us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.781931 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.781933 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:51.783618 (+ 1685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:51.783630 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.784661 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.784665 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:51.784782 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:51.784824 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 15:50:51.784951 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 15:50:51.785167 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"mutex_wait_us":113,"thread_start_us":120,"threads_started":1}
I20260808 15:50:51.785722 29550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:51.779192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:41343 (local address 127.0.0.1:60346)
0808 15:50:51.779513 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:51.779527 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:51.779629 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:51.780867 (+ 1238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:51.780870 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:51.780889 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:51.780990 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:51.780997 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.782184 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.782188 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:51.783497 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:51.783508 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.784964 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.784967 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:51.785333 (+ 366us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:51.785368 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 15:50:51.785463 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 15:50:51.785587 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"mutex_wait_us":62,"thread_start_us":105,"threads_started":1}
I20260808 15:50:51.786055 29548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:51.778605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.67:41883 (local address 127.0.0.1:36118)
0808 15:50:51.779075 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:51.779092 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:51.779196 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:51.780273 (+ 1077us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:51.780275 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:51.780290 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:51.780374 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:51.780380 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.781928 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.781931 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:51.783618 (+ 1687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:51.783630 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.784964 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.784967 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:51.785338 (+ 371us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:51.785755 (+ 417us) client_negotiation.cc:769] Sending connection context
0808 15:50:51.785835 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 15:50:51.785915 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":395,"mutex_wait_us":412,"thread_start_us":139,"threads_started":1}
I20260808 15:50:51.786199 29552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:51.779511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60346 (local address 127.8.39.65:41343)
0808 15:50:51.780393 (+ 882us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:51.780405 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:51.780431 (+ 26us) server_negotiation.cc:407] Connection header received
0808 15:50:51.780514 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:51.780518 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:51.780711 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:51.780888 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:51.781117 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.782068 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.783644 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.784589 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.784702 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:51.784891 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:51.785925 (+ 1034us) server_negotiation.cc:299] Negotiation successful
0808 15:50:51.786037 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":773,"thread_start_us":165,"threads_started":1}
I20260808 15:50:51.786832 29551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:51.779296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36118 (local address 127.8.39.67:41883)
0808 15:50:51.779832 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:51.779844 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:51.779866 (+ 22us) server_negotiation.cc:407] Connection header received
0808 15:50:51.779944 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:51.779949 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:51.780124 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:51.780270 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:51.780519 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.781784 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.783777 (+ 1993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.784597 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.784702 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:51.784891 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:51.786516 (+ 1625us) server_negotiation.cc:299] Negotiation successful
0808 15:50:51.786633 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":218,"threads_started":1}
I20260808 15:50:51.788967 29319 tablet_service.cc:1467] Processing CreateTablet for tablet e904a1e33ae446838652dba0130299b4 (DEFAULT_TABLE table=test-table [id=117086557eff463681bd978ceb945772]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:50:51.789273 29173 tablet_service.cc:1467] Processing CreateTablet for tablet e904a1e33ae446838652dba0130299b4 (DEFAULT_TABLE table=test-table [id=117086557eff463681bd978ceb945772]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:50:51.790127 29319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e904a1e33ae446838652dba0130299b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:51.790364 29173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e904a1e33ae446838652dba0130299b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:51.790033 29463 tablet_service.cc:1467] Processing CreateTablet for tablet e904a1e33ae446838652dba0130299b4 (DEFAULT_TABLE table=test-table [id=117086557eff463681bd978ceb945772]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:50:51.791086 29463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e904a1e33ae446838652dba0130299b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:51.797009 29553 tablet_bootstrap.cc:492] T e904a1e33ae446838652dba0130299b4 P be48e34b607c4188816ff5fa39a43732: Bootstrap starting.
I20260808 15:50:51.798228 29555 tablet_bootstrap.cc:492] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe: Bootstrap starting.
I20260808 15:50:51.799245 29554 tablet_bootstrap.cc:492] T e904a1e33ae446838652dba0130299b4 P fbe4558d48bd4c749e54f6e557581f54: Bootstrap starting.
I20260808 15:50:51.799391 29553 tablet_bootstrap.cc:654] T e904a1e33ae446838652dba0130299b4 P be48e34b607c4188816ff5fa39a43732: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:51.800299 29553 log.cc:824] T e904a1e33ae446838652dba0130299b4 P be48e34b607c4188816ff5fa39a43732: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:51.800462 29555 tablet_bootstrap.cc:654] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:51.801182 29554 tablet_bootstrap.cc:654] T e904a1e33ae446838652dba0130299b4 P fbe4558d48bd4c749e54f6e557581f54: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:51.801210 29555 log.cc:824] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:51.801967 29554 log.cc:824] T e904a1e33ae446838652dba0130299b4 P fbe4558d48bd4c749e54f6e557581f54: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:51.802757 29553 tablet_bootstrap.cc:492] T e904a1e33ae446838652dba0130299b4 P be48e34b607c4188816ff5fa39a43732: No bootstrap required, opened a new log
I20260808 15:50:51.803071 29553 ts_tablet_manager.cc:1397] T e904a1e33ae446838652dba0130299b4 P be48e34b607c4188816ff5fa39a43732: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260808 15:50:51.803180 29555 tablet_bootstrap.cc:492] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe: No bootstrap required, opened a new log
I20260808 15:50:51.803375 29555 ts_tablet_manager.cc:1397] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 15:50:51.803833 29554 tablet_bootstrap.cc:492] T e904a1e33ae446838652dba0130299b4 P fbe4558d48bd4c749e54f6e557581f54: No bootstrap required, opened a new log
I20260808 15:50:51.804028 29554 ts_tablet_manager.cc:1397] T e904a1e33ae446838652dba0130299b4 P fbe4558d48bd4c749e54f6e557581f54: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 15:50:51.807315 29554 raft_consensus.cc:348] T e904a1e33ae446838652dba0130299b4 P fbe4558d48bd4c749e54f6e557581f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be48e34b607c4188816ff5fa39a43732" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 37677 } } peers { permanent_uuid: "2f35b1e1ae3942a5ad73bd81a1bf62fe" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41883 } } peers { permanent_uuid: "fbe4558d48bd4c749e54f6e557581f54" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 41343 } }
I20260808 15:50:51.807616 29554 raft_consensus.cc:374] T e904a1e33ae446838652dba0130299b4 P fbe4558d48bd4c749e54f6e557581f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:51.807674 29554 raft_consensus.cc:729] T e904a1e33ae446838652dba0130299b4 P fbe4558d48bd4c749e54f6e557581f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbe4558d48bd4c749e54f6e557581f54, State: Initialized, Role: FOLLOWER
I20260808 15:50:51.807677 29555 raft_consensus.cc:348] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be48e34b607c4188816ff5fa39a43732" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 37677 } } peers { permanent_uuid: "2f35b1e1ae3942a5ad73bd81a1bf62fe" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41883 } } peers { permanent_uuid: "fbe4558d48bd4c749e54f6e557581f54" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 41343 } }
I20260808 15:50:51.807677 29553 raft_consensus.cc:348] T e904a1e33ae446838652dba0130299b4 P be48e34b607c4188816ff5fa39a43732 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be48e34b607c4188816ff5fa39a43732" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 37677 } } peers { permanent_uuid: "2f35b1e1ae3942a5ad73bd81a1bf62fe" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41883 } } peers { permanent_uuid: "fbe4558d48bd4c749e54f6e557581f54" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 41343 } }
I20260808 15:50:51.807938 29555 raft_consensus.cc:374] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:51.808000 29555 raft_consensus.cc:729] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f35b1e1ae3942a5ad73bd81a1bf62fe, State: Initialized, Role: FOLLOWER
I20260808 15:50:51.808013 29553 raft_consensus.cc:374] T e904a1e33ae446838652dba0130299b4 P be48e34b607c4188816ff5fa39a43732 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:51.808076 29553 raft_consensus.cc:729] T e904a1e33ae446838652dba0130299b4 P be48e34b607c4188816ff5fa39a43732 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be48e34b607c4188816ff5fa39a43732, State: Initialized, Role: FOLLOWER
I20260808 15:50:51.808187 29554 consensus_queue.cc:260] T e904a1e33ae446838652dba0130299b4 P fbe4558d48bd4c749e54f6e557581f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be48e34b607c4188816ff5fa39a43732" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 37677 } } peers { permanent_uuid: "2f35b1e1ae3942a5ad73bd81a1bf62fe" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41883 } } peers { permanent_uuid: "fbe4558d48bd4c749e54f6e557581f54" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 41343 } }
I20260808 15:50:51.808463 29553 consensus_queue.cc:260] T e904a1e33ae446838652dba0130299b4 P be48e34b607c4188816ff5fa39a43732 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be48e34b607c4188816ff5fa39a43732" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 37677 } } peers { permanent_uuid: "2f35b1e1ae3942a5ad73bd81a1bf62fe" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41883 } } peers { permanent_uuid: "fbe4558d48bd4c749e54f6e557581f54" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 41343 } }
I20260808 15:50:51.808463 29555 consensus_queue.cc:260] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be48e34b607c4188816ff5fa39a43732" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 37677 } } peers { permanent_uuid: "2f35b1e1ae3942a5ad73bd81a1bf62fe" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41883 } } peers { permanent_uuid: "fbe4558d48bd4c749e54f6e557581f54" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 41343 } }
I20260808 15:50:51.809373 29554 ts_tablet_manager.cc:1428] T e904a1e33ae446838652dba0130299b4 P fbe4558d48bd4c749e54f6e557581f54: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 15:50:51.809427 29553 ts_tablet_manager.cc:1428] T e904a1e33ae446838652dba0130299b4 P be48e34b607c4188816ff5fa39a43732: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 15:50:51.809433 29555 ts_tablet_manager.cc:1428] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 15:50:51.809755 29244 heartbeater.cc:503] Master 127.8.39.126:46805 was elected leader, sending a full tablet report...
I20260808 15:50:51.809754 29395 heartbeater.cc:503] Master 127.8.39.126:46805 was elected leader, sending a full tablet report...
I20260808 15:50:51.810882 29535 heartbeater.cc:503] Master 127.8.39.126:46805 was elected leader, sending a full tablet report...
W20260808 15:50:51.813470 29245 tablet.cc:2369] T e904a1e33ae446838652dba0130299b4 P fbe4558d48bd4c749e54f6e557581f54: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:50:51.887128 29560 raft_consensus.cc:482] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:50:51.887429 29560 raft_consensus.cc:504] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be48e34b607c4188816ff5fa39a43732" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 37677 } } peers { permanent_uuid: "2f35b1e1ae3942a5ad73bd81a1bf62fe" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41883 } } peers { permanent_uuid: "fbe4558d48bd4c749e54f6e557581f54" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 41343 } }
I20260808 15:50:51.888906 29560 leader_election.cc:288] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be48e34b607c4188816ff5fa39a43732 (127.8.39.66:37677), fbe4558d48bd4c749e54f6e557581f54 (127.8.39.65:41343)
I20260808 15:50:51.894030 29549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:51.889968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:45731 (local address 127.8.39.66:37677)
0808 15:50:51.890092 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:51.890099 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:51.890120 (+ 21us) server_negotiation.cc:407] Connection header received
0808 15:50:51.890190 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:51.890195 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:51.890261 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:51.890377 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:51.890907 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.891753 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.893038 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.893443 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.893569 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:51.893633 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:51.893836 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 15:50:51.893914 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 15:50:51.894030 29537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:51.889165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.66:37677 (local address 127.8.39.67:45731)
0808 15:50:51.889278 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:51.889295 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:51.889402 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:51.890528 (+ 1126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:51.890535 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:51.890558 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:51.890730 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:51.890741 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.891887 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.891890 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:51.892920 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:51.892927 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.893573 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.893576 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:51.893684 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:51.893709 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 15:50:51.893803 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 15:50:51.893881 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 15:50:51.894284 29552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:51.889722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.39.67:46253 (local address 127.8.39.65:41343)
0808 15:50:51.889887 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:51.889892 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:51.890023 (+ 131us) server_negotiation.cc:407] Connection header received
0808 15:50:51.890224 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:51.890227 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:51.890282 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:51.890368 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:50:51.890659 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.891339 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.892795 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.893483 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.893602 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:51.893669 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:51.894044 (+ 375us) server_negotiation.cc:299] Negotiation successful
0808 15:50:51.894141 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 15:50:51.894848 29342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e904a1e33ae446838652dba0130299b4" candidate_uuid: "2f35b1e1ae3942a5ad73bd81a1bf62fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be48e34b607c4188816ff5fa39a43732" is_pre_election: true
I20260808 15:50:51.894976 29562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:51.889471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:41343 (local address 127.8.39.67:46253)
0808 15:50:51.889899 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:51.889914 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:50:51.890112 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:50:51.890377 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:50:51.890380 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:50:51.890395 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:50:51.890541 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:51.890547 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.891450 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.891456 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:51.892647 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:50:51.892659 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.893752 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.893756 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:50:51.893878 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:51.893906 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 15:50:51.894642 (+ 736us) client_negotiation.cc:240] Negotiation successful
0808 15:50:51.894770 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":143,"threads_started":1}
I20260808 15:50:51.895231 29342 raft_consensus.cc:2454] T e904a1e33ae446838652dba0130299b4 P be48e34b607c4188816ff5fa39a43732 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f35b1e1ae3942a5ad73bd81a1bf62fe in term 0.
I20260808 15:50:51.895810 29413 leader_election.cc:302] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f35b1e1ae3942a5ad73bd81a1bf62fe, be48e34b607c4188816ff5fa39a43732; no voters:
I20260808 15:50:51.895821 29194 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e904a1e33ae446838652dba0130299b4" candidate_uuid: "2f35b1e1ae3942a5ad73bd81a1bf62fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe4558d48bd4c749e54f6e557581f54" is_pre_election: true
I20260808 15:50:51.896106 29194 raft_consensus.cc:2454] T e904a1e33ae446838652dba0130299b4 P fbe4558d48bd4c749e54f6e557581f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f35b1e1ae3942a5ad73bd81a1bf62fe in term 0.
I20260808 15:50:51.896196 29560 raft_consensus.cc:2781] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:50:51.896276 29560 raft_consensus.cc:482] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:50:51.896318 29560 raft_consensus.cc:3037] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:51.897960 29560 raft_consensus.cc:504] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be48e34b607c4188816ff5fa39a43732" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 37677 } } peers { permanent_uuid: "2f35b1e1ae3942a5ad73bd81a1bf62fe" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41883 } } peers { permanent_uuid: "fbe4558d48bd4c749e54f6e557581f54" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 41343 } }
I20260808 15:50:51.898423 29560 leader_election.cc:288] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe [CANDIDATE]: Term 1 election: Requested vote from peers be48e34b607c4188816ff5fa39a43732 (127.8.39.66:37677), fbe4558d48bd4c749e54f6e557581f54 (127.8.39.65:41343)
I20260808 15:50:51.898947 29194 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e904a1e33ae446838652dba0130299b4" candidate_uuid: "2f35b1e1ae3942a5ad73bd81a1bf62fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe4558d48bd4c749e54f6e557581f54"
I20260808 15:50:51.899111 29194 raft_consensus.cc:3037] T e904a1e33ae446838652dba0130299b4 P fbe4558d48bd4c749e54f6e557581f54 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:51.900790 29194 raft_consensus.cc:2454] T e904a1e33ae446838652dba0130299b4 P fbe4558d48bd4c749e54f6e557581f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f35b1e1ae3942a5ad73bd81a1bf62fe in term 1.
I20260808 15:50:51.901360 29342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e904a1e33ae446838652dba0130299b4" candidate_uuid: "2f35b1e1ae3942a5ad73bd81a1bf62fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be48e34b607c4188816ff5fa39a43732"
I20260808 15:50:51.901592 29342 raft_consensus.cc:3037] T e904a1e33ae446838652dba0130299b4 P be48e34b607c4188816ff5fa39a43732 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:51.901774 29413 leader_election.cc:302] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f35b1e1ae3942a5ad73bd81a1bf62fe, fbe4558d48bd4c749e54f6e557581f54; no voters:
I20260808 15:50:51.902118 29560 raft_consensus.cc:2781] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:50:51.902710 29560 raft_consensus.cc:686] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe [term 1 LEADER]: Becoming Leader. State: Replica: 2f35b1e1ae3942a5ad73bd81a1bf62fe, State: Running, Role: LEADER
I20260808 15:50:51.903210 29342 raft_consensus.cc:2454] T e904a1e33ae446838652dba0130299b4 P be48e34b607c4188816ff5fa39a43732 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f35b1e1ae3942a5ad73bd81a1bf62fe in term 1.
I20260808 15:50:51.903151 29560 consensus_queue.cc:237] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be48e34b607c4188816ff5fa39a43732" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 37677 } } peers { permanent_uuid: "2f35b1e1ae3942a5ad73bd81a1bf62fe" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41883 } } peers { permanent_uuid: "fbe4558d48bd4c749e54f6e557581f54" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 41343 } }
I20260808 15:50:51.907336 29043 catalog_manager.cc:5495] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f35b1e1ae3942a5ad73bd81a1bf62fe (127.8.39.67). New cstate: current_term: 1 leader_uuid: "2f35b1e1ae3942a5ad73bd81a1bf62fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be48e34b607c4188816ff5fa39a43732" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f35b1e1ae3942a5ad73bd81a1bf62fe" member_type: VOTER last_known_addr { host: "127.8.39.67" port: 41883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbe4558d48bd4c749e54f6e557581f54" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 41343 } health_report { overall_health: UNKNOWN } } }
I20260808 15:50:51.942134 29551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:51.938175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36122 (local address 127.8.39.67:41883)
0808 15:50:51.938337 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:51.938342 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:51.938360 (+ 18us) server_negotiation.cc:407] Connection header received
0808 15:50:51.938552 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:51.938555 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:51.938625 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:51.938798 (+ 173us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:50:51.939065 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.939592 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.940518 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:51.940761 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:51.940883 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:51.941232 (+ 349us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:50:51.941681 (+ 449us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:50:51.941834 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:51.941877 (+ 43us) server_negotiation.cc:299] Negotiation successful
0808 15:50:51.941933 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 15:50:51.948818 29194 raft_consensus.cc:1261] T e904a1e33ae446838652dba0130299b4 P fbe4558d48bd4c749e54f6e557581f54 [term 1 FOLLOWER]: Refusing update from remote peer 2f35b1e1ae3942a5ad73bd81a1bf62fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:50:51.948818 29342 raft_consensus.cc:1261] T e904a1e33ae446838652dba0130299b4 P be48e34b607c4188816ff5fa39a43732 [term 1 FOLLOWER]: Refusing update from remote peer 2f35b1e1ae3942a5ad73bd81a1bf62fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:50:51.949736 29560 consensus_queue.cc:1035] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbe4558d48bd4c749e54f6e557581f54" member_type: VOTER last_known_addr { host: "127.8.39.65" port: 41343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:50:51.950007 29563 consensus_queue.cc:1035] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "be48e34b607c4188816ff5fa39a43732" member_type: VOTER last_known_addr { host: "127.8.39.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:50:51.968236 29045 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:50:51.968454 29045 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:50:51.971232 29045 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 90610c2dc449443d8237fa78a4a3c581: Sending DeleteTablet for 3 replicas of tablet e904a1e33ae446838652dba0130299b4
I20260808 15:50:51.972155 29463 tablet_service.cc:1514] Processing DeleteTablet for tablet e904a1e33ae446838652dba0130299b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:50:51 UTC) from {username='slave'} at 127.0.0.1:36118
I20260808 15:50:51.972204 29173 tablet_service.cc:1514] Processing DeleteTablet for tablet e904a1e33ae446838652dba0130299b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:50:51 UTC) from {username='slave'} at 127.0.0.1:60346
I20260808 15:50:51.972316 29319 tablet_service.cc:1514] Processing DeleteTablet for tablet e904a1e33ae446838652dba0130299b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:50:51 UTC) from {username='slave'} at 127.0.0.1:33838
I20260808 15:50:51.972822 29578 tablet_replica.cc:330] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe: stopping tablet replica
I20260808 15:50:51.972910 29580 tablet_replica.cc:330] T e904a1e33ae446838652dba0130299b4 P be48e34b607c4188816ff5fa39a43732: stopping tablet replica
I20260808 15:50:51.973263 29578 raft_consensus.cc:2229] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:50:51.973264 29580 raft_consensus.cc:2229] T e904a1e33ae446838652dba0130299b4 P be48e34b607c4188816ff5fa39a43732 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:50:51.973414 29579 tablet_replica.cc:330] T e904a1e33ae446838652dba0130299b4 P fbe4558d48bd4c749e54f6e557581f54: stopping tablet replica
I20260808 15:50:51.973747 29579 raft_consensus.cc:2229] T e904a1e33ae446838652dba0130299b4 P fbe4558d48bd4c749e54f6e557581f54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:50:51.973863 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 29108
I20260808 15:50:51.974107 29579 raft_consensus.cc:2258] T e904a1e33ae446838652dba0130299b4 P fbe4558d48bd4c749e54f6e557581f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:50:51.979066 29580 raft_consensus.cc:2258] T e904a1e33ae446838652dba0130299b4 P be48e34b607c4188816ff5fa39a43732 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:50:51.981529 29580 ts_tablet_manager.cc:1905] T e904a1e33ae446838652dba0130299b4 P be48e34b607c4188816ff5fa39a43732: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:50:51.984675 29580 ts_tablet_manager.cc:1918] T e904a1e33ae446838652dba0130299b4 P be48e34b607c4188816ff5fa39a43732: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:50:51.984767 29580 log.cc:1196] T e904a1e33ae446838652dba0130299b4 P be48e34b607c4188816ff5fa39a43732: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-1/wal/wals/e904a1e33ae446838652dba0130299b4
I20260808 15:50:51.985008 29580 ts_tablet_manager.cc:1939] T e904a1e33ae446838652dba0130299b4 P be48e34b607c4188816ff5fa39a43732: Deleting consensus metadata
I20260808 15:50:51.986294 29027 catalog_manager.cc:4841] TS be48e34b607c4188816ff5fa39a43732 (127.8.39.66:37677): tablet e904a1e33ae446838652dba0130299b4 (table test-table [id=117086557eff463681bd978ceb945772]) successfully deleted
I20260808 15:50:51.973755 29578 raft_consensus.cc:2258] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:50:51.989018 29578 ts_tablet_manager.cc:1905] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 15:50:51.989403 29027 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.39.65:41343 (error 108)
I20260808 15:50:51.990051 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 29248
I20260808 15:50:51.993103 29578 ts_tablet_manager.cc:1918] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:50:51.993263 29578 log.cc:1196] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe: Deleting WAL directory at /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786203987027663-8349-0/minicluster-data/ts-2/wal/wals/e904a1e33ae446838652dba0130299b4
I20260808 15:50:51.993661 29578 ts_tablet_manager.cc:1939] T e904a1e33ae446838652dba0130299b4 P 2f35b1e1ae3942a5ad73bd81a1bf62fe: Deleting consensus metadata
I20260808 15:50:51.995366 29028 catalog_manager.cc:4841] TS 2f35b1e1ae3942a5ad73bd81a1bf62fe (127.8.39.67:41883): tablet e904a1e33ae446838652dba0130299b4 (table test-table [id=117086557eff463681bd978ceb945772]) successfully deleted
I20260808 15:50:51.998346 29548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:51.997932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.65:41343 (local address 127.0.0.1:60348)
0808 15:50:51.998112 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 15:50:51.998224 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.65:41343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 15:50:51.998927 29027 catalog_manager.cc:4584] TS fbe4558d48bd4c749e54f6e557581f54 (127.8.39.65:41343): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e904a1e33ae446838652dba0130299b4: Network error: Client connection negotiation failed: client connection to 127.8.39.65:41343: connect: Connection refused (error 111)
I20260808 15:50:52.005494 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 29398
I20260808 15:50:52.013654 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 29010
2026-08-08T15:50:52Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1201 ms)
[----------] 6 tests from EncryptionPolicyTest (11411 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:50:52 dist-test-slave-8tdl krb5kdc[29584](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:50:52 dist-test-slave-8tdl krb5kdc[29584](info): set up 2 sockets
Aug 08 15:50:52 dist-test-slave-8tdl krb5kdc[29584](info): commencing operation
krb5kdc: starting...
W20260808 15:50:53.185674 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.148s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:50:53 dist-test-slave-8tdl krb5kdc[29584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204253, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:50:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:50:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 15:50:53.326530 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41759
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41759
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:50:53.445127 29600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:53.445488 29600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:53.445570 29600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:53.449934 29600 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:50:53.450078 29600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:53.450115 29600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:53.450155 29600 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:50:53.450214 29600 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:50:53.456167 29600 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41759
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41759
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29600
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:53.457427 29600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:53.458555 29600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 15:50:53.468012 29600 server_base.cc:1034] running on GCE node
W20260808 15:50:53.467944 29609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:53.467917 29607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:53.467957 29606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:53.468878 29600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:53.470145 29600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:53.471382 29600 hybrid_clock.cc:648] HybridClock initialized: now 1786204253471352 us; error 43 us; skew 500 ppm
Aug 08 15:50:53 dist-test-slave-8tdl krb5kdc[29584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204253, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:50:53.474851 29600 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 15:50:53.475955 29600 webserver.cc:460] Webserver started at http://127.0.0.1:36223/ using document root <none> and password file <none>
I20260808 15:50:53.476570 29600 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:53.476668 29600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:53.476923 29600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:53.479395 29600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "68902ecaace54979948452c474e4548d"
format_stamp: "Formatted at 2026-08-08 15:50:53 on dist-test-slave-8tdl"
server_key: "c59ac10a2dadf7ba95582f1747734e2f"
server_key_iv: "f12046f2e69415e4f169aeb66f5204cb"
server_key_version: "encryptionkey@0"
I20260808 15:50:53.480048 29600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "68902ecaace54979948452c474e4548d"
format_stamp: "Formatted at 2026-08-08 15:50:53 on dist-test-slave-8tdl"
server_key: "c59ac10a2dadf7ba95582f1747734e2f"
server_key_iv: "f12046f2e69415e4f169aeb66f5204cb"
server_key_version: "encryptionkey@0"
I20260808 15:50:53.484249 29600 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 15:50:53.486989 29616 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:53.488346 29600 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 15:50:53.488517 29600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "68902ecaace54979948452c474e4548d"
format_stamp: "Formatted at 2026-08-08 15:50:53 on dist-test-slave-8tdl"
server_key: "c59ac10a2dadf7ba95582f1747734e2f"
server_key_iv: "f12046f2e69415e4f169aeb66f5204cb"
server_key_version: "encryptionkey@0"
I20260808 15:50:53.488656 29600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:53.513345 29600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:53.516870 29600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:53.517112 29600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:53.525326 29600 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41759
I20260808 15:50:53.525362 29670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41759 every 8 connection(s)
I20260808 15:50:53.526350 29600 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:50:53.529531 29671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:53.535177 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 29600
I20260808 15:50:53.535334 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:50:53.535660 8349 external_mini_cluster.cc:1428] Setting key efb0eb200787dd90bf72053d6d596405
I20260808 15:50:53.535795 29671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68902ecaace54979948452c474e4548d: Bootstrap starting.
I20260808 15:50:53.538654 29671 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68902ecaace54979948452c474e4548d: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:53.539507 29671 log.cc:824] T 00000000000000000000000000000000 P 68902ecaace54979948452c474e4548d: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:53.541538 29671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68902ecaace54979948452c474e4548d: No bootstrap required, opened a new log
Aug 08 15:50:53 dist-test-slave-8tdl krb5kdc[29584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204253, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 15:50:53.546824 29671 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68902ecaace54979948452c474e4548d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68902ecaace54979948452c474e4548d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41759 } }
I20260808 15:50:53.547166 29671 raft_consensus.cc:374] T 00000000000000000000000000000000 P 68902ecaace54979948452c474e4548d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:53.547241 29671 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68902ecaace54979948452c474e4548d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68902ecaace54979948452c474e4548d, State: Initialized, Role: FOLLOWER
I20260808 15:50:53.547806 29671 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68902ecaace54979948452c474e4548d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68902ecaace54979948452c474e4548d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41759 } }
I20260808 15:50:53.548026 29671 raft_consensus.cc:388] T 00000000000000000000000000000000 P 68902ecaace54979948452c474e4548d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:50:53.548152 29671 raft_consensus.cc:482] T 00000000000000000000000000000000 P 68902ecaace54979948452c474e4548d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:50:53.548310 29671 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68902ecaace54979948452c474e4548d [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:53.549433 29671 raft_consensus.cc:504] T 00000000000000000000000000000000 P 68902ecaace54979948452c474e4548d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68902ecaace54979948452c474e4548d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41759 } }
I20260808 15:50:53.549847 29671 leader_election.cc:302] T 00000000000000000000000000000000 P 68902ecaace54979948452c474e4548d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68902ecaace54979948452c474e4548d; no voters:
I20260808 15:50:53.550236 29671 leader_election.cc:288] T 00000000000000000000000000000000 P 68902ecaace54979948452c474e4548d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:50:53.550379 29676 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 68902ecaace54979948452c474e4548d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:50:53.550659 29676 raft_consensus.cc:686] T 00000000000000000000000000000000 P 68902ecaace54979948452c474e4548d [term 1 LEADER]: Becoming Leader. State: Replica: 68902ecaace54979948452c474e4548d, State: Running, Role: LEADER
I20260808 15:50:53.551074 29676 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68902ecaace54979948452c474e4548d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68902ecaace54979948452c474e4548d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41759 } }
I20260808 15:50:53.551908 29671 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68902ecaace54979948452c474e4548d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:50:53.552923 29678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68902ecaace54979948452c474e4548d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68902ecaace54979948452c474e4548d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68902ecaace54979948452c474e4548d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41759 } } }
I20260808 15:50:53.553045 29678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68902ecaace54979948452c474e4548d [sys.catalog]: This master's current role is: LEADER
I20260808 15:50:53.553465 29679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68902ecaace54979948452c474e4548d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68902ecaace54979948452c474e4548d. Latest consensus state: current_term: 1 leader_uuid: "68902ecaace54979948452c474e4548d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68902ecaace54979948452c474e4548d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41759 } } }
I20260808 15:50:53.553577 29674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:53.537553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51689 (local address 127.0.0.1:41759)
0808 15:50:53.538049 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:53.538065 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:53.538102 (+ 37us) server_negotiation.cc:407] Connection header received
0808 15:50:53.539019 (+ 917us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:53.539041 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:53.539425 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:53.539782 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:53.540698 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:53.541690 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:53.542589 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:53.543171 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:53.543365 (+ 194us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:53.546657 (+ 3292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:53.546662 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:53.546730 (+ 68us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:53.546776 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:53.549049 (+ 2273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:53.549741 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:53.549746 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:53.549751 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:53.549888 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:53.550352 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:53.550357 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:53.550359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:53.551082 (+ 723us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:53.551420 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:53.552148 (+ 728us) server_negotiation.cc:299] Negotiation successful
0808 15:50:53.552409 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":153,"threads_started":1}
I20260808 15:50:53.553623 29679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68902ecaace54979948452c474e4548d [sys.catalog]: This master's current role is: LEADER
I20260808 15:50:53.554105 29687 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:50:53.557325 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:50:53.557508 29687 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:50:53.564500 29687 catalog_manager.cc:1347] Generated new cluster ID: a17b6512d4604f679a6db0f7de9fb27a
I20260808 15:50:53.564586 29687 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:50:53.570649 29674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:53.559737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54709 (local address 127.0.0.1:41759)
0808 15:50:53.559879 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:53.559884 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:53.562205 (+ 2321us) server_negotiation.cc:407] Connection header received
0808 15:50:53.562329 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:53.562331 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:53.562375 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:53.562449 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:53.563444 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:53.564203 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:53.565220 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:53.565494 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:53.565608 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:53.567198 (+ 1590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:53.567201 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:53.567206 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:53.567236 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:53.568730 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:53.569227 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:53.569233 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:53.569240 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:53.569315 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:53.569665 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:53.569669 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:53.569671 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:53.569859 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:53.570057 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:53.570338 (+ 281us) server_negotiation.cc:299] Negotiation successful
0808 15:50:53.570440 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":52}
I20260808 15:50:53.584751 29687 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:50:53.586225 29687 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:50:53.595096 29687 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 68902ecaace54979948452c474e4548d: Generated new TSK 0
I20260808 15:50:53.595935 29687 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:50:53.606600 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 29600
W20260808 15:50:53.614259 29582 connection.cc:535] client connection to 127.0.0.1:41759 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41759): Connection reset by peer (error 104)
2026-08-08T15:50:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1591 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:50:53 dist-test-slave-8tdl krb5kdc[29705](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:50:53 dist-test-slave-8tdl krb5kdc[29705](info): set up 2 sockets
Aug 08 15:50:53 dist-test-slave-8tdl krb5kdc[29705](info): commencing operation
krb5kdc: starting...
W20260808 15:50:54.714747 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.085s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:50:54 dist-test-slave-8tdl krb5kdc[29705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204254, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:50:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:50:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 15:50:54.858336 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46577
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46577
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:50:54.978168 29718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:54.978502 29718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:54.978547 29718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:54.982769 29718 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:50:54.982842 29718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:54.982863 29718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:54.982879 29718 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:50:54.982895 29718 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:50:54.988490 29718 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46577
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46577
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:54.989616 29718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:54.990638 29718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:54.999888 29723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:54.999888 29724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:54.999888 29726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:55.000128 29718 server_base.cc:1034] running on GCE node
I20260808 15:50:55.000936 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:55.002206 29718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:55.003417 29718 hybrid_clock.cc:648] HybridClock initialized: now 1786204255003402 us; error 42 us; skew 500 ppm
Aug 08 15:50:55 dist-test-slave-8tdl krb5kdc[29705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204255, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:50:55.006647 29718 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 15:50:55.007818 29718 webserver.cc:460] Webserver started at http://127.0.0.1:43539/ using document root <none> and password file <none>
I20260808 15:50:55.008458 29718 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:55.008564 29718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:55.008821 29718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:55.011193 29718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "bdf319c6e6244c279bb4aca158e5c756"
format_stamp: "Formatted at 2026-08-08 15:50:55 on dist-test-slave-8tdl"
server_key: "80242c1586e30daa51c4d6a8ce626bcd"
server_key_iv: "2524cd24fb833396904e7fa12f1bb1b5"
server_key_version: "encryptionkey@0"
I20260808 15:50:55.011826 29718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "bdf319c6e6244c279bb4aca158e5c756"
format_stamp: "Formatted at 2026-08-08 15:50:55 on dist-test-slave-8tdl"
server_key: "80242c1586e30daa51c4d6a8ce626bcd"
server_key_iv: "2524cd24fb833396904e7fa12f1bb1b5"
server_key_version: "encryptionkey@0"
I20260808 15:50:55.016103 29718 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 15:50:55.018760 29733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:55.020123 29718 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:50:55.020289 29718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "bdf319c6e6244c279bb4aca158e5c756"
format_stamp: "Formatted at 2026-08-08 15:50:55 on dist-test-slave-8tdl"
server_key: "80242c1586e30daa51c4d6a8ce626bcd"
server_key_iv: "2524cd24fb833396904e7fa12f1bb1b5"
server_key_version: "encryptionkey@0"
I20260808 15:50:55.020426 29718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:55.034438 29718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:55.038779 29718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:55.039103 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:55.047044 29718 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46577
I20260808 15:50:55.047096 29787 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46577 every 8 connection(s)
I20260808 15:50:55.048136 29718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:50:55.051081 29788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:55.056890 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 29718
I20260808 15:50:55.057029 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:50:55.057246 29788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdf319c6e6244c279bb4aca158e5c756: Bootstrap starting.
I20260808 15:50:55.057356 8349 external_mini_cluster.cc:1428] Setting key aa0e063facc927807beefc82e44841e7
I20260808 15:50:55.060050 29788 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdf319c6e6244c279bb4aca158e5c756: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:55.060925 29788 log.cc:824] T 00000000000000000000000000000000 P bdf319c6e6244c279bb4aca158e5c756: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:55.063377 29788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdf319c6e6244c279bb4aca158e5c756: No bootstrap required, opened a new log
I20260808 15:50:55.067209 29793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:55.058894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38031 (local address 127.0.0.1:46577)
0808 15:50:55.059340 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:55.059357 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:55.059396 (+ 39us) server_negotiation.cc:407] Connection header received
0808 15:50:55.060096 (+ 700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:55.060115 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:55.060535 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:55.060842 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:55.061258 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:55.062253 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:55.063515 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:55.064033 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:55.064190 (+ 157us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:55.065249 (+ 1059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:55.065254 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:55.065269 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:50:55.065707 (+ 438us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:55.065766 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:50:55.065790 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:55.065901 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:55.066130 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 15:50:55.066309 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":153,"threads_started":1}
I20260808 15:50:55.067772 29788 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdf319c6e6244c279bb4aca158e5c756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdf319c6e6244c279bb4aca158e5c756" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46577 } }
I20260808 15:50:55.068032 29788 raft_consensus.cc:374] T 00000000000000000000000000000000 P bdf319c6e6244c279bb4aca158e5c756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:55.068114 29788 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdf319c6e6244c279bb4aca158e5c756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf319c6e6244c279bb4aca158e5c756, State: Initialized, Role: FOLLOWER
I20260808 15:50:55.068610 29788 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdf319c6e6244c279bb4aca158e5c756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdf319c6e6244c279bb4aca158e5c756" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46577 } }
I20260808 15:50:55.068766 29788 raft_consensus.cc:388] T 00000000000000000000000000000000 P bdf319c6e6244c279bb4aca158e5c756 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:50:55.068856 29788 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdf319c6e6244c279bb4aca158e5c756 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:50:55.068958 29788 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdf319c6e6244c279bb4aca158e5c756 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:55.070102 29788 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdf319c6e6244c279bb4aca158e5c756 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdf319c6e6244c279bb4aca158e5c756" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46577 } }
I20260808 15:50:55.070427 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:50:55.070495 29788 leader_election.cc:302] T 00000000000000000000000000000000 P bdf319c6e6244c279bb4aca158e5c756 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bdf319c6e6244c279bb4aca158e5c756; no voters:
I20260808 15:50:55.070883 29788 leader_election.cc:288] T 00000000000000000000000000000000 P bdf319c6e6244c279bb4aca158e5c756 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:50:55.071058 29796 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bdf319c6e6244c279bb4aca158e5c756 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:50:55.071305 29796 raft_consensus.cc:686] T 00000000000000000000000000000000 P bdf319c6e6244c279bb4aca158e5c756 [term 1 LEADER]: Becoming Leader. State: Replica: bdf319c6e6244c279bb4aca158e5c756, State: Running, Role: LEADER
I20260808 15:50:55.071679 29796 consensus_queue.cc:237] T 00000000000000000000000000000000 P bdf319c6e6244c279bb4aca158e5c756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdf319c6e6244c279bb4aca158e5c756" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46577 } }
I20260808 15:50:55.072387 29788 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdf319c6e6244c279bb4aca158e5c756 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:50:55.073462 29798 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdf319c6e6244c279bb4aca158e5c756 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdf319c6e6244c279bb4aca158e5c756. Latest consensus state: current_term: 1 leader_uuid: "bdf319c6e6244c279bb4aca158e5c756" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdf319c6e6244c279bb4aca158e5c756" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46577 } } }
I20260808 15:50:55.073613 29798 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdf319c6e6244c279bb4aca158e5c756 [sys.catalog]: This master's current role is: LEADER
I20260808 15:50:55.074064 29812 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:50:55.074034 29797 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdf319c6e6244c279bb4aca158e5c756 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bdf319c6e6244c279bb4aca158e5c756" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdf319c6e6244c279bb4aca158e5c756" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46577 } } }
I20260808 15:50:55.074128 29797 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdf319c6e6244c279bb4aca158e5c756 [sys.catalog]: This master's current role is: LEADER
I20260808 15:50:55.077548 29812 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:50:55.078855 29793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:55.073371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33167 (local address 127.0.0.1:46577)
0808 15:50:55.074266 (+ 895us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:55.074270 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:55.074285 (+ 15us) server_negotiation.cc:407] Connection header received
0808 15:50:55.074326 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:55.074329 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:55.074372 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:55.074461 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:55.074786 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:55.075548 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:55.076731 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:55.077087 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:55.077196 (+ 109us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:55.078229 (+ 1033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:55.078233 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:55.078236 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:50:55.078251 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:55.078284 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:50:55.078300 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:55.078387 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:55.078639 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 15:50:55.078705 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":818}
I20260808 15:50:55.083910 29812 catalog_manager.cc:1347] Generated new cluster ID: bf11ba2c1a6e4edf8d36cf2b10cc5abc
I20260808 15:50:55.084064 29812 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:50:55.097549 29812 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:50:55.098969 29812 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:50:55.105293 29812 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bdf319c6e6244c279bb4aca158e5c756: Generated new TSK 0
I20260808 15:50:55.106181 29812 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:50:55.118906 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 29718
W20260808 15:50:55.127271 29703 connection.cc:535] client connection to 127.0.0.1:46577 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46577): Connection reset by peer (error 104)
2026-08-08T15:50:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1512 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:50:55 dist-test-slave-8tdl krb5kdc[29825](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:50:55 dist-test-slave-8tdl krb5kdc[29825](info): set up 2 sockets
Aug 08 15:50:55 dist-test-slave-8tdl krb5kdc[29825](info): commencing operation
krb5kdc: starting...
W20260808 15:50:56.218245 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:50:56 dist-test-slave-8tdl krb5kdc[29825](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204256, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:50:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:50:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 15:50:56.356330 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38547
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38547
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:50:56.483072 29839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:56.483412 29839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:56.483461 29839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:56.488382 29839 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:50:56.488484 29839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:56.488507 29839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:56.488526 29839 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:50:56.488544 29839 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:50:56.494663 29839 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38547
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38547
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29839
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:56.495968 29839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:56.497094 29839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:56.506275 29845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:56.506325 29846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:56.506287 29848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:56.506692 29839 server_base.cc:1034] running on GCE node
I20260808 15:50:56.507309 29839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:56.508493 29839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:56.509694 29839 hybrid_clock.cc:648] HybridClock initialized: now 1786204256509680 us; error 29 us; skew 500 ppm
Aug 08 15:50:56 dist-test-slave-8tdl krb5kdc[29825](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204256, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:50:56.516251 29839 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 15:50:56.517225 29839 webserver.cc:460] Webserver started at http://127.0.0.1:39927/ using document root <none> and password file <none>
I20260808 15:50:56.517807 29839 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:56.517899 29839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:56.518147 29839 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:56.520493 29839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "7dcdfcd09df34c00bc841e27cb7c67c9"
format_stamp: "Formatted at 2026-08-08 15:50:56 on dist-test-slave-8tdl"
server_key: "c318c8170b65979acbef864f28e913af"
server_key_iv: "8cdc0a1af3fab6bda552ab984567c65f"
server_key_version: "encryptionkey@0"
I20260808 15:50:56.521096 29839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "7dcdfcd09df34c00bc841e27cb7c67c9"
format_stamp: "Formatted at 2026-08-08 15:50:56 on dist-test-slave-8tdl"
server_key: "c318c8170b65979acbef864f28e913af"
server_key_iv: "8cdc0a1af3fab6bda552ab984567c65f"
server_key_version: "encryptionkey@0"
I20260808 15:50:56.525210 29839 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 15:50:56.527818 29855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:56.529201 29839 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:50:56.529356 29839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "7dcdfcd09df34c00bc841e27cb7c67c9"
format_stamp: "Formatted at 2026-08-08 15:50:56 on dist-test-slave-8tdl"
server_key: "c318c8170b65979acbef864f28e913af"
server_key_iv: "8cdc0a1af3fab6bda552ab984567c65f"
server_key_version: "encryptionkey@0"
I20260808 15:50:56.529488 29839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:56.534245 29839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:56.537459 29839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:56.537674 29839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:56.545073 29839 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38547
I20260808 15:50:56.545104 29910 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38547 every 8 connection(s)
I20260808 15:50:56.546066 29839 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:50:56.549157 29911 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:56.555064 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 29839
I20260808 15:50:56.555233 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:50:56.555368 29911 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dcdfcd09df34c00bc841e27cb7c67c9: Bootstrap starting.
I20260808 15:50:56.555558 8349 external_mini_cluster.cc:1428] Setting key e932e23d214fbdb0e1c5ac6502c33985
I20260808 15:50:56.558391 29911 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7dcdfcd09df34c00bc841e27cb7c67c9: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:56.559237 29911 log.cc:824] T 00000000000000000000000000000000 P 7dcdfcd09df34c00bc841e27cb7c67c9: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:56.561362 29914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:56.557055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33095 (local address 127.0.0.1:38547)
0808 15:50:56.557604 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:56.557662 (+ 58us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:56.557709 (+ 47us) server_negotiation.cc:407] Connection header received
0808 15:50:56.558396 (+ 687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:56.558413 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:56.558827 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:56.559189 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:56.559933 (+ 744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:56.559938 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:56.559949 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:50:56.559957 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:56.560006 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:50:56.560023 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:56.560142 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:56.560248 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 15:50:56.560412 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":165,"threads_started":1}
I20260808 15:50:56.561578 29911 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dcdfcd09df34c00bc841e27cb7c67c9: No bootstrap required, opened a new log
I20260808 15:50:56.564436 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:50:56.565886 29911 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7dcdfcd09df34c00bc841e27cb7c67c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dcdfcd09df34c00bc841e27cb7c67c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38547 } }
I20260808 15:50:56.566133 29911 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7dcdfcd09df34c00bc841e27cb7c67c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:56.566200 29911 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7dcdfcd09df34c00bc841e27cb7c67c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dcdfcd09df34c00bc841e27cb7c67c9, State: Initialized, Role: FOLLOWER
I20260808 15:50:56.566753 29911 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7dcdfcd09df34c00bc841e27cb7c67c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dcdfcd09df34c00bc841e27cb7c67c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38547 } }
I20260808 15:50:56.567031 29911 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7dcdfcd09df34c00bc841e27cb7c67c9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:50:56.567099 29911 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7dcdfcd09df34c00bc841e27cb7c67c9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:50:56.567227 29911 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7dcdfcd09df34c00bc841e27cb7c67c9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:56.568416 29911 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7dcdfcd09df34c00bc841e27cb7c67c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dcdfcd09df34c00bc841e27cb7c67c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38547 } }
I20260808 15:50:56.568913 29914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:56.566767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39723 (local address 127.0.0.1:38547)
0808 15:50:56.566917 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:56.566923 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:56.567137 (+ 214us) server_negotiation.cc:407] Connection header received
0808 15:50:56.567267 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:56.567269 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:56.567321 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:56.567421 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:56.568318 (+ 897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:56.568325 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:56.568330 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:50:56.568416 (+ 86us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:56.568455 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:50:56.568486 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:56.568625 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:56.568740 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 15:50:56.568783 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 15:50:56.568872 29911 leader_election.cc:302] T 00000000000000000000000000000000 P 7dcdfcd09df34c00bc841e27cb7c67c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7dcdfcd09df34c00bc841e27cb7c67c9; no voters:
I20260808 15:50:56.569267 29911 leader_election.cc:288] T 00000000000000000000000000000000 P 7dcdfcd09df34c00bc841e27cb7c67c9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:50:56.569381 29921 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7dcdfcd09df34c00bc841e27cb7c67c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:50:56.569617 29921 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7dcdfcd09df34c00bc841e27cb7c67c9 [term 1 LEADER]: Becoming Leader. State: Replica: 7dcdfcd09df34c00bc841e27cb7c67c9, State: Running, Role: LEADER
I20260808 15:50:56.570020 29921 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7dcdfcd09df34c00bc841e27cb7c67c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dcdfcd09df34c00bc841e27cb7c67c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38547 } }
I20260808 15:50:56.570724 29911 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7dcdfcd09df34c00bc841e27cb7c67c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:50:56.571827 29923 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dcdfcd09df34c00bc841e27cb7c67c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7dcdfcd09df34c00bc841e27cb7c67c9. Latest consensus state: current_term: 1 leader_uuid: "7dcdfcd09df34c00bc841e27cb7c67c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dcdfcd09df34c00bc841e27cb7c67c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38547 } } }
I20260808 15:50:56.571969 29923 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dcdfcd09df34c00bc841e27cb7c67c9 [sys.catalog]: This master's current role is: LEADER
I20260808 15:50:56.572319 29922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dcdfcd09df34c00bc841e27cb7c67c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7dcdfcd09df34c00bc841e27cb7c67c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dcdfcd09df34c00bc841e27cb7c67c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38547 } } }
I20260808 15:50:56.572388 29931 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:50:56.572472 29922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dcdfcd09df34c00bc841e27cb7c67c9 [sys.catalog]: This master's current role is: LEADER
I20260808 15:50:56.575822 29931 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:50:56.582044 29931 catalog_manager.cc:1347] Generated new cluster ID: 08f9a04167084d92a9de4aa774bdb61e
I20260808 15:50:56.582132 29931 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:50:56.598337 29931 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:50:56.598747 29931 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:50:56.611002 29931 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7dcdfcd09df34c00bc841e27cb7c67c9: Generated new TSK 0
I20260808 15:50:56.611757 29931 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:50:56.615003 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 29839
2026-08-08T15:50:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1493 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:50:56 dist-test-slave-8tdl krb5kdc[29944](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:50:56 dist-test-slave-8tdl krb5kdc[29944](info): set up 2 sockets
Aug 08 15:50:56 dist-test-slave-8tdl krb5kdc[29944](info): commencing operation
krb5kdc: starting...
W20260808 15:50:57.688064 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.052s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:50:57 dist-test-slave-8tdl krb5kdc[29944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204257, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:50:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:50:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 15:50:57.830017 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42471
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42471
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:50:57.947232 29957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:57.947588 29957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:57.947678 29957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:57.951844 29957 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:50:57.951967 29957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:57.952009 29957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:57.952068 29957 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:50:57.952109 29957 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:50:57.957923 29957 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42471
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42471
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29957
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:57.959193 29957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:57.960386 29957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:57.969517 29967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:57.969519 29963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:57.969524 29965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:57.969789 29957 server_base.cc:1034] running on GCE node
I20260808 15:50:57.970714 29957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:57.971973 29957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:57.973157 29957 hybrid_clock.cc:648] HybridClock initialized: now 1786204257973109 us; error 66 us; skew 500 ppm
Aug 08 15:50:57 dist-test-slave-8tdl krb5kdc[29944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204257, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:50:57.976327 29957 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 15:50:57.977309 29957 webserver.cc:460] Webserver started at http://127.0.0.1:32987/ using document root <none> and password file <none>
I20260808 15:50:57.977908 29957 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:57.977977 29957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:57.978250 29957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:57.980544 29957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "3c47961d4c6b4509992019cdd8c2c163"
format_stamp: "Formatted at 2026-08-08 15:50:57 on dist-test-slave-8tdl"
server_key: "5d688f6000154747a5e101e9b5f87067"
server_key_iv: "f25bd9244086167899381f00298f59dc"
server_key_version: "encryptionkey@0"
I20260808 15:50:57.981161 29957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "3c47961d4c6b4509992019cdd8c2c163"
format_stamp: "Formatted at 2026-08-08 15:50:57 on dist-test-slave-8tdl"
server_key: "5d688f6000154747a5e101e9b5f87067"
server_key_iv: "f25bd9244086167899381f00298f59dc"
server_key_version: "encryptionkey@0"
I20260808 15:50:57.985282 29957 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 15:50:57.987952 29974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:57.989233 29957 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:50:57.989387 29957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "3c47961d4c6b4509992019cdd8c2c163"
format_stamp: "Formatted at 2026-08-08 15:50:57 on dist-test-slave-8tdl"
server_key: "5d688f6000154747a5e101e9b5f87067"
server_key_iv: "f25bd9244086167899381f00298f59dc"
server_key_version: "encryptionkey@0"
I20260808 15:50:57.989538 29957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:58.006631 29957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:58.010016 29957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:58.010259 29957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:58.017915 29957 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42471
I20260808 15:50:58.017983 30028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42471 every 8 connection(s)
I20260808 15:50:58.018980 29957 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:50:58.022519 30029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:58.028355 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 29957
I20260808 15:50:58.028563 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:50:58.028864 8349 external_mini_cluster.cc:1428] Setting key 7742a54a2a3f6d6d8fcb2bc39fd25a4d
I20260808 15:50:58.029090 30029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c47961d4c6b4509992019cdd8c2c163: Bootstrap starting.
I20260808 15:50:58.032053 30029 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c47961d4c6b4509992019cdd8c2c163: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:58.033182 30029 log.cc:824] T 00000000000000000000000000000000 P 3c47961d4c6b4509992019cdd8c2c163: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:58.035794 30029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c47961d4c6b4509992019cdd8c2c163: No bootstrap required, opened a new log
Aug 08 15:50:58 dist-test-slave-8tdl krb5kdc[29944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204257, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 15:50:58.041066 30029 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c47961d4c6b4509992019cdd8c2c163 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c47961d4c6b4509992019cdd8c2c163" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42471 } }
I20260808 15:50:58.041363 30029 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c47961d4c6b4509992019cdd8c2c163 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:58.041460 30029 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c47961d4c6b4509992019cdd8c2c163 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c47961d4c6b4509992019cdd8c2c163, State: Initialized, Role: FOLLOWER
I20260808 15:50:58.042016 30029 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c47961d4c6b4509992019cdd8c2c163 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c47961d4c6b4509992019cdd8c2c163" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42471 } }
I20260808 15:50:58.042188 30029 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c47961d4c6b4509992019cdd8c2c163 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:50:58.042289 30029 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c47961d4c6b4509992019cdd8c2c163 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:50:58.042415 30029 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c47961d4c6b4509992019cdd8c2c163 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:58.043766 30029 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c47961d4c6b4509992019cdd8c2c163 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c47961d4c6b4509992019cdd8c2c163" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42471 } }
I20260808 15:50:58.044221 30029 leader_election.cc:302] T 00000000000000000000000000000000 P 3c47961d4c6b4509992019cdd8c2c163 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c47961d4c6b4509992019cdd8c2c163; no voters:
I20260808 15:50:58.044622 30029 leader_election.cc:288] T 00000000000000000000000000000000 P 3c47961d4c6b4509992019cdd8c2c163 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:50:58.044734 30034 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c47961d4c6b4509992019cdd8c2c163 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:50:58.044988 30034 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c47961d4c6b4509992019cdd8c2c163 [term 1 LEADER]: Becoming Leader. State: Replica: 3c47961d4c6b4509992019cdd8c2c163, State: Running, Role: LEADER
I20260808 15:50:58.045128 30032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:58.030259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59559 (local address 127.0.0.1:42471)
0808 15:50:58.030750 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:58.030767 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:58.030805 (+ 38us) server_negotiation.cc:407] Connection header received
0808 15:50:58.031499 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:58.031517 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:58.031877 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:58.032233 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:58.033325 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:58.034405 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:58.035689 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:58.036334 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:58.036465 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:58.039602 (+ 3137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:58.039607 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:58.039622 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:58.039653 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:58.041582 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:58.042069 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:58.042076 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:58.042082 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:58.042253 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:58.042604 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:58.042607 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:58.042608 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:58.043119 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:58.043272 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:58.043655 (+ 383us) server_negotiation.cc:299] Negotiation successful
0808 15:50:58.043980 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":165,"threads_started":1}
I20260808 15:50:58.045406 30034 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c47961d4c6b4509992019cdd8c2c163 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c47961d4c6b4509992019cdd8c2c163" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42471 } }
I20260808 15:50:58.046070 30029 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c47961d4c6b4509992019cdd8c2c163 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:50:58.048192 30035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c47961d4c6b4509992019cdd8c2c163 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c47961d4c6b4509992019cdd8c2c163" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c47961d4c6b4509992019cdd8c2c163" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42471 } } }
I20260808 15:50:58.048246 30036 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c47961d4c6b4509992019cdd8c2c163 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c47961d4c6b4509992019cdd8c2c163. Latest consensus state: current_term: 1 leader_uuid: "3c47961d4c6b4509992019cdd8c2c163" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c47961d4c6b4509992019cdd8c2c163" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42471 } } }
I20260808 15:50:58.048354 30036 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c47961d4c6b4509992019cdd8c2c163 [sys.catalog]: This master's current role is: LEADER
I20260808 15:50:58.048355 30035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c47961d4c6b4509992019cdd8c2c163 [sys.catalog]: This master's current role is: LEADER
I20260808 15:50:58.048691 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:50:58.048771 30048 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:50:58.052425 30048 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:50:58.058996 30048 catalog_manager.cc:1347] Generated new cluster ID: 1a3f5771a733437f987457f3f048029d
I20260808 15:50:58.059078 30048 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:50:58.066035 30032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:58.051404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50513 (local address 127.0.0.1:42471)
0808 15:50:58.051561 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:58.051568 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:58.051720 (+ 152us) server_negotiation.cc:407] Connection header received
0808 15:50:58.051882 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:58.051886 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:58.051937 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:58.052034 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:58.053002 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:58.053749 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:58.055148 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:58.055493 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:58.055604 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:58.057527 (+ 1923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:58.057531 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:58.057533 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:50:58.057561 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:58.064116 (+ 6555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:58.064732 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:58.064735 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:58.064737 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:58.064830 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:50:58.065137 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:50:58.065140 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:50:58.065142 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:50:58.065347 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:58.065469 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:58.065736 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 15:50:58.065862 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 15:50:58.072985 30048 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:50:58.074246 30048 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:50:58.082161 30048 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c47961d4c6b4509992019cdd8c2c163: Generated new TSK 0
I20260808 15:50:58.083123 30048 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:50:58.087970 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 29957
2026-08-08T15:50:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1474 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:50:58 dist-test-slave-8tdl krb5kdc[30060](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:50:58 dist-test-slave-8tdl krb5kdc[30060](info): set up 2 sockets
Aug 08 15:50:58 dist-test-slave-8tdl krb5kdc[30060](info): commencing operation
krb5kdc: starting...
W20260808 15:50:59.173136 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.062s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:50:59 dist-test-slave-8tdl krb5kdc[30060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204259, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:50:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:50:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 15:50:59.314551 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37475
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37475
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:50:59.432672 30073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:50:59.432973 30073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:50:59.433060 30073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:50:59.437216 30073 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:50:59.437281 30073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:50:59.437300 30073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:50:59.437346 30073 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:50:59.437383 30073 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:50:59.442744 30073 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37475
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30073
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:50:59.443902 30073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:50:59.444998 30073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:50:59.454262 30081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:59.454299 30080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:50:59.454336 30083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:50:59.454564 30073 server_base.cc:1034] running on GCE node
I20260808 15:50:59.455418 30073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:50:59.456723 30073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:50:59.457898 30073 hybrid_clock.cc:648] HybridClock initialized: now 1786204259457853 us; error 61 us; skew 500 ppm
Aug 08 15:50:59 dist-test-slave-8tdl krb5kdc[30060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204259, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:50:59.460850 30073 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 15:50:59.461753 30073 webserver.cc:460] Webserver started at http://127.0.0.1:42239/ using document root <none> and password file <none>
I20260808 15:50:59.462292 30073 fs_manager.cc:359] Metadata directory not provided
I20260808 15:50:59.462356 30073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:50:59.462527 30073 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:50:59.464733 30073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "b0282929e585457ca2aa8a291a86f309"
format_stamp: "Formatted at 2026-08-08 15:50:59 on dist-test-slave-8tdl"
server_key: "6de26a82fe416a612a84e641723ba492"
server_key_iv: "6e5d80b74b51f6c670279eed9b35a73d"
server_key_version: "encryptionkey@0"
I20260808 15:50:59.465270 30073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "b0282929e585457ca2aa8a291a86f309"
format_stamp: "Formatted at 2026-08-08 15:50:59 on dist-test-slave-8tdl"
server_key: "6de26a82fe416a612a84e641723ba492"
server_key_iv: "6e5d80b74b51f6c670279eed9b35a73d"
server_key_version: "encryptionkey@0"
I20260808 15:50:59.469215 30073 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 15:50:59.471803 30090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:50:59.473250 30073 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:50:59.473405 30073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "b0282929e585457ca2aa8a291a86f309"
format_stamp: "Formatted at 2026-08-08 15:50:59 on dist-test-slave-8tdl"
server_key: "6de26a82fe416a612a84e641723ba492"
server_key_iv: "6e5d80b74b51f6c670279eed9b35a73d"
server_key_version: "encryptionkey@0"
I20260808 15:50:59.473532 30073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:50:59.491858 30073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:50:59.495293 30073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:50:59.495523 30073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:50:59.503072 30073 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37475
I20260808 15:50:59.503104 30148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37475 every 8 connection(s)
I20260808 15:50:59.504076 30073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:50:59.507262 30149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:50:59.513149 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 30073
I20260808 15:50:59.513329 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:50:59.513489 30149 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0282929e585457ca2aa8a291a86f309: Bootstrap starting.
I20260808 15:50:59.513652 8349 external_mini_cluster.cc:1428] Setting key 47c840a8d46b404b00aecc6b58118eb8
I20260808 15:50:59.516479 30149 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b0282929e585457ca2aa8a291a86f309: Neither blocks nor log segments found. Creating new log.
I20260808 15:50:59.517323 30149 log.cc:824] T 00000000000000000000000000000000 P b0282929e585457ca2aa8a291a86f309: Log is configured to *not* fsync() on all Append() calls
I20260808 15:50:59.519536 30149 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0282929e585457ca2aa8a291a86f309: No bootstrap required, opened a new log
I20260808 15:50:59.523154 30152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:59.515161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56529 (local address 127.0.0.1:37475)
0808 15:50:59.515664 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:59.515679 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:59.515715 (+ 36us) server_negotiation.cc:407] Connection header received
0808 15:50:59.516402 (+ 687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:59.516419 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:59.516812 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:59.517155 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:59.517629 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:59.518576 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:59.519552 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:59.520107 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:59.520289 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:59.521347 (+ 1058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:59.521362 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:59.521375 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:50:59.521768 (+ 393us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:59.521822 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:50:59.521846 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:59.521964 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:59.522115 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 15:50:59.522336 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":163,"threads_started":1}
I20260808 15:50:59.523986 30149 raft_consensus.cc:348] T 00000000000000000000000000000000 P b0282929e585457ca2aa8a291a86f309 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0282929e585457ca2aa8a291a86f309" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37475 } }
I20260808 15:50:59.524273 30149 raft_consensus.cc:374] T 00000000000000000000000000000000 P b0282929e585457ca2aa8a291a86f309 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:50:59.524358 30149 raft_consensus.cc:729] T 00000000000000000000000000000000 P b0282929e585457ca2aa8a291a86f309 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0282929e585457ca2aa8a291a86f309, State: Initialized, Role: FOLLOWER
I20260808 15:50:59.524875 30149 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0282929e585457ca2aa8a291a86f309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0282929e585457ca2aa8a291a86f309" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37475 } }
I20260808 15:50:59.525091 30149 raft_consensus.cc:388] T 00000000000000000000000000000000 P b0282929e585457ca2aa8a291a86f309 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:50:59.525172 30149 raft_consensus.cc:482] T 00000000000000000000000000000000 P b0282929e585457ca2aa8a291a86f309 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:50:59.525282 30149 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0282929e585457ca2aa8a291a86f309 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:50:59.526150 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:50:59.526660 30149 raft_consensus.cc:504] T 00000000000000000000000000000000 P b0282929e585457ca2aa8a291a86f309 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0282929e585457ca2aa8a291a86f309" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37475 } }
I20260808 15:50:59.527122 30149 leader_election.cc:302] T 00000000000000000000000000000000 P b0282929e585457ca2aa8a291a86f309 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0282929e585457ca2aa8a291a86f309; no voters:
I20260808 15:50:59.527547 30149 leader_election.cc:288] T 00000000000000000000000000000000 P b0282929e585457ca2aa8a291a86f309 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:50:59.527670 30155 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b0282929e585457ca2aa8a291a86f309 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:50:59.527978 30155 raft_consensus.cc:686] T 00000000000000000000000000000000 P b0282929e585457ca2aa8a291a86f309 [term 1 LEADER]: Becoming Leader. State: Replica: b0282929e585457ca2aa8a291a86f309, State: Running, Role: LEADER
I20260808 15:50:59.528318 30155 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0282929e585457ca2aa8a291a86f309 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0282929e585457ca2aa8a291a86f309" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37475 } }
I20260808 15:50:59.529114 30149 sys_catalog.cc:564] T 00000000000000000000000000000000 P b0282929e585457ca2aa8a291a86f309 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:50:59.529542 30158 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0282929e585457ca2aa8a291a86f309 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b0282929e585457ca2aa8a291a86f309" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0282929e585457ca2aa8a291a86f309" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37475 } } }
I20260808 15:50:59.529542 30155 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0282929e585457ca2aa8a291a86f309 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0282929e585457ca2aa8a291a86f309. Latest consensus state: current_term: 1 leader_uuid: "b0282929e585457ca2aa8a291a86f309" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0282929e585457ca2aa8a291a86f309" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37475 } } }
I20260808 15:50:59.529709 30158 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0282929e585457ca2aa8a291a86f309 [sys.catalog]: This master's current role is: LEADER
I20260808 15:50:59.529709 30155 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0282929e585457ca2aa8a291a86f309 [sys.catalog]: This master's current role is: LEADER
I20260808 15:50:59.534178 30152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:50:59.528790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33753 (local address 127.0.0.1:37475)
0808 15:50:59.528898 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 15:50:59.528902 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:50:59.529531 (+ 629us) server_negotiation.cc:407] Connection header received
0808 15:50:59.529745 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:50:59.529749 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:50:59.529800 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:50:59.529856 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:50:59.530428 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:59.531243 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:59.532364 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:50:59.532730 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:50:59.532854 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:50:59.533733 (+ 879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:50:59.533737 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:50:59.533740 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:50:59.533753 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:50:59.533786 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:50:59.533798 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:50:59.533880 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 15:50:59.533971 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 15:50:59.534024 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
W20260808 15:50:59.534919 30177 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b0282929e585457ca2aa8a291a86f309: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:50:59.535050 30177 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:50:59.535132 30165 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:50:59.536098 30165 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:50:59.542017 30165 catalog_manager.cc:1347] Generated new cluster ID: a3d40dab22d64c228d598cd405bd239e
I20260808 15:50:59.542102 30165 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:50:59.560721 30165 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:50:59.561715 30165 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:50:59.572701 30165 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b0282929e585457ca2aa8a291a86f309: Generated new TSK 0
I20260808 15:50:59.573462 30165 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:50:59.584215 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 30073
2026-08-08T15:50:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1495 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:50:59 dist-test-slave-8tdl krb5kdc[30182](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:50:59 dist-test-slave-8tdl krb5kdc[30182](info): set up 2 sockets
Aug 08 15:50:59 dist-test-slave-8tdl krb5kdc[30182](info): commencing operation
krb5kdc: starting...
W20260808 15:51:00.681495 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.075s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:51:00 dist-test-slave-8tdl krb5kdc[30182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204260, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:51:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:51:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 15:51:00.826206 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36153
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36153
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:51:00.944048 30195 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:51:00.944363 30195 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:51:00.944411 30195 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:51:00.948575 30195 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:51:00.948649 30195 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:51:00.948669 30195 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:51:00.948686 30195 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:51:00.948702 30195 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:51:00.954376 30195 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36153
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36153
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30195
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:51:00.955621 30195 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:51:00.956655 30195 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 15:51:00.965830 30195 server_base.cc:1034] running on GCE node
W20260808 15:51:00.965837 30202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:00.965823 30204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:00.965826 30201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:00.966979 30195 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:51:00.968235 30195 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:51:00.969480 30195 hybrid_clock.cc:648] HybridClock initialized: now 1786204260969442 us; error 54 us; skew 500 ppm
Aug 08 15:51:00 dist-test-slave-8tdl krb5kdc[30182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204260, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:51:00.972872 30195 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 15:51:00.973994 30195 webserver.cc:460] Webserver started at http://127.0.0.1:35111/ using document root <none> and password file <none>
I20260808 15:51:00.974656 30195 fs_manager.cc:359] Metadata directory not provided
I20260808 15:51:00.974795 30195 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:51:00.975068 30195 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:51:00.977476 30195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "abd689da56dd4e69baaefa7a35deb0c3"
format_stamp: "Formatted at 2026-08-08 15:51:00 on dist-test-slave-8tdl"
server_key: "0572711610c5e056ce88e912cf0827f0"
server_key_iv: "4d69e30d2a737d08f4e1c019f2887722"
server_key_version: "encryptionkey@0"
I20260808 15:51:00.978134 30195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "abd689da56dd4e69baaefa7a35deb0c3"
format_stamp: "Formatted at 2026-08-08 15:51:00 on dist-test-slave-8tdl"
server_key: "0572711610c5e056ce88e912cf0827f0"
server_key_iv: "4d69e30d2a737d08f4e1c019f2887722"
server_key_version: "encryptionkey@0"
I20260808 15:51:00.982501 30195 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260808 15:51:00.985316 30212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:51:00.986819 30195 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:51:00.986961 30195 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "abd689da56dd4e69baaefa7a35deb0c3"
format_stamp: "Formatted at 2026-08-08 15:51:00 on dist-test-slave-8tdl"
server_key: "0572711610c5e056ce88e912cf0827f0"
server_key_iv: "4d69e30d2a737d08f4e1c019f2887722"
server_key_version: "encryptionkey@0"
I20260808 15:51:00.987087 30195 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:51:00.992214 30195 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:51:00.995750 30195 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:51:00.995996 30195 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:51:01.003527 30195 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36153
I20260808 15:51:01.003691 30266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36153 every 8 connection(s)
I20260808 15:51:01.004631 30195 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:51:01.007892 30267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:51:01.013935 30267 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abd689da56dd4e69baaefa7a35deb0c3: Bootstrap starting.
I20260808 15:51:01.014534 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 30195
I20260808 15:51:01.014747 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:51:01.015086 8349 external_mini_cluster.cc:1428] Setting key 2f585b3c3aefca7ce4a2c338e5220dda
I20260808 15:51:01.017068 30267 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P abd689da56dd4e69baaefa7a35deb0c3: Neither blocks nor log segments found. Creating new log.
I20260808 15:51:01.017858 30267 log.cc:824] T 00000000000000000000000000000000 P abd689da56dd4e69baaefa7a35deb0c3: Log is configured to *not* fsync() on all Append() calls
I20260808 15:51:01.020355 30267 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abd689da56dd4e69baaefa7a35deb0c3: No bootstrap required, opened a new log
I20260808 15:51:01.021368 30270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:01.016495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57973 (local address 127.0.0.1:36153)
0808 15:51:01.016998 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:01.017014 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:01.017051 (+ 37us) server_negotiation.cc:407] Connection header received
0808 15:51:01.018181 (+ 1130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:01.018202 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:01.018513 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:01.018909 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:01.019845 (+ 936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:01.019850 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:01.019863 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:51:01.019876 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:01.020003 (+ 127us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:51:01.020026 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:01.020131 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:01.020294 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 15:51:01.020492 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":167,"threads_started":1}
I20260808 15:51:01.024636 30267 raft_consensus.cc:348] T 00000000000000000000000000000000 P abd689da56dd4e69baaefa7a35deb0c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abd689da56dd4e69baaefa7a35deb0c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36153 } }
I20260808 15:51:01.024910 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:51:01.024909 30267 raft_consensus.cc:374] T 00000000000000000000000000000000 P abd689da56dd4e69baaefa7a35deb0c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:51:01.024974 30267 raft_consensus.cc:729] T 00000000000000000000000000000000 P abd689da56dd4e69baaefa7a35deb0c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd689da56dd4e69baaefa7a35deb0c3, State: Initialized, Role: FOLLOWER
I20260808 15:51:01.025455 30267 consensus_queue.cc:260] T 00000000000000000000000000000000 P abd689da56dd4e69baaefa7a35deb0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abd689da56dd4e69baaefa7a35deb0c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36153 } }
I20260808 15:51:01.025630 30267 raft_consensus.cc:388] T 00000000000000000000000000000000 P abd689da56dd4e69baaefa7a35deb0c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:51:01.025691 30267 raft_consensus.cc:482] T 00000000000000000000000000000000 P abd689da56dd4e69baaefa7a35deb0c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:51:01.025797 30267 raft_consensus.cc:3037] T 00000000000000000000000000000000 P abd689da56dd4e69baaefa7a35deb0c3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:51:01.027248 30267 raft_consensus.cc:504] T 00000000000000000000000000000000 P abd689da56dd4e69baaefa7a35deb0c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abd689da56dd4e69baaefa7a35deb0c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36153 } }
I20260808 15:51:01.027695 30267 leader_election.cc:302] T 00000000000000000000000000000000 P abd689da56dd4e69baaefa7a35deb0c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: abd689da56dd4e69baaefa7a35deb0c3; no voters:
I20260808 15:51:01.028097 30267 leader_election.cc:288] T 00000000000000000000000000000000 P abd689da56dd4e69baaefa7a35deb0c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:51:01.028189 30279 raft_consensus.cc:2781] T 00000000000000000000000000000000 P abd689da56dd4e69baaefa7a35deb0c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:51:01.028383 30279 raft_consensus.cc:686] T 00000000000000000000000000000000 P abd689da56dd4e69baaefa7a35deb0c3 [term 1 LEADER]: Becoming Leader. State: Replica: abd689da56dd4e69baaefa7a35deb0c3, State: Running, Role: LEADER
I20260808 15:51:01.028710 30279 consensus_queue.cc:237] T 00000000000000000000000000000000 P abd689da56dd4e69baaefa7a35deb0c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abd689da56dd4e69baaefa7a35deb0c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36153 } }
I20260808 15:51:01.029507 30267 sys_catalog.cc:564] T 00000000000000000000000000000000 P abd689da56dd4e69baaefa7a35deb0c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:51:01.029786 30270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:01.027477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43229 (local address 127.0.0.1:36153)
0808 15:51:01.027625 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:01.027630 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:01.027970 (+ 340us) server_negotiation.cc:407] Connection header received
0808 15:51:01.028014 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:01.028016 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:01.028076 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:01.028178 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:01.029229 (+ 1051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:01.029233 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:01.029235 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:51:01.029248 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:01.029285 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:51:01.029324 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:01.029412 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:01.029621 (+ 209us) server_negotiation.cc:299] Negotiation successful
0808 15:51:01.029672 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 15:51:01.029983 30279 sys_catalog.cc:455] T 00000000000000000000000000000000 P abd689da56dd4e69baaefa7a35deb0c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader abd689da56dd4e69baaefa7a35deb0c3. Latest consensus state: current_term: 1 leader_uuid: "abd689da56dd4e69baaefa7a35deb0c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abd689da56dd4e69baaefa7a35deb0c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36153 } } }
I20260808 15:51:01.030105 30279 sys_catalog.cc:458] T 00000000000000000000000000000000 P abd689da56dd4e69baaefa7a35deb0c3 [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:01.030529 30280 sys_catalog.cc:455] T 00000000000000000000000000000000 P abd689da56dd4e69baaefa7a35deb0c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "abd689da56dd4e69baaefa7a35deb0c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abd689da56dd4e69baaefa7a35deb0c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36153 } } }
I20260808 15:51:01.030637 30280 sys_catalog.cc:458] T 00000000000000000000000000000000 P abd689da56dd4e69baaefa7a35deb0c3 [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:01.031044 30284 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:51:01.035226 30284 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:51:01.041278 30284 catalog_manager.cc:1347] Generated new cluster ID: 5b07cc11d6514ee3a2b6c0ca651665c4
I20260808 15:51:01.041782 30284 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:51:01.054638 30284 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:51:01.055086 30284 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:51:01.062942 30284 catalog_manager.cc:5868] T 00000000000000000000000000000000 P abd689da56dd4e69baaefa7a35deb0c3: Generated new TSK 0
I20260808 15:51:01.063961 30284 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:51:01.078840 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 30195
2026-08-08T15:51:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1495 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:51:01 dist-test-slave-8tdl krb5kdc[30303](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:51:01 dist-test-slave-8tdl krb5kdc[30303](info): set up 2 sockets
Aug 08 15:51:01 dist-test-slave-8tdl krb5kdc[30303](info): commencing operation
krb5kdc: starting...
W20260808 15:51:02.164763 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.061s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:51:02 dist-test-slave-8tdl krb5kdc[30303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:51:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:51:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 15:51:02.305681 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41983
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41983
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:51:02.431475 30316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:51:02.431849 30316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:51:02.431941 30316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:51:02.436529 30316 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:51:02.436646 30316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:51:02.436688 30316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:51:02.436729 30316 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:51:02.436765 30316 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:51:02.442466 30316 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41983
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41983
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:51:02.443770 30316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:51:02.444909 30316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:51:02.454346 30323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:02.454342 30321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:02.454514 30316 server_base.cc:1034] running on GCE node
W20260808 15:51:02.454381 30325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:02.455350 30316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:51:02.456707 30316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:51:02.457897 30316 hybrid_clock.cc:648] HybridClock initialized: now 1786204262457848 us; error 74 us; skew 500 ppm
Aug 08 15:51:02 dist-test-slave-8tdl krb5kdc[30303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204262, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:51:02.461115 30316 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 15:51:02.462162 30316 webserver.cc:460] Webserver started at http://127.0.0.1:43377/ using document root <none> and password file <none>
I20260808 15:51:02.462805 30316 fs_manager.cc:359] Metadata directory not provided
I20260808 15:51:02.462884 30316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:51:02.463069 30316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:51:02.465339 30316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "d0beb31aca504cc683b9985405e7a132"
format_stamp: "Formatted at 2026-08-08 15:51:02 on dist-test-slave-8tdl"
server_key: "8a68df791e261c3a5b5752c0ed34892d"
server_key_iv: "e98c1beacf353706bcf583498b680864"
server_key_version: "encryptionkey@0"
I20260808 15:51:02.465929 30316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "d0beb31aca504cc683b9985405e7a132"
format_stamp: "Formatted at 2026-08-08 15:51:02 on dist-test-slave-8tdl"
server_key: "8a68df791e261c3a5b5752c0ed34892d"
server_key_iv: "e98c1beacf353706bcf583498b680864"
server_key_version: "encryptionkey@0"
I20260808 15:51:02.470263 30316 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 15:51:02.473351 30332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:51:02.474936 30316 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:51:02.475107 30316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "d0beb31aca504cc683b9985405e7a132"
format_stamp: "Formatted at 2026-08-08 15:51:02 on dist-test-slave-8tdl"
server_key: "8a68df791e261c3a5b5752c0ed34892d"
server_key_iv: "e98c1beacf353706bcf583498b680864"
server_key_version: "encryptionkey@0"
I20260808 15:51:02.475260 30316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:51:02.496773 30316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:51:02.500512 30316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:51:02.500770 30316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:51:02.509328 30316 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41983
I20260808 15:51:02.509344 30390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41983 every 8 connection(s)
I20260808 15:51:02.510437 30316 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:51:02.513521 30391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:51:02.514714 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 30316
I20260808 15:51:02.514909 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:51:02.515305 8349 external_mini_cluster.cc:1428] Setting key a042f553340c3610717d78eac71ea307
I20260808 15:51:02.520406 30391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0beb31aca504cc683b9985405e7a132: Bootstrap starting.
I20260808 15:51:02.523095 30391 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d0beb31aca504cc683b9985405e7a132: Neither blocks nor log segments found. Creating new log.
I20260808 15:51:02.524212 30391 log.cc:824] T 00000000000000000000000000000000 P d0beb31aca504cc683b9985405e7a132: Log is configured to *not* fsync() on all Append() calls
Aug 08 15:51:02 dist-test-slave-8tdl krb5kdc[30303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 15:51:02.526844 30391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0beb31aca504cc683b9985405e7a132: No bootstrap required, opened a new log
I20260808 15:51:02.531005 30391 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0beb31aca504cc683b9985405e7a132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0beb31aca504cc683b9985405e7a132" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41983 } }
I20260808 15:51:02.531359 30391 raft_consensus.cc:374] T 00000000000000000000000000000000 P d0beb31aca504cc683b9985405e7a132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:51:02.531441 30391 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0beb31aca504cc683b9985405e7a132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0beb31aca504cc683b9985405e7a132, State: Initialized, Role: FOLLOWER
I20260808 15:51:02.531951 30391 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0beb31aca504cc683b9985405e7a132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0beb31aca504cc683b9985405e7a132" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41983 } }
I20260808 15:51:02.532092 30391 raft_consensus.cc:388] T 00000000000000000000000000000000 P d0beb31aca504cc683b9985405e7a132 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:51:02.532196 30391 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0beb31aca504cc683b9985405e7a132 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:51:02.532338 30391 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0beb31aca504cc683b9985405e7a132 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:51:02.532549 30394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:02.517031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.51:33759 (local address 127.0.0.1:41983)
0808 15:51:02.517520 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:02.517538 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:02.517578 (+ 40us) server_negotiation.cc:407] Connection header received
0808 15:51:02.518320 (+ 742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:02.518339 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:02.518787 (+ 448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:02.519163 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:02.520074 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:02.521217 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:02.522223 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:02.522832 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:02.523035 (+ 203us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:02.526449 (+ 3414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:02.526455 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:02.526473 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:02.526505 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:02.528685 (+ 2180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:02.529365 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:02.529371 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:02.529377 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:02.529513 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:02.529917 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:02.529921 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:02.529923 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:02.530420 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:02.530688 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:02.531102 (+ 414us) server_negotiation.cc:299] Negotiation successful
0808 15:51:02.531397 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":146,"threads_started":1}
I20260808 15:51:02.533588 30391 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0beb31aca504cc683b9985405e7a132 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0beb31aca504cc683b9985405e7a132" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41983 } }
I20260808 15:51:02.533985 30391 leader_election.cc:302] T 00000000000000000000000000000000 P d0beb31aca504cc683b9985405e7a132 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d0beb31aca504cc683b9985405e7a132; no voters:
I20260808 15:51:02.534376 30391 leader_election.cc:288] T 00000000000000000000000000000000 P d0beb31aca504cc683b9985405e7a132 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:51:02.534530 30396 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d0beb31aca504cc683b9985405e7a132 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:51:02.534852 30396 raft_consensus.cc:686] T 00000000000000000000000000000000 P d0beb31aca504cc683b9985405e7a132 [term 1 LEADER]: Becoming Leader. State: Replica: d0beb31aca504cc683b9985405e7a132, State: Running, Role: LEADER
I20260808 15:51:02.535282 30396 consensus_queue.cc:237] T 00000000000000000000000000000000 P d0beb31aca504cc683b9985405e7a132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0beb31aca504cc683b9985405e7a132" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41983 } }
I20260808 15:51:02.535863 30391 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0beb31aca504cc683b9985405e7a132 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:51:02.536561 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:51:02.537034 30398 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0beb31aca504cc683b9985405e7a132 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0beb31aca504cc683b9985405e7a132. Latest consensus state: current_term: 1 leader_uuid: "d0beb31aca504cc683b9985405e7a132" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0beb31aca504cc683b9985405e7a132" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41983 } } }
I20260808 15:51:02.537165 30398 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0beb31aca504cc683b9985405e7a132 [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:02.537550 30397 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0beb31aca504cc683b9985405e7a132 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d0beb31aca504cc683b9985405e7a132" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0beb31aca504cc683b9985405e7a132" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41983 } } }
I20260808 15:51:02.537643 30397 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0beb31aca504cc683b9985405e7a132 [sys.catalog]: This master's current role is: LEADER
W20260808 15:51:02.541639 30416 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d0beb31aca504cc683b9985405e7a132: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:51:02.541740 30416 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:51:02.541819 30405 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:51:02.542542 30405 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:51:02.549042 30405 catalog_manager.cc:1347] Generated new cluster ID: 94377ffcbaca44ba9389e3bed5320e89
I20260808 15:51:02.549126 30405 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:51:02.550065 30394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:02.539101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.51:54189 (local address 127.0.0.1:41983)
0808 15:51:02.539241 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:02.539247 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:02.539611 (+ 364us) server_negotiation.cc:407] Connection header received
0808 15:51:02.539721 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:02.539725 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:02.539776 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:02.539859 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:02.540845 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:02.541665 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:02.543156 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:02.543501 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:02.543613 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:02.545572 (+ 1959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:02.545576 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:02.545579 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:02.545610 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:02.547568 (+ 1958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:02.548239 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:02.548243 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:02.548245 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:02.548342 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:02.548794 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:02.548798 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:02.548800 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:02.549061 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:02.549286 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:02.549788 (+ 502us) server_negotiation.cc:299] Negotiation successful
0808 15:51:02.549902 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 15:51:02.572611 30405 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:51:02.574061 30405 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:51:02.592036 30405 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d0beb31aca504cc683b9985405e7a132: Generated new TSK 0
I20260808 15:51:02.593034 30405 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:51:02.600260 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 30316
W20260808 15:51:02.607932 30301 connection.cc:535] client connection to 127.0.0.1:41983 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41983): Connection reset by peer (error 104)
2026-08-08T15:51:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1520 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:51:02 dist-test-slave-8tdl krb5kdc[30423](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:51:02 dist-test-slave-8tdl krb5kdc[30423](info): set up 2 sockets
Aug 08 15:51:02 dist-test-slave-8tdl krb5kdc[30423](info): commencing operation
krb5kdc: starting...
W20260808 15:51:03.704736 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.082s user 0.009s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:51:03 dist-test-slave-8tdl krb5kdc[30423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204263, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:51:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:51:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 15:51:03.854625 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40535
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40535
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:51:03.974720 30439 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:51:03.975136 30439 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:51:03.975224 30439 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:51:03.979616 30439 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:51:03.979745 30439 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:51:03.979786 30439 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:51:03.979822 30439 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:51:03.979863 30439 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:51:03.985992 30439 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40535
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40535
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30439
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:51:03.987304 30439 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:51:03.988441 30439 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:51:03.998543 30444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:03.998581 30447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:03.998581 30445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:03.998646 30439 server_base.cc:1034] running on GCE node
I20260808 15:51:03.999652 30439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:51:04.001029 30439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:51:04.002269 30439 hybrid_clock.cc:648] HybridClock initialized: now 1786204264002238 us; error 47 us; skew 500 ppm
Aug 08 15:51:04 dist-test-slave-8tdl krb5kdc[30423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204264, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:51:04.005838 30439 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 15:51:04.007006 30439 webserver.cc:460] Webserver started at http://127.0.0.1:39353/ using document root <none> and password file <none>
I20260808 15:51:04.007633 30439 fs_manager.cc:359] Metadata directory not provided
I20260808 15:51:04.007704 30439 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:51:04.007894 30439 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:51:04.010314 30439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "6c60a28203aa4749a45972a0a169ec3f"
format_stamp: "Formatted at 2026-08-08 15:51:04 on dist-test-slave-8tdl"
server_key: "f2ac08093de8a756d140c689bcb77dd6"
server_key_iv: "a84d29d2a308495b63ad56eedcca710b"
server_key_version: "encryptionkey@0"
I20260808 15:51:04.011065 30439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "6c60a28203aa4749a45972a0a169ec3f"
format_stamp: "Formatted at 2026-08-08 15:51:04 on dist-test-slave-8tdl"
server_key: "f2ac08093de8a756d140c689bcb77dd6"
server_key_iv: "a84d29d2a308495b63ad56eedcca710b"
server_key_version: "encryptionkey@0"
I20260808 15:51:04.015668 30439 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 15:51:04.018388 30454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:51:04.020074 30439 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:51:04.020229 30439 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "6c60a28203aa4749a45972a0a169ec3f"
format_stamp: "Formatted at 2026-08-08 15:51:04 on dist-test-slave-8tdl"
server_key: "f2ac08093de8a756d140c689bcb77dd6"
server_key_iv: "a84d29d2a308495b63ad56eedcca710b"
server_key_version: "encryptionkey@0"
I20260808 15:51:04.020358 30439 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:51:04.039160 30439 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:51:04.043280 30439 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:51:04.043483 30439 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:51:04.051877 30439 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40535
I20260808 15:51:04.051921 30509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40535 every 8 connection(s)
I20260808 15:51:04.053025 30439 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:51:04.053352 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 30439
I20260808 15:51:04.053519 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:51:04.053913 8349 external_mini_cluster.cc:1428] Setting key d886222317c28d7cfb6aeca3969d57fc
I20260808 15:51:04.056828 30510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:51:04.063517 30510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c60a28203aa4749a45972a0a169ec3f: Bootstrap starting.
I20260808 15:51:04.063874 30513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:04.055679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.51:51123 (local address 127.0.0.1:40535)
0808 15:51:04.056204 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:04.056220 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:04.056259 (+ 39us) server_negotiation.cc:407] Connection header received
0808 15:51:04.057040 (+ 781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:04.057066 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:04.057459 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:04.057819 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:04.058250 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:04.059357 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:04.060361 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:04.060887 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:04.061067 (+ 180us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:04.062080 (+ 1013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:04.062085 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:04.062098 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:51:04.062504 (+ 406us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:04.062561 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:51:04.062583 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:04.062759 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:04.062910 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 15:51:04.063060 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":177,"threads_started":1}
I20260808 15:51:04.066381 30510 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c60a28203aa4749a45972a0a169ec3f: Neither blocks nor log segments found. Creating new log.
I20260808 15:51:04.067284 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:51:04.067441 30510 log.cc:824] T 00000000000000000000000000000000 P 6c60a28203aa4749a45972a0a169ec3f: Log is configured to *not* fsync() on all Append() calls
I20260808 15:51:04.069880 30510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c60a28203aa4749a45972a0a169ec3f: No bootstrap required, opened a new log
I20260808 15:51:04.074533 30513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:04.069640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.51:60575 (local address 127.0.0.1:40535)
0808 15:51:04.069783 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:04.069790 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:04.070053 (+ 263us) server_negotiation.cc:407] Connection header received
0808 15:51:04.070136 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:04.070139 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:04.070180 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:04.070250 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:04.070644 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:04.071244 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:04.072668 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:04.072930 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:04.073029 (+ 99us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:04.073996 (+ 967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:04.074000 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:04.074002 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:51:04.074015 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:04.074041 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:51:04.074051 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:04.074120 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:04.074312 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 15:51:04.074349 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 15:51:04.075404 30510 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c60a28203aa4749a45972a0a169ec3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c60a28203aa4749a45972a0a169ec3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40535 } }
I20260808 15:51:04.075706 30510 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6c60a28203aa4749a45972a0a169ec3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:51:04.075778 30510 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c60a28203aa4749a45972a0a169ec3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c60a28203aa4749a45972a0a169ec3f, State: Initialized, Role: FOLLOWER
I20260808 15:51:04.076249 30510 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c60a28203aa4749a45972a0a169ec3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c60a28203aa4749a45972a0a169ec3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40535 } }
I20260808 15:51:04.076422 30510 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6c60a28203aa4749a45972a0a169ec3f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:51:04.076520 30510 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c60a28203aa4749a45972a0a169ec3f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:51:04.076635 30510 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c60a28203aa4749a45972a0a169ec3f [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:51:04.077742 30510 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c60a28203aa4749a45972a0a169ec3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c60a28203aa4749a45972a0a169ec3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40535 } }
I20260808 15:51:04.078155 30510 leader_election.cc:302] T 00000000000000000000000000000000 P 6c60a28203aa4749a45972a0a169ec3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c60a28203aa4749a45972a0a169ec3f; no voters:
I20260808 15:51:04.078527 30510 leader_election.cc:288] T 00000000000000000000000000000000 P 6c60a28203aa4749a45972a0a169ec3f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:51:04.078703 30520 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c60a28203aa4749a45972a0a169ec3f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:51:04.078943 30520 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c60a28203aa4749a45972a0a169ec3f [term 1 LEADER]: Becoming Leader. State: Replica: 6c60a28203aa4749a45972a0a169ec3f, State: Running, Role: LEADER
I20260808 15:51:04.079283 30520 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c60a28203aa4749a45972a0a169ec3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c60a28203aa4749a45972a0a169ec3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40535 } }
I20260808 15:51:04.080071 30510 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c60a28203aa4749a45972a0a169ec3f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:51:04.081420 30523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c60a28203aa4749a45972a0a169ec3f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c60a28203aa4749a45972a0a169ec3f. Latest consensus state: current_term: 1 leader_uuid: "6c60a28203aa4749a45972a0a169ec3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c60a28203aa4749a45972a0a169ec3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40535 } } }
I20260808 15:51:04.081403 30521 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c60a28203aa4749a45972a0a169ec3f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6c60a28203aa4749a45972a0a169ec3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c60a28203aa4749a45972a0a169ec3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40535 } } }
I20260808 15:51:04.081578 30521 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c60a28203aa4749a45972a0a169ec3f [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:04.081576 30523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c60a28203aa4749a45972a0a169ec3f [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:04.082042 30531 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:51:04.084872 30531 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:51:04.090837 30531 catalog_manager.cc:1347] Generated new cluster ID: 3b7b0ab6b0b343a9aa7eb4e536a28d87
I20260808 15:51:04.090934 30531 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:51:04.104707 30531 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:51:04.106187 30531 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:51:04.115407 30531 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6c60a28203aa4749a45972a0a169ec3f: Generated new TSK 0
I20260808 15:51:04.116402 30531 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:51:04.127075 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 30439
W20260808 15:51:04.135360 30421 connection.cc:535] client connection to 127.0.0.1:40535 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40535): Connection reset by peer (error 104)
2026-08-08T15:51:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1528 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:51:04 dist-test-slave-8tdl krb5kdc[30543](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:51:04 dist-test-slave-8tdl krb5kdc[30543](info): set up 2 sockets
Aug 08 15:51:04 dist-test-slave-8tdl krb5kdc[30543](info): commencing operation
krb5kdc: starting...
W20260808 15:51:05.214203 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:51:05 dist-test-slave-8tdl krb5kdc[30543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:51:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:51:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 15:51:05.358480 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33157
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33157
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:51:05.483819 30556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:51:05.484186 30556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:51:05.484266 30556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:51:05.488653 30556 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:51:05.488770 30556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:51:05.488806 30556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:51:05.488845 30556 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:51:05.488888 30556 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:51:05.494866 30556 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33157
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33157
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:51:05.496119 30556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:51:05.497226 30556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:51:05.506140 30561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:05.506187 30562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:05.506506 30556 server_base.cc:1034] running on GCE node
W20260808 15:51:05.506140 30564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:05.507164 30556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:51:05.508452 30556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:51:05.509685 30556 hybrid_clock.cc:648] HybridClock initialized: now 1786204265509646 us; error 58 us; skew 500 ppm
Aug 08 15:51:05 dist-test-slave-8tdl krb5kdc[30543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204265, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:51:05.512799 30556 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 15:51:05.513828 30556 webserver.cc:460] Webserver started at http://127.0.0.1:46479/ using document root <none> and password file <none>
I20260808 15:51:05.514443 30556 fs_manager.cc:359] Metadata directory not provided
I20260808 15:51:05.514557 30556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:51:05.514878 30556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:51:05.517198 30556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "25dd465baa98438cbc45f31380a95c9a"
format_stamp: "Formatted at 2026-08-08 15:51:05 on dist-test-slave-8tdl"
server_key: "3f87dfae010b3cebd30d28c9a61f5647"
server_key_iv: "b9273ee1d92163da3edfd2d39e0dadad"
server_key_version: "encryptionkey@0"
I20260808 15:51:05.517843 30556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "25dd465baa98438cbc45f31380a95c9a"
format_stamp: "Formatted at 2026-08-08 15:51:05 on dist-test-slave-8tdl"
server_key: "3f87dfae010b3cebd30d28c9a61f5647"
server_key_iv: "b9273ee1d92163da3edfd2d39e0dadad"
server_key_version: "encryptionkey@0"
I20260808 15:51:05.522017 30556 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 15:51:05.524876 30571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:51:05.526427 30556 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:51:05.526614 30556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "25dd465baa98438cbc45f31380a95c9a"
format_stamp: "Formatted at 2026-08-08 15:51:05 on dist-test-slave-8tdl"
server_key: "3f87dfae010b3cebd30d28c9a61f5647"
server_key_iv: "b9273ee1d92163da3edfd2d39e0dadad"
server_key_version: "encryptionkey@0"
I20260808 15:51:05.526832 30556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:51:05.531781 30556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:51:05.535358 30556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:51:05.535607 30556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:51:05.543190 30556 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33157
I20260808 15:51:05.543220 30628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33157 every 8 connection(s)
I20260808 15:51:05.544219 30556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:51:05.547266 30630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:51:05.547266 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 30556
I20260808 15:51:05.547420 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:51:05.547768 8349 external_mini_cluster.cc:1428] Setting key 15adf5842b2116c1f92702e38c357c6d
I20260808 15:51:05.553471 30633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:05.549295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.51:50385 (local address 127.0.0.1:33157)
0808 15:51:05.549766 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:05.549781 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:05.549818 (+ 37us) server_negotiation.cc:407] Connection header received
0808 15:51:05.550638 (+ 820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:05.550659 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:05.551009 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:05.551388 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:05.552235 (+ 847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:05.552240 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:05.552252 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:51:05.552263 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:05.552319 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:51:05.552337 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:05.552502 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:05.552572 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 15:51:05.552763 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":160,"threads_started":1}
I20260808 15:51:05.554270 30630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25dd465baa98438cbc45f31380a95c9a: Bootstrap starting.
I20260808 15:51:05.556428 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:51:05.556874 30630 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25dd465baa98438cbc45f31380a95c9a: Neither blocks nor log segments found. Creating new log.
I20260808 15:51:05.557705 30630 log.cc:824] T 00000000000000000000000000000000 P 25dd465baa98438cbc45f31380a95c9a: Log is configured to *not* fsync() on all Append() calls
I20260808 15:51:05.560607 30633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:05.558717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.51:45007 (local address 127.0.0.1:33157)
0808 15:51:05.558838 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:05.558842 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:05.559089 (+ 247us) server_negotiation.cc:407] Connection header received
0808 15:51:05.559204 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:05.559206 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:05.559242 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:05.559320 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:05.560120 (+ 800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:05.560123 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:05.560125 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:51:05.560136 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:05.560164 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:51:05.560175 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:05.560258 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:05.560378 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 15:51:05.560418 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 15:51:05.560835 30630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25dd465baa98438cbc45f31380a95c9a: No bootstrap required, opened a new log
I20260808 15:51:05.564795 30630 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25dd465baa98438cbc45f31380a95c9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25dd465baa98438cbc45f31380a95c9a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33157 } }
I20260808 15:51:05.565141 30630 raft_consensus.cc:374] T 00000000000000000000000000000000 P 25dd465baa98438cbc45f31380a95c9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:51:05.565223 30630 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25dd465baa98438cbc45f31380a95c9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25dd465baa98438cbc45f31380a95c9a, State: Initialized, Role: FOLLOWER
I20260808 15:51:05.565724 30630 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25dd465baa98438cbc45f31380a95c9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25dd465baa98438cbc45f31380a95c9a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33157 } }
I20260808 15:51:05.565933 30630 raft_consensus.cc:388] T 00000000000000000000000000000000 P 25dd465baa98438cbc45f31380a95c9a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:51:05.566010 30630 raft_consensus.cc:482] T 00000000000000000000000000000000 P 25dd465baa98438cbc45f31380a95c9a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:51:05.566119 30630 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25dd465baa98438cbc45f31380a95c9a [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:51:05.567299 30630 raft_consensus.cc:504] T 00000000000000000000000000000000 P 25dd465baa98438cbc45f31380a95c9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25dd465baa98438cbc45f31380a95c9a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33157 } }
I20260808 15:51:05.567669 30630 leader_election.cc:302] T 00000000000000000000000000000000 P 25dd465baa98438cbc45f31380a95c9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25dd465baa98438cbc45f31380a95c9a; no voters:
I20260808 15:51:05.568015 30630 leader_election.cc:288] T 00000000000000000000000000000000 P 25dd465baa98438cbc45f31380a95c9a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:51:05.568204 30640 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 25dd465baa98438cbc45f31380a95c9a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:51:05.568509 30640 raft_consensus.cc:686] T 00000000000000000000000000000000 P 25dd465baa98438cbc45f31380a95c9a [term 1 LEADER]: Becoming Leader. State: Replica: 25dd465baa98438cbc45f31380a95c9a, State: Running, Role: LEADER
I20260808 15:51:05.568861 30640 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25dd465baa98438cbc45f31380a95c9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25dd465baa98438cbc45f31380a95c9a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33157 } }
I20260808 15:51:05.569365 30630 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25dd465baa98438cbc45f31380a95c9a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:51:05.570926 30642 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25dd465baa98438cbc45f31380a95c9a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25dd465baa98438cbc45f31380a95c9a. Latest consensus state: current_term: 1 leader_uuid: "25dd465baa98438cbc45f31380a95c9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25dd465baa98438cbc45f31380a95c9a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33157 } } }
I20260808 15:51:05.571084 30642 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25dd465baa98438cbc45f31380a95c9a [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:05.570942 30641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25dd465baa98438cbc45f31380a95c9a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25dd465baa98438cbc45f31380a95c9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25dd465baa98438cbc45f31380a95c9a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33157 } } }
I20260808 15:51:05.571237 30641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25dd465baa98438cbc45f31380a95c9a [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:05.571535 30650 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:51:05.574539 30650 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:51:05.581094 30650 catalog_manager.cc:1347] Generated new cluster ID: 7fb5027f80fa4443a6def8bf35715b29
I20260808 15:51:05.581192 30650 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:51:05.613627 30650 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:51:05.614030 30650 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:51:05.619540 30650 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 25dd465baa98438cbc45f31380a95c9a: Generated new TSK 0
I20260808 15:51:05.620358 30650 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:51:05.627142 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 30556
2026-08-08T15:51:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1498 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:51:05 dist-test-slave-8tdl krb5kdc[30661](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:51:05 dist-test-slave-8tdl krb5kdc[30661](info): set up 2 sockets
Aug 08 15:51:05 dist-test-slave-8tdl krb5kdc[30661](info): commencing operation
krb5kdc: starting...
W20260808 15:51:06.727624 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.078s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:51:06 dist-test-slave-8tdl krb5kdc[30661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204266, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:51:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:51:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 15:51:06.874500 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46193
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46193
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:51:06.992790 30677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:51:06.993100 30677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:51:06.993144 30677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:51:06.997486 30677 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:51:06.997583 30677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:51:06.997603 30677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:51:06.997622 30677 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:51:06.997637 30677 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:51:07.003419 30677 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46193
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46193
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30677
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:51:07.004585 30677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:51:07.005635 30677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:51:07.015100 30683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:07.015195 30677 server_base.cc:1034] running on GCE node
W20260808 15:51:07.015058 30682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:07.015095 30685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:07.015954 30677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:51:07.017408 30677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:51:07.018662 30677 hybrid_clock.cc:648] HybridClock initialized: now 1786204267018642 us; error 36 us; skew 500 ppm
Aug 08 15:51:07 dist-test-slave-8tdl krb5kdc[30661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204267, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:51:07.027915 30677 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 15:51:07.029162 30677 webserver.cc:460] Webserver started at http://127.0.0.1:37785/ using document root <none> and password file <none>
I20260808 15:51:07.029822 30677 fs_manager.cc:359] Metadata directory not provided
I20260808 15:51:07.029934 30677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:51:07.030212 30677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:51:07.032665 30677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "84ebf1608295493c9f5baf2e5dd32286"
format_stamp: "Formatted at 2026-08-08 15:51:07 on dist-test-slave-8tdl"
server_key: "2a3173bc0ad8e9c3aa4b5fe2c3f1641a"
server_key_iv: "6858829ca053fe7ef23887ff33697446"
server_key_version: "encryptionkey@0"
I20260808 15:51:07.033358 30677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "84ebf1608295493c9f5baf2e5dd32286"
format_stamp: "Formatted at 2026-08-08 15:51:07 on dist-test-slave-8tdl"
server_key: "2a3173bc0ad8e9c3aa4b5fe2c3f1641a"
server_key_iv: "6858829ca053fe7ef23887ff33697446"
server_key_version: "encryptionkey@0"
I20260808 15:51:07.037762 30677 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260808 15:51:07.040553 30693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:51:07.041929 30677 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:51:07.042198 30677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "84ebf1608295493c9f5baf2e5dd32286"
format_stamp: "Formatted at 2026-08-08 15:51:07 on dist-test-slave-8tdl"
server_key: "2a3173bc0ad8e9c3aa4b5fe2c3f1641a"
server_key_iv: "6858829ca053fe7ef23887ff33697446"
server_key_version: "encryptionkey@0"
I20260808 15:51:07.042379 30677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:51:07.088466 30677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:51:07.092003 30677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:51:07.092267 30677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:51:07.100837 30677 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46193
I20260808 15:51:07.100850 30748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46193 every 8 connection(s)
I20260808 15:51:07.102047 30677 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:51:07.103470 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 30677
I20260808 15:51:07.103659 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:51:07.104035 8349 external_mini_cluster.cc:1428] Setting key 001b599620f2c3e9806175c8e9db4e30
I20260808 15:51:07.105638 30749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:51:07.112725 30749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84ebf1608295493c9f5baf2e5dd32286: Bootstrap starting.
Aug 08 15:51:07 dist-test-slave-8tdl krb5kdc[30661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204266, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 15:51:07.115688 30749 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 84ebf1608295493c9f5baf2e5dd32286: Neither blocks nor log segments found. Creating new log.
I20260808 15:51:07.116631 30749 log.cc:824] T 00000000000000000000000000000000 P 84ebf1608295493c9f5baf2e5dd32286: Log is configured to *not* fsync() on all Append() calls
I20260808 15:51:07.119201 30749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84ebf1608295493c9f5baf2e5dd32286: No bootstrap required, opened a new log
I20260808 15:51:07.121163 30752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:07.105592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.51:56489 (local address 127.0.0.1:46193)
0808 15:51:07.106125 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:07.106143 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:07.106183 (+ 40us) server_negotiation.cc:407] Connection header received
0808 15:51:07.107007 (+ 824us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:07.107029 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:07.107422 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:07.107735 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:07.108763 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:07.110000 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:07.111285 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:07.111830 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:07.111980 (+ 150us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:07.115202 (+ 3222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:07.115208 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:07.115224 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:07.115260 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:07.117621 (+ 2361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:07.118260 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:07.118272 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:07.118277 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:07.118400 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:07.118817 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:07.118820 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:07.118822 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:07.119278 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:07.119534 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:07.119910 (+ 376us) server_negotiation.cc:299] Negotiation successful
0808 15:51:07.120152 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":186,"threads_started":1}
I20260808 15:51:07.122738 30749 raft_consensus.cc:348] T 00000000000000000000000000000000 P 84ebf1608295493c9f5baf2e5dd32286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84ebf1608295493c9f5baf2e5dd32286" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46193 } }
I20260808 15:51:07.123014 30749 raft_consensus.cc:374] T 00000000000000000000000000000000 P 84ebf1608295493c9f5baf2e5dd32286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:51:07.123126 30749 raft_consensus.cc:729] T 00000000000000000000000000000000 P 84ebf1608295493c9f5baf2e5dd32286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84ebf1608295493c9f5baf2e5dd32286, State: Initialized, Role: FOLLOWER
I20260808 15:51:07.123648 30749 consensus_queue.cc:260] T 00000000000000000000000000000000 P 84ebf1608295493c9f5baf2e5dd32286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84ebf1608295493c9f5baf2e5dd32286" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46193 } }
I20260808 15:51:07.123812 30749 raft_consensus.cc:388] T 00000000000000000000000000000000 P 84ebf1608295493c9f5baf2e5dd32286 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:51:07.123961 30749 raft_consensus.cc:482] T 00000000000000000000000000000000 P 84ebf1608295493c9f5baf2e5dd32286 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:51:07.124095 30749 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 84ebf1608295493c9f5baf2e5dd32286 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:51:07.124730 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:51:07.125527 30749 raft_consensus.cc:504] T 00000000000000000000000000000000 P 84ebf1608295493c9f5baf2e5dd32286 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84ebf1608295493c9f5baf2e5dd32286" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46193 } }
I20260808 15:51:07.125973 30749 leader_election.cc:302] T 00000000000000000000000000000000 P 84ebf1608295493c9f5baf2e5dd32286 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 84ebf1608295493c9f5baf2e5dd32286; no voters:
I20260808 15:51:07.126382 30749 leader_election.cc:288] T 00000000000000000000000000000000 P 84ebf1608295493c9f5baf2e5dd32286 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:51:07.126523 30757 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 84ebf1608295493c9f5baf2e5dd32286 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:51:07.126847 30757 raft_consensus.cc:686] T 00000000000000000000000000000000 P 84ebf1608295493c9f5baf2e5dd32286 [term 1 LEADER]: Becoming Leader. State: Replica: 84ebf1608295493c9f5baf2e5dd32286, State: Running, Role: LEADER
I20260808 15:51:07.127327 30757 consensus_queue.cc:237] T 00000000000000000000000000000000 P 84ebf1608295493c9f5baf2e5dd32286 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84ebf1608295493c9f5baf2e5dd32286" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46193 } }
I20260808 15:51:07.128011 30749 sys_catalog.cc:564] T 00000000000000000000000000000000 P 84ebf1608295493c9f5baf2e5dd32286 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:51:07.129587 30760 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84ebf1608295493c9f5baf2e5dd32286 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 84ebf1608295493c9f5baf2e5dd32286. Latest consensus state: current_term: 1 leader_uuid: "84ebf1608295493c9f5baf2e5dd32286" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84ebf1608295493c9f5baf2e5dd32286" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46193 } } }
I20260808 15:51:07.129985 30759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84ebf1608295493c9f5baf2e5dd32286 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "84ebf1608295493c9f5baf2e5dd32286" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84ebf1608295493c9f5baf2e5dd32286" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46193 } } }
I20260808 15:51:07.130192 30759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84ebf1608295493c9f5baf2e5dd32286 [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:07.131075 30760 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84ebf1608295493c9f5baf2e5dd32286 [sys.catalog]: This master's current role is: LEADER
W20260808 15:51:07.133910 30775 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 84ebf1608295493c9f5baf2e5dd32286: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:51:07.134014 30775 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:51:07.134393 30777 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:51:07.135516 30777 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:51:07.138741 30752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:07.127375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.51:37863 (local address 127.0.0.1:46193)
0808 15:51:07.127491 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:07.127496 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:07.127943 (+ 447us) server_negotiation.cc:407] Connection header received
0808 15:51:07.128259 (+ 316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:07.128263 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:07.128318 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:07.128370 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:07.129894 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:07.130822 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:07.131989 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:07.132279 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:07.132422 (+ 143us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:07.134312 (+ 1890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:07.134316 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:07.134319 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:07.134354 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:07.136274 (+ 1920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:07.136953 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:07.136956 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:07.136958 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:07.137056 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:07.137486 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:07.137490 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:07.137492 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:07.137724 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:07.137936 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:07.138251 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 15:51:07.138367 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 15:51:07.143066 30777 catalog_manager.cc:1347] Generated new cluster ID: 8a72654af5784eeebeed07de47916544
I20260808 15:51:07.143227 30777 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:51:07.158900 30777 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:51:07.159943 30777 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:51:07.168305 30777 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 84ebf1608295493c9f5baf2e5dd32286: Generated new TSK 0
I20260808 15:51:07.169098 30777 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:51:07.175148 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 30677
W20260808 15:51:07.182766 30659 connection.cc:535] client connection to 127.0.0.1:46193 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46193): Connection reset by peer (error 104)
2026-08-08T15:51:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1548 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:51:07 dist-test-slave-8tdl krb5kdc[30783](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:51:07 dist-test-slave-8tdl krb5kdc[30783](info): set up 2 sockets
Aug 08 15:51:07 dist-test-slave-8tdl krb5kdc[30783](info): commencing operation
krb5kdc: starting...
W20260808 15:51:08.292605 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:51:08 dist-test-slave-8tdl krb5kdc[30783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204268, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:51:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:51:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 15:51:08.439186 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37071
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37071
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:51:08.560731 30798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:51:08.561105 30798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:51:08.561192 30798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:51:08.565423 30798 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:51:08.565533 30798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:51:08.565574 30798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:51:08.565609 30798 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:51:08.565640 30798 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:51:08.571306 30798 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37071
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30798
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:51:08.572540 30798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:51:08.573657 30798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 15:51:08.583505 30798 server_base.cc:1034] running on GCE node
W20260808 15:51:08.583452 30803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:08.583452 30804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:08.583460 30806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:08.584412 30798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:51:08.585644 30798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:51:08.586828 30798 hybrid_clock.cc:648] HybridClock initialized: now 1786204268586806 us; error 36 us; skew 500 ppm
Aug 08 15:51:08 dist-test-slave-8tdl krb5kdc[30783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204268, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:51:08.589812 30798 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 15:51:08.590859 30798 webserver.cc:460] Webserver started at http://127.0.0.1:44055/ using document root <none> and password file <none>
I20260808 15:51:08.591394 30798 fs_manager.cc:359] Metadata directory not provided
I20260808 15:51:08.591455 30798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:51:08.591635 30798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:51:08.593724 30798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "5ec7db373dfc495eab924d2640cb37b3"
format_stamp: "Formatted at 2026-08-08 15:51:08 on dist-test-slave-8tdl"
server_key: "1a58b78a3ab2e183296263f012b8130a"
server_key_iv: "c0c744f7a704195328f73d27081dd780"
server_key_version: "encryptionkey@0"
I20260808 15:51:08.594277 30798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "5ec7db373dfc495eab924d2640cb37b3"
format_stamp: "Formatted at 2026-08-08 15:51:08 on dist-test-slave-8tdl"
server_key: "1a58b78a3ab2e183296263f012b8130a"
server_key_iv: "c0c744f7a704195328f73d27081dd780"
server_key_version: "encryptionkey@0"
I20260808 15:51:08.598254 30798 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 15:51:08.600960 30815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:51:08.602427 30798 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:51:08.602627 30798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "5ec7db373dfc495eab924d2640cb37b3"
format_stamp: "Formatted at 2026-08-08 15:51:08 on dist-test-slave-8tdl"
server_key: "1a58b78a3ab2e183296263f012b8130a"
server_key_iv: "c0c744f7a704195328f73d27081dd780"
server_key_version: "encryptionkey@0"
I20260808 15:51:08.602789 30798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:51:08.634946 30798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:51:08.638623 30798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:51:08.638923 30798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:51:08.646845 30798 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37071
I20260808 15:51:08.646880 30871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37071 every 8 connection(s)
I20260808 15:51:08.647902 30798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:51:08.650914 30872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:51:08.656867 30872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ec7db373dfc495eab924d2640cb37b3: Bootstrap starting.
I20260808 15:51:08.658087 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 30798
I20260808 15:51:08.658260 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:51:08.658583 8349 external_mini_cluster.cc:1428] Setting key 30729da01098cba9034849da38923920
I20260808 15:51:08.659866 30872 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ec7db373dfc495eab924d2640cb37b3: Neither blocks nor log segments found. Creating new log.
I20260808 15:51:08.660743 30872 log.cc:824] T 00000000000000000000000000000000 P 5ec7db373dfc495eab924d2640cb37b3: Log is configured to *not* fsync() on all Append() calls
I20260808 15:51:08.663081 30872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ec7db373dfc495eab924d2640cb37b3: No bootstrap required, opened a new log
I20260808 15:51:08.667130 30872 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ec7db373dfc495eab924d2640cb37b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ec7db373dfc495eab924d2640cb37b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37071 } }
I20260808 15:51:08.667392 30872 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5ec7db373dfc495eab924d2640cb37b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:51:08.667428 30872 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ec7db373dfc495eab924d2640cb37b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec7db373dfc495eab924d2640cb37b3, State: Initialized, Role: FOLLOWER
I20260808 15:51:08.668033 30872 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ec7db373dfc495eab924d2640cb37b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ec7db373dfc495eab924d2640cb37b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37071 } }
I20260808 15:51:08.668200 30872 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5ec7db373dfc495eab924d2640cb37b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:51:08.668293 30872 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ec7db373dfc495eab924d2640cb37b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:51:08.668406 30872 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ec7db373dfc495eab924d2640cb37b3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:51:08.669013 30875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:08.659870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.51:49423 (local address 127.0.0.1:37071)
0808 15:51:08.660367 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:08.660383 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:08.660421 (+ 38us) server_negotiation.cc:407] Connection header received
0808 15:51:08.661276 (+ 855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:08.661301 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:08.661774 (+ 473us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:08.662151 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:08.662610 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:08.663783 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:08.664770 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:08.665287 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:08.665488 (+ 201us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:08.666782 (+ 1294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:08.666788 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:08.666804 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:51:08.667243 (+ 439us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:08.667310 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:51:08.667344 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:08.667615 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:08.667809 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 15:51:08.668016 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":162,"threads_started":1}
I20260808 15:51:08.669592 30872 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ec7db373dfc495eab924d2640cb37b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ec7db373dfc495eab924d2640cb37b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37071 } }
I20260808 15:51:08.669961 30872 leader_election.cc:302] T 00000000000000000000000000000000 P 5ec7db373dfc495eab924d2640cb37b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ec7db373dfc495eab924d2640cb37b3; no voters:
I20260808 15:51:08.670373 30872 leader_election.cc:288] T 00000000000000000000000000000000 P 5ec7db373dfc495eab924d2640cb37b3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:51:08.670455 30877 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ec7db373dfc495eab924d2640cb37b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:51:08.670701 30877 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5ec7db373dfc495eab924d2640cb37b3 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec7db373dfc495eab924d2640cb37b3, State: Running, Role: LEADER
I20260808 15:51:08.671090 30877 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ec7db373dfc495eab924d2640cb37b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ec7db373dfc495eab924d2640cb37b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37071 } }
I20260808 15:51:08.671862 30872 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ec7db373dfc495eab924d2640cb37b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:51:08.672431 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:51:08.672896 30879 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ec7db373dfc495eab924d2640cb37b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ec7db373dfc495eab924d2640cb37b3. Latest consensus state: current_term: 1 leader_uuid: "5ec7db373dfc495eab924d2640cb37b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ec7db373dfc495eab924d2640cb37b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37071 } } }
I20260808 15:51:08.673033 30879 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ec7db373dfc495eab924d2640cb37b3 [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:08.673374 30878 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ec7db373dfc495eab924d2640cb37b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5ec7db373dfc495eab924d2640cb37b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ec7db373dfc495eab924d2640cb37b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37071 } } }
I20260808 15:51:08.673460 30878 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ec7db373dfc495eab924d2640cb37b3 [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:08.674564 30886 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:51:08.678570 30886 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:51:08.679622 30875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:08.675186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.51:35589 (local address 127.0.0.1:37071)
0808 15:51:08.675327 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:08.675336 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:08.675573 (+ 237us) server_negotiation.cc:407] Connection header received
0808 15:51:08.675727 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:08.675729 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:08.675773 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:08.675850 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:08.676195 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:08.676778 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:08.677733 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:08.677996 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:08.678120 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:08.679100 (+ 980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:08.679103 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:08.679106 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:51:08.679122 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:08.679156 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:51:08.679168 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:08.679272 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:08.679418 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 15:51:08.679465 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 15:51:08.685398 30886 catalog_manager.cc:1347] Generated new cluster ID: a82ea24d508844848b08e0d92e058fb8
I20260808 15:51:08.685559 30886 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:51:08.705123 30886 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:51:08.707039 30886 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:51:08.716321 30886 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5ec7db373dfc495eab924d2640cb37b3: Generated new TSK 0
I20260808 15:51:08.717271 30886 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:51:08.730013 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 30798
W20260808 15:51:08.738399 30781 connection.cc:535] client connection to 127.0.0.1:37071 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37071): Connection reset by peer (error 104)
2026-08-08T15:51:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1555 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:51:08 dist-test-slave-8tdl krb5kdc[30903](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:51:08 dist-test-slave-8tdl krb5kdc[30903](info): set up 2 sockets
Aug 08 15:51:08 dist-test-slave-8tdl krb5kdc[30903](info): commencing operation
krb5kdc: starting...
W20260808 15:51:09.851647 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:51:09 dist-test-slave-8tdl krb5kdc[30903](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204269, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:51:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:51:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 15:51:09.990006 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36737
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36737
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:51:10.105448 30917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:51:10.105787 30917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:51:10.105871 30917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:51:10.110034 30917 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:51:10.110148 30917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:51:10.110188 30917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:51:10.110224 30917 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:51:10.110265 30917 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:51:10.116008 30917 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36737
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30917
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:51:10.117280 30917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:51:10.118467 30917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:51:10.127607 30922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:10.127637 30923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:10.127612 30925 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:10.127655 30917 server_base.cc:1034] running on GCE node
I20260808 15:51:10.128604 30917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:51:10.129889 30917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:51:10.131088 30917 hybrid_clock.cc:648] HybridClock initialized: now 1786204270131064 us; error 34 us; skew 500 ppm
Aug 08 15:51:10 dist-test-slave-8tdl krb5kdc[30903](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204270, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:51:10.134002 30917 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 15:51:10.135052 30917 webserver.cc:460] Webserver started at http://127.0.0.1:33827/ using document root <none> and password file <none>
I20260808 15:51:10.135615 30917 fs_manager.cc:359] Metadata directory not provided
I20260808 15:51:10.135679 30917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:51:10.135860 30917 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:51:10.138015 30917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "70a6f3b6051943b5b83b60f2f171feca"
format_stamp: "Formatted at 2026-08-08 15:51:10 on dist-test-slave-8tdl"
server_key: "c6fbb36a36d6ed7d81638e65f952a204"
server_key_iv: "5f2180c726ff8e44aaa5221bf06a6b29"
server_key_version: "encryptionkey@0"
I20260808 15:51:10.138558 30917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "70a6f3b6051943b5b83b60f2f171feca"
format_stamp: "Formatted at 2026-08-08 15:51:10 on dist-test-slave-8tdl"
server_key: "c6fbb36a36d6ed7d81638e65f952a204"
server_key_iv: "5f2180c726ff8e44aaa5221bf06a6b29"
server_key_version: "encryptionkey@0"
I20260808 15:51:10.142518 30917 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260808 15:51:10.145020 30932 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:51:10.146350 30917 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:51:10.146512 30917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "70a6f3b6051943b5b83b60f2f171feca"
format_stamp: "Formatted at 2026-08-08 15:51:10 on dist-test-slave-8tdl"
server_key: "c6fbb36a36d6ed7d81638e65f952a204"
server_key_iv: "5f2180c726ff8e44aaa5221bf06a6b29"
server_key_version: "encryptionkey@0"
I20260808 15:51:10.146647 30917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:51:10.151548 30917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:51:10.155161 30917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:51:10.155377 30917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:51:10.163002 30917 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36737
I20260808 15:51:10.163033 30991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36737 every 8 connection(s)
I20260808 15:51:10.164057 30917 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:51:10.167237 30992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:51:10.167946 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 30917
I20260808 15:51:10.168097 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:51:10.168406 8349 external_mini_cluster.cc:1428] Setting key ecd199401cfcc757ab49a44fd378882e
I20260808 15:51:10.173936 30992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70a6f3b6051943b5b83b60f2f171feca: Bootstrap starting.
I20260808 15:51:10.174015 30995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:10.169967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.51:41143 (local address 127.0.0.1:36737)
0808 15:51:10.170477 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:10.170493 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:10.170531 (+ 38us) server_negotiation.cc:407] Connection header received
0808 15:51:10.171246 (+ 715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:10.171265 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:10.171577 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:10.171928 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:10.172779 (+ 851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:10.172784 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:10.172795 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:51:10.172806 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:10.172860 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:51:10.172879 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:10.173034 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:10.173107 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 15:51:10.173279 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":140,"threads_started":1}
I20260808 15:51:10.176789 30992 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70a6f3b6051943b5b83b60f2f171feca: Neither blocks nor log segments found. Creating new log.
I20260808 15:51:10.177335 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:51:10.177724 30992 log.cc:824] T 00000000000000000000000000000000 P 70a6f3b6051943b5b83b60f2f171feca: Log is configured to *not* fsync() on all Append() calls
I20260808 15:51:10.180307 30992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70a6f3b6051943b5b83b60f2f171feca: No bootstrap required, opened a new log
I20260808 15:51:10.182112 30995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:10.180026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.51:55639 (local address 127.0.0.1:36737)
0808 15:51:10.180205 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:10.180210 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:10.180517 (+ 307us) server_negotiation.cc:407] Connection header received
0808 15:51:10.180655 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:10.180659 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:10.180700 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:10.180800 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:10.181662 (+ 862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:10.181666 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:10.181669 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:51:10.181682 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:10.181715 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:51:10.181728 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:10.181826 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:10.181921 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 15:51:10.181970 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 15:51:10.184765 30992 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70a6f3b6051943b5b83b60f2f171feca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70a6f3b6051943b5b83b60f2f171feca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36737 } }
I20260808 15:51:10.185032 30992 raft_consensus.cc:374] T 00000000000000000000000000000000 P 70a6f3b6051943b5b83b60f2f171feca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:51:10.185096 30992 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70a6f3b6051943b5b83b60f2f171feca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70a6f3b6051943b5b83b60f2f171feca, State: Initialized, Role: FOLLOWER
I20260808 15:51:10.185539 30992 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70a6f3b6051943b5b83b60f2f171feca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70a6f3b6051943b5b83b60f2f171feca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36737 } }
I20260808 15:51:10.185710 30992 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70a6f3b6051943b5b83b60f2f171feca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:51:10.185801 30992 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70a6f3b6051943b5b83b60f2f171feca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:51:10.185931 30992 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70a6f3b6051943b5b83b60f2f171feca [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:51:10.187143 30992 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70a6f3b6051943b5b83b60f2f171feca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70a6f3b6051943b5b83b60f2f171feca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36737 } }
I20260808 15:51:10.187566 30992 leader_election.cc:302] T 00000000000000000000000000000000 P 70a6f3b6051943b5b83b60f2f171feca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70a6f3b6051943b5b83b60f2f171feca; no voters:
I20260808 15:51:10.187933 30992 leader_election.cc:288] T 00000000000000000000000000000000 P 70a6f3b6051943b5b83b60f2f171feca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:51:10.188141 31002 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70a6f3b6051943b5b83b60f2f171feca [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:51:10.188448 31002 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70a6f3b6051943b5b83b60f2f171feca [term 1 LEADER]: Becoming Leader. State: Replica: 70a6f3b6051943b5b83b60f2f171feca, State: Running, Role: LEADER
I20260808 15:51:10.188761 31002 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70a6f3b6051943b5b83b60f2f171feca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70a6f3b6051943b5b83b60f2f171feca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36737 } }
I20260808 15:51:10.189416 30992 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70a6f3b6051943b5b83b60f2f171feca [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:51:10.190541 31004 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70a6f3b6051943b5b83b60f2f171feca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70a6f3b6051943b5b83b60f2f171feca. Latest consensus state: current_term: 1 leader_uuid: "70a6f3b6051943b5b83b60f2f171feca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70a6f3b6051943b5b83b60f2f171feca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36737 } } }
I20260808 15:51:10.190699 31004 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70a6f3b6051943b5b83b60f2f171feca [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:10.191116 31011 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:51:10.191112 31003 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70a6f3b6051943b5b83b60f2f171feca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "70a6f3b6051943b5b83b60f2f171feca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70a6f3b6051943b5b83b60f2f171feca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36737 } } }
I20260808 15:51:10.191713 31003 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70a6f3b6051943b5b83b60f2f171feca [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:10.194435 31011 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:51:10.200521 31011 catalog_manager.cc:1347] Generated new cluster ID: 7d27b51614b948ec87c43622d428da58
I20260808 15:51:10.200608 31011 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:51:10.210930 31011 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:51:10.211282 31011 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:51:10.217047 31011 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 70a6f3b6051943b5b83b60f2f171feca: Generated new TSK 0
I20260808 15:51:10.218083 31011 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:51:10.230507 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 30917
2026-08-08T15:51:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1498 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:51:10 dist-test-slave-8tdl krb5kdc[31023](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:51:10 dist-test-slave-8tdl krb5kdc[31023](info): set up 2 sockets
Aug 08 15:51:10 dist-test-slave-8tdl krb5kdc[31023](info): commencing operation
krb5kdc: starting...
W20260808 15:51:11.392493 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:51:11 dist-test-slave-8tdl krb5kdc[31023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204271, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:51:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:51:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:51:11.534308 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:46137
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:42211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:46137
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:51:11.657111 31037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:51:11.657474 31037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:51:11.657562 31037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:51:11.661948 31037 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:51:11.662067 31037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:51:11.662110 31037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:51:11.662153 31037 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:51:11.662184 31037 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:51:11.668103 31037 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:42211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:46137
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:46137
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31037
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:51:11.669356 31037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:51:11.670477 31037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:51:11.679752 31043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:11.679731 31045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:11.679731 31042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:11.680188 31037 server_base.cc:1034] running on GCE node
I20260808 15:51:11.680949 31037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:51:11.682238 31037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:51:11.683480 31037 hybrid_clock.cc:648] HybridClock initialized: now 1786204271683426 us; error 72 us; skew 500 ppm
Aug 08 15:51:11 dist-test-slave-8tdl krb5kdc[31023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204271, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:51:11.686667 31037 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:51:11.687755 31037 webserver.cc:460] Webserver started at http://127.8.39.126:38151/ using document root <none> and password file <none>
I20260808 15:51:11.688340 31037 fs_manager.cc:359] Metadata directory not provided
I20260808 15:51:11.688406 31037 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:51:11.688592 31037 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:51:11.690856 31037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "9ccfcf7166e04b63be72b810065df6ae"
format_stamp: "Formatted at 2026-08-08 15:51:11 on dist-test-slave-8tdl"
server_key: "0e033065c15507caa903c3e9d5c18ae7"
server_key_iv: "d8a46f4d407fbb3aef7f6fe5ec40c2d9"
server_key_version: "encryptionkey@0"
I20260808 15:51:11.691461 31037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "9ccfcf7166e04b63be72b810065df6ae"
format_stamp: "Formatted at 2026-08-08 15:51:11 on dist-test-slave-8tdl"
server_key: "0e033065c15507caa903c3e9d5c18ae7"
server_key_iv: "d8a46f4d407fbb3aef7f6fe5ec40c2d9"
server_key_version: "encryptionkey@0"
I20260808 15:51:11.695734 31037 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 15:51:11.698464 31052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:51:11.700008 31037 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 15:51:11.700140 31037 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "9ccfcf7166e04b63be72b810065df6ae"
format_stamp: "Formatted at 2026-08-08 15:51:11 on dist-test-slave-8tdl"
server_key: "0e033065c15507caa903c3e9d5c18ae7"
server_key_iv: "d8a46f4d407fbb3aef7f6fe5ec40c2d9"
server_key_version: "encryptionkey@0"
I20260808 15:51:11.700244 31037 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:51:11.723896 31037 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:51:11.729120 31037 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:51:11.729388 31037 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:51:11.737960 31037 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:46137
I20260808 15:51:11.737985 31110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:46137 every 8 connection(s)
I20260808 15:51:11.739069 31037 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:51:11.742007 31111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:51:11.742936 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 31037
I20260808 15:51:11.743105 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:51:11.743430 8349 external_mini_cluster.cc:1428] Setting key 24291a4feb7f2de08329e9c3ffeba0cd
I20260808 15:51:11.748799 31111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ccfcf7166e04b63be72b810065df6ae: Bootstrap starting.
I20260808 15:51:11.751288 31111 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ccfcf7166e04b63be72b810065df6ae: Neither blocks nor log segments found. Creating new log.
I20260808 15:51:11.752213 31111 log.cc:824] T 00000000000000000000000000000000 P 9ccfcf7166e04b63be72b810065df6ae: Log is configured to *not* fsync() on all Append() calls
Aug 08 15:51:11 dist-test-slave-8tdl krb5kdc[31023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204271, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:51:11.754916 31111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ccfcf7166e04b63be72b810065df6ae: No bootstrap required, opened a new log
I20260808 15:51:11.758674 31111 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ccfcf7166e04b63be72b810065df6ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccfcf7166e04b63be72b810065df6ae" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 46137 } }
I20260808 15:51:11.759053 31111 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9ccfcf7166e04b63be72b810065df6ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:51:11.759130 31111 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ccfcf7166e04b63be72b810065df6ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ccfcf7166e04b63be72b810065df6ae, State: Initialized, Role: FOLLOWER
I20260808 15:51:11.759651 31111 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ccfcf7166e04b63be72b810065df6ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccfcf7166e04b63be72b810065df6ae" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 46137 } }
I20260808 15:51:11.759788 31111 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9ccfcf7166e04b63be72b810065df6ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:51:11.759873 31111 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ccfcf7166e04b63be72b810065df6ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:51:11.759987 31111 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ccfcf7166e04b63be72b810065df6ae [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:51:11.760149 31114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:11.745074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41651 (local address 127.8.39.126:46137)
0808 15:51:11.745597 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:11.745620 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:11.745660 (+ 40us) server_negotiation.cc:407] Connection header received
0808 15:51:11.746451 (+ 791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:11.746470 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:11.746938 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:11.747314 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:11.748288 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:11.749460 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:11.750550 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:11.751123 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:11.751301 (+ 178us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:11.754413 (+ 3112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:11.754419 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:11.754435 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:11.754467 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:11.756490 (+ 2023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:11.757102 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:11.757108 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:11.757113 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:11.757243 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:11.757633 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:11.757642 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:11.757643 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:11.758103 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:11.758352 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:11.758777 (+ 425us) server_negotiation.cc:299] Negotiation successful
0808 15:51:11.759068 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":154,"threads_started":1}
I20260808 15:51:11.761106 31111 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ccfcf7166e04b63be72b810065df6ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccfcf7166e04b63be72b810065df6ae" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 46137 } }
I20260808 15:51:11.761490 31111 leader_election.cc:302] T 00000000000000000000000000000000 P 9ccfcf7166e04b63be72b810065df6ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ccfcf7166e04b63be72b810065df6ae; no voters:
I20260808 15:51:11.761828 31111 leader_election.cc:288] T 00000000000000000000000000000000 P 9ccfcf7166e04b63be72b810065df6ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:51:11.761960 31116 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ccfcf7166e04b63be72b810065df6ae [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:51:11.762207 31116 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ccfcf7166e04b63be72b810065df6ae [term 1 LEADER]: Becoming Leader. State: Replica: 9ccfcf7166e04b63be72b810065df6ae, State: Running, Role: LEADER
I20260808 15:51:11.762617 31116 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ccfcf7166e04b63be72b810065df6ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccfcf7166e04b63be72b810065df6ae" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 46137 } }
I20260808 15:51:11.763309 31111 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ccfcf7166e04b63be72b810065df6ae [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:51:11.763823 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:51:11.764726 31117 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ccfcf7166e04b63be72b810065df6ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9ccfcf7166e04b63be72b810065df6ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccfcf7166e04b63be72b810065df6ae" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 46137 } } }
I20260808 15:51:11.764726 31118 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ccfcf7166e04b63be72b810065df6ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ccfcf7166e04b63be72b810065df6ae. Latest consensus state: current_term: 1 leader_uuid: "9ccfcf7166e04b63be72b810065df6ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ccfcf7166e04b63be72b810065df6ae" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 46137 } } }
I20260808 15:51:11.764883 31118 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ccfcf7166e04b63be72b810065df6ae [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:11.764883 31117 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ccfcf7166e04b63be72b810065df6ae [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:11.765377 31128 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:51:11.768901 31128 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:51:11.776482 31114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:11.766502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39637 (local address 127.8.39.126:46137)
0808 15:51:11.766623 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:11.766627 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:11.766959 (+ 332us) server_negotiation.cc:407] Connection header received
0808 15:51:11.767169 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:11.767172 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:11.767221 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:11.767270 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:11.768282 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:11.769117 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:11.770340 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:11.770765 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:11.771002 (+ 237us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:11.772526 (+ 1524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:11.772530 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:11.772534 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:11.772573 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:11.774190 (+ 1617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:11.774917 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:11.774921 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:11.774923 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:11.775024 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:11.775454 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:11.775458 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:11.775460 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:11.775705 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:11.775868 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:11.776193 (+ 325us) server_negotiation.cc:299] Negotiation successful
0808 15:51:11.776307 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 15:51:11.776842 31128 catalog_manager.cc:1347] Generated new cluster ID: 45c9cd0f08a74eadbe1b63e0c317a4b4
I20260808 15:51:11.776921 31128 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:51:11.796511 31128 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:51:11.797891 31128 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:51:11.804469 31128 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9ccfcf7166e04b63be72b810065df6ae: Generated new TSK 0
I20260808 15:51:11.805301 31128 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:51:11.813633 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 31037
W20260808 15:51:11.820952 31021 connection.cc:535] client connection to 127.8.39.126:46137 recv error: Network error: failed to read from TLS socket (remote: 127.8.39.126:46137): Connection reset by peer (error 104)
2026-08-08T15:51:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1583 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:51:11 dist-test-slave-8tdl krb5kdc[31143](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:51:11 dist-test-slave-8tdl krb5kdc[31143](info): set up 2 sockets
Aug 08 15:51:11 dist-test-slave-8tdl krb5kdc[31143](info): commencing operation
krb5kdc: starting...
W20260808 15:51:12.968384 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:51:13 dist-test-slave-8tdl krb5kdc[31143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:51:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:51:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:51:13.111074 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:37289
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:44477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:37289
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:51:13.229672 31159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:51:13.229974 31159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:51:13.230018 31159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:51:13.234669 31159 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:51:13.234795 31159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:51:13.234817 31159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:51:13.234866 31159 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:51:13.234951 31159 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:51:13.241537 31159 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:44477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:37289
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:37289
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:51:13.242825 31159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:51:13.243930 31159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:51:13.253430 31165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:13.253441 31167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:13.253441 31169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:13.253729 31159 server_base.cc:1034] running on GCE node
I20260808 15:51:13.254355 31159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:51:13.255668 31159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:51:13.256834 31159 hybrid_clock.cc:648] HybridClock initialized: now 1786204273256799 us; error 55 us; skew 500 ppm
Aug 08 15:51:13 dist-test-slave-8tdl krb5kdc[31143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204273, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:51:13.264658 31159 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:51:13.265805 31159 webserver.cc:460] Webserver started at http://127.8.39.126:43109/ using document root <none> and password file <none>
I20260808 15:51:13.266448 31159 fs_manager.cc:359] Metadata directory not provided
I20260808 15:51:13.266548 31159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:51:13.266860 31159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:51:13.269112 31159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "24c1a532ad544e10aafc041c354a6241"
format_stamp: "Formatted at 2026-08-08 15:51:13 on dist-test-slave-8tdl"
server_key: "297fbf82fc0330cd6766f44596002c70"
server_key_iv: "b4f9a7f7e863d0e7309908a111312c20"
server_key_version: "encryptionkey@0"
I20260808 15:51:13.269740 31159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "24c1a532ad544e10aafc041c354a6241"
format_stamp: "Formatted at 2026-08-08 15:51:13 on dist-test-slave-8tdl"
server_key: "297fbf82fc0330cd6766f44596002c70"
server_key_iv: "b4f9a7f7e863d0e7309908a111312c20"
server_key_version: "encryptionkey@0"
I20260808 15:51:13.273888 31159 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 15:51:13.276767 31176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:51:13.278273 31159 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:51:13.278446 31159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "24c1a532ad544e10aafc041c354a6241"
format_stamp: "Formatted at 2026-08-08 15:51:13 on dist-test-slave-8tdl"
server_key: "297fbf82fc0330cd6766f44596002c70"
server_key_iv: "b4f9a7f7e863d0e7309908a111312c20"
server_key_version: "encryptionkey@0"
I20260808 15:51:13.278579 31159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:51:13.291474 31159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:51:13.295231 31159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:51:13.295471 31159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:51:13.304522 31159 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:37289
I20260808 15:51:13.304562 31229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:37289 every 8 connection(s)
I20260808 15:51:13.305637 31159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:51:13.308871 31230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:51:13.309571 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 31159
I20260808 15:51:13.309721 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:51:13.310029 8349 external_mini_cluster.cc:1428] Setting key 035595a8d6291ae74d4cde6fbc2a065a
I20260808 15:51:13.315533 31230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24c1a532ad544e10aafc041c354a6241: Bootstrap starting.
I20260808 15:51:13.318037 31230 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 24c1a532ad544e10aafc041c354a6241: Neither blocks nor log segments found. Creating new log.
I20260808 15:51:13.318892 31230 log.cc:824] T 00000000000000000000000000000000 P 24c1a532ad544e10aafc041c354a6241: Log is configured to *not* fsync() on all Append() calls
I20260808 15:51:13.320350 31233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:13.311699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43603 (local address 127.8.39.126:37289)
0808 15:51:13.312184 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:13.312201 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:13.312242 (+ 41us) server_negotiation.cc:407] Connection header received
0808 15:51:13.312967 (+ 725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:13.312986 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:13.313359 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:13.313737 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:13.314186 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:13.315416 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:13.316511 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:13.317031 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:13.317220 (+ 189us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:13.318280 (+ 1060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:13.318286 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:13.318301 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:51:13.318796 (+ 495us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:13.318863 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:51:13.318889 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:13.319050 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:13.319251 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 15:51:13.319412 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":143,"threads_started":1}
I20260808 15:51:13.321314 31230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24c1a532ad544e10aafc041c354a6241: No bootstrap required, opened a new log
I20260808 15:51:13.323678 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:51:13.325753 31230 raft_consensus.cc:348] T 00000000000000000000000000000000 P 24c1a532ad544e10aafc041c354a6241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24c1a532ad544e10aafc041c354a6241" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 37289 } }
I20260808 15:51:13.326067 31230 raft_consensus.cc:374] T 00000000000000000000000000000000 P 24c1a532ad544e10aafc041c354a6241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:51:13.326134 31230 raft_consensus.cc:729] T 00000000000000000000000000000000 P 24c1a532ad544e10aafc041c354a6241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24c1a532ad544e10aafc041c354a6241, State: Initialized, Role: FOLLOWER
I20260808 15:51:13.326663 31230 consensus_queue.cc:260] T 00000000000000000000000000000000 P 24c1a532ad544e10aafc041c354a6241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24c1a532ad544e10aafc041c354a6241" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 37289 } }
I20260808 15:51:13.326874 31230 raft_consensus.cc:388] T 00000000000000000000000000000000 P 24c1a532ad544e10aafc041c354a6241 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:51:13.326951 31230 raft_consensus.cc:482] T 00000000000000000000000000000000 P 24c1a532ad544e10aafc041c354a6241 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:51:13.327056 31230 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 24c1a532ad544e10aafc041c354a6241 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:51:13.328094 31230 raft_consensus.cc:504] T 00000000000000000000000000000000 P 24c1a532ad544e10aafc041c354a6241 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24c1a532ad544e10aafc041c354a6241" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 37289 } }
I20260808 15:51:13.328465 31230 leader_election.cc:302] T 00000000000000000000000000000000 P 24c1a532ad544e10aafc041c354a6241 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 24c1a532ad544e10aafc041c354a6241; no voters:
I20260808 15:51:13.328821 31230 leader_election.cc:288] T 00000000000000000000000000000000 P 24c1a532ad544e10aafc041c354a6241 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:51:13.328912 31243 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 24c1a532ad544e10aafc041c354a6241 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:51:13.329087 31243 raft_consensus.cc:686] T 00000000000000000000000000000000 P 24c1a532ad544e10aafc041c354a6241 [term 1 LEADER]: Becoming Leader. State: Replica: 24c1a532ad544e10aafc041c354a6241, State: Running, Role: LEADER
I20260808 15:51:13.329392 31243 consensus_queue.cc:237] T 00000000000000000000000000000000 P 24c1a532ad544e10aafc041c354a6241 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24c1a532ad544e10aafc041c354a6241" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 37289 } }
I20260808 15:51:13.330216 31230 sys_catalog.cc:564] T 00000000000000000000000000000000 P 24c1a532ad544e10aafc041c354a6241 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:51:13.330775 31233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:13.325942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41243 (local address 127.8.39.126:37289)
0808 15:51:13.326100 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:13.326105 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:13.326259 (+ 154us) server_negotiation.cc:407] Connection header received
0808 15:51:13.326409 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:13.326412 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:13.326466 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:13.326556 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:13.326892 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:13.327583 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:13.328546 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:13.328972 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:13.329086 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:13.330137 (+ 1051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:13.330141 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:13.330144 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:51:13.330159 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:13.330195 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:51:13.330207 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:13.330312 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:13.330525 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 15:51:13.330568 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 15:51:13.330730 31243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24c1a532ad544e10aafc041c354a6241 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "24c1a532ad544e10aafc041c354a6241" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24c1a532ad544e10aafc041c354a6241" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 37289 } } }
I20260808 15:51:13.330879 31243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24c1a532ad544e10aafc041c354a6241 [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:13.331110 31243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24c1a532ad544e10aafc041c354a6241 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 24c1a532ad544e10aafc041c354a6241. Latest consensus state: current_term: 1 leader_uuid: "24c1a532ad544e10aafc041c354a6241" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24c1a532ad544e10aafc041c354a6241" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 37289 } } }
I20260808 15:51:13.331211 31243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24c1a532ad544e10aafc041c354a6241 [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:13.331326 31247 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:51:13.334995 31247 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:51:13.341766 31247 catalog_manager.cc:1347] Generated new cluster ID: b39716e7bee0460f96908048d514be38
I20260808 15:51:13.341846 31247 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:51:13.360787 31247 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:51:13.361802 31247 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:51:13.373272 31247 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 24c1a532ad544e10aafc041c354a6241: Generated new TSK 0
I20260808 15:51:13.374181 31247 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:51:13.386307 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 31159
W20260808 15:51:13.393612 31141 connection.cc:535] client connection to 127.8.39.126:37289 recv error: Network error: failed to read from TLS socket (remote: 127.8.39.126:37289): Connection reset by peer (error 104)
2026-08-08T15:51:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1572 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:51:13 dist-test-slave-8tdl krb5kdc[31266](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:51:13 dist-test-slave-8tdl krb5kdc[31266](info): set up 2 sockets
Aug 08 15:51:13 dist-test-slave-8tdl krb5kdc[31266](info): commencing operation
krb5kdc: starting...
W20260808 15:51:14.493026 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.084s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:51:14 dist-test-slave-8tdl krb5kdc[31266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204274, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:51:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:51:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:51:14.633637 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:45487
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:34277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:45487
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:51:14.750777 31279 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:51:14.751139 31279 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:51:14.751226 31279 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:51:14.755492 31279 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:51:14.755611 31279 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:51:14.755652 31279 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:51:14.755687 31279 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:51:14.755724 31279 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:51:14.761500 31279 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:34277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:45487
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:45487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31279
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:51:14.762913 31279 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:51:14.764058 31279 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:51:14.773844 31285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:14.773856 31288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:14.773936 31279 server_base.cc:1034] running on GCE node
W20260808 15:51:14.773864 31286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:14.774869 31279 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:51:14.776198 31279 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:51:14.777442 31279 hybrid_clock.cc:648] HybridClock initialized: now 1786204274777403 us; error 55 us; skew 500 ppm
Aug 08 15:51:14 dist-test-slave-8tdl krb5kdc[31266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204274, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:51:14.780838 31279 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:51:14.781898 31279 webserver.cc:460] Webserver started at http://127.8.39.126:34061/ using document root <none> and password file <none>
I20260808 15:51:14.782536 31279 fs_manager.cc:359] Metadata directory not provided
I20260808 15:51:14.782634 31279 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:51:14.782909 31279 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:51:14.785245 31279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "b91cd6f0b42a411f9a6451089628bbef"
format_stamp: "Formatted at 2026-08-08 15:51:14 on dist-test-slave-8tdl"
server_key: "0a98527d476b734e587807644a589a7a"
server_key_iv: "12a3e21b38b6dbd7d7fe3f9bb7e2d75d"
server_key_version: "encryptionkey@0"
I20260808 15:51:14.785926 31279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "b91cd6f0b42a411f9a6451089628bbef"
format_stamp: "Formatted at 2026-08-08 15:51:14 on dist-test-slave-8tdl"
server_key: "0a98527d476b734e587807644a589a7a"
server_key_iv: "12a3e21b38b6dbd7d7fe3f9bb7e2d75d"
server_key_version: "encryptionkey@0"
I20260808 15:51:14.790549 31279 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 15:51:14.793773 31296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:51:14.795418 31279 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:51:14.795599 31279 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "b91cd6f0b42a411f9a6451089628bbef"
format_stamp: "Formatted at 2026-08-08 15:51:14 on dist-test-slave-8tdl"
server_key: "0a98527d476b734e587807644a589a7a"
server_key_iv: "12a3e21b38b6dbd7d7fe3f9bb7e2d75d"
server_key_version: "encryptionkey@0"
I20260808 15:51:14.795737 31279 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:51:14.800792 31279 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:51:14.804388 31279 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:51:14.804613 31279 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:51:14.812237 31279 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:45487
I20260808 15:51:14.812268 31350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:45487 every 8 connection(s)
I20260808 15:51:14.813231 31279 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:51:14.816282 31352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:51:14.821622 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 31279
I20260808 15:51:14.821795 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:51:14.822070 8349 external_mini_cluster.cc:1428] Setting key 20b278576d41596472522d4e6072b050
I20260808 15:51:14.822474 31352 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b91cd6f0b42a411f9a6451089628bbef: Bootstrap starting.
I20260808 15:51:14.825268 31352 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b91cd6f0b42a411f9a6451089628bbef: Neither blocks nor log segments found. Creating new log.
I20260808 15:51:14.826242 31352 log.cc:824] T 00000000000000000000000000000000 P b91cd6f0b42a411f9a6451089628bbef: Log is configured to *not* fsync() on all Append() calls
I20260808 15:51:14.828109 31355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:14.823590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55243 (local address 127.8.39.126:45487)
0808 15:51:14.824035 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:14.824055 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:14.824098 (+ 43us) server_negotiation.cc:407] Connection header received
0808 15:51:14.824961 (+ 863us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:14.824986 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:14.825369 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:14.825786 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:14.826574 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:14.826579 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:14.826595 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:51:14.826611 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:14.826711 (+ 100us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:51:14.826745 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:14.826853 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:14.826997 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 15:51:14.827174 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":117,"threads_started":1}
I20260808 15:51:14.828743 31352 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b91cd6f0b42a411f9a6451089628bbef: No bootstrap required, opened a new log
I20260808 15:51:14.831017 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:51:14.832914 31352 raft_consensus.cc:348] T 00000000000000000000000000000000 P b91cd6f0b42a411f9a6451089628bbef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91cd6f0b42a411f9a6451089628bbef" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45487 } }
I20260808 15:51:14.833230 31352 raft_consensus.cc:374] T 00000000000000000000000000000000 P b91cd6f0b42a411f9a6451089628bbef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:51:14.833283 31352 raft_consensus.cc:729] T 00000000000000000000000000000000 P b91cd6f0b42a411f9a6451089628bbef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b91cd6f0b42a411f9a6451089628bbef, State: Initialized, Role: FOLLOWER
I20260808 15:51:14.833747 31352 consensus_queue.cc:260] T 00000000000000000000000000000000 P b91cd6f0b42a411f9a6451089628bbef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91cd6f0b42a411f9a6451089628bbef" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45487 } }
I20260808 15:51:14.833901 31352 raft_consensus.cc:388] T 00000000000000000000000000000000 P b91cd6f0b42a411f9a6451089628bbef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:51:14.833993 31352 raft_consensus.cc:482] T 00000000000000000000000000000000 P b91cd6f0b42a411f9a6451089628bbef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:51:14.834101 31352 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b91cd6f0b42a411f9a6451089628bbef [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:51:14.835000 31355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:14.833156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59379 (local address 127.8.39.126:45487)
0808 15:51:14.833295 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:14.833301 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:14.833540 (+ 239us) server_negotiation.cc:407] Connection header received
0808 15:51:14.833686 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:14.833689 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:14.833730 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:14.833811 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:14.834562 (+ 751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:14.834566 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:14.834568 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:51:14.834580 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:14.834610 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:51:14.834626 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:14.834739 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:14.834836 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 15:51:14.834877 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 15:51:14.835340 31352 raft_consensus.cc:504] T 00000000000000000000000000000000 P b91cd6f0b42a411f9a6451089628bbef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91cd6f0b42a411f9a6451089628bbef" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45487 } }
I20260808 15:51:14.835695 31352 leader_election.cc:302] T 00000000000000000000000000000000 P b91cd6f0b42a411f9a6451089628bbef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b91cd6f0b42a411f9a6451089628bbef; no voters:
I20260808 15:51:14.836110 31352 leader_election.cc:288] T 00000000000000000000000000000000 P b91cd6f0b42a411f9a6451089628bbef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:51:14.836163 31362 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b91cd6f0b42a411f9a6451089628bbef [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:51:14.836342 31362 raft_consensus.cc:686] T 00000000000000000000000000000000 P b91cd6f0b42a411f9a6451089628bbef [term 1 LEADER]: Becoming Leader. State: Replica: b91cd6f0b42a411f9a6451089628bbef, State: Running, Role: LEADER
I20260808 15:51:14.836658 31362 consensus_queue.cc:237] T 00000000000000000000000000000000 P b91cd6f0b42a411f9a6451089628bbef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91cd6f0b42a411f9a6451089628bbef" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45487 } }
I20260808 15:51:14.837411 31352 sys_catalog.cc:564] T 00000000000000000000000000000000 P b91cd6f0b42a411f9a6451089628bbef [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:51:14.838431 31364 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91cd6f0b42a411f9a6451089628bbef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b91cd6f0b42a411f9a6451089628bbef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91cd6f0b42a411f9a6451089628bbef" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45487 } } }
I20260808 15:51:14.838586 31364 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91cd6f0b42a411f9a6451089628bbef [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:14.838961 31372 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:51:14.842281 31372 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:51:14.838919 31363 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91cd6f0b42a411f9a6451089628bbef [sys.catalog]: SysCatalogTable state changed. Reason: New leader b91cd6f0b42a411f9a6451089628bbef. Latest consensus state: current_term: 1 leader_uuid: "b91cd6f0b42a411f9a6451089628bbef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b91cd6f0b42a411f9a6451089628bbef" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45487 } } }
I20260808 15:51:14.843127 31363 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91cd6f0b42a411f9a6451089628bbef [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:14.848539 31372 catalog_manager.cc:1347] Generated new cluster ID: 330483bce5a64cdda34aa766ce5957a9
I20260808 15:51:14.848629 31372 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:51:14.854780 31372 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:51:14.855202 31372 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:51:14.872866 31372 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b91cd6f0b42a411f9a6451089628bbef: Generated new TSK 0
I20260808 15:51:14.873844 31372 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:51:14.886325 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 31279
2026-08-08T15:51:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1499 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:51:14 dist-test-slave-8tdl krb5kdc[31385](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:51:14 dist-test-slave-8tdl krb5kdc[31385](info): set up 2 sockets
Aug 08 15:51:14 dist-test-slave-8tdl krb5kdc[31385](info): commencing operation
krb5kdc: starting...
W20260808 15:51:15.976500 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.068s user 0.005s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:51:16 dist-test-slave-8tdl krb5kdc[31385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204276, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:51:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:51:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:51:16.114063 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:45601
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:46757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:45601
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:51:16.247498 31399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:51:16.247956 31399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:51:16.248045 31399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:51:16.253158 31399 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:51:16.253291 31399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:51:16.253336 31399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:51:16.253378 31399 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:51:16.253413 31399 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:51:16.259512 31399 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:46757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:45601
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:45601
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31399
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:51:16.260743 31399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:51:16.261963 31399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:51:16.271111 31407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:16.271077 31404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:16.271066 31405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:16.271399 31399 server_base.cc:1034] running on GCE node
I20260808 15:51:16.272161 31399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:51:16.273479 31399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:51:16.274721 31399 hybrid_clock.cc:648] HybridClock initialized: now 1786204276274636 us; error 46 us; skew 500 ppm
Aug 08 15:51:16 dist-test-slave-8tdl krb5kdc[31385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204276, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:51:16.277990 31399 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:51:16.279232 31399 webserver.cc:460] Webserver started at http://127.8.39.126:36539/ using document root <none> and password file <none>
I20260808 15:51:16.279883 31399 fs_manager.cc:359] Metadata directory not provided
I20260808 15:51:16.279990 31399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:51:16.280251 31399 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:51:16.282609 31399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "dd100f6e0c5e48ea9743660b60453e5f"
format_stamp: "Formatted at 2026-08-08 15:51:16 on dist-test-slave-8tdl"
server_key: "5dcb9a30e5cd0c3ad8816ae38ff7c382"
server_key_iv: "a95de04b167de33a709517b03dcb59b9"
server_key_version: "encryptionkey@0"
I20260808 15:51:16.283370 31399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "dd100f6e0c5e48ea9743660b60453e5f"
format_stamp: "Formatted at 2026-08-08 15:51:16 on dist-test-slave-8tdl"
server_key: "5dcb9a30e5cd0c3ad8816ae38ff7c382"
server_key_iv: "a95de04b167de33a709517b03dcb59b9"
server_key_version: "encryptionkey@0"
I20260808 15:51:16.287945 31399 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 15:51:16.291015 31416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:51:16.292440 31399 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:51:16.292618 31399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "dd100f6e0c5e48ea9743660b60453e5f"
format_stamp: "Formatted at 2026-08-08 15:51:16 on dist-test-slave-8tdl"
server_key: "5dcb9a30e5cd0c3ad8816ae38ff7c382"
server_key_iv: "a95de04b167de33a709517b03dcb59b9"
server_key_version: "encryptionkey@0"
I20260808 15:51:16.292755 31399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:51:16.303105 31399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:51:16.306420 31399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:51:16.306638 31399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:51:16.314514 31399 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:45601
I20260808 15:51:16.314582 31471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:45601 every 8 connection(s)
I20260808 15:51:16.315605 31399 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:51:16.318631 31472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:51:16.323215 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 31399
I20260808 15:51:16.323391 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:51:16.323700 8349 external_mini_cluster.cc:1428] Setting key 77e1b01acfe72610f2ab40c9a5dde9a8
I20260808 15:51:16.325521 31472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd100f6e0c5e48ea9743660b60453e5f: Bootstrap starting.
I20260808 15:51:16.328562 31472 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd100f6e0c5e48ea9743660b60453e5f: Neither blocks nor log segments found. Creating new log.
I20260808 15:51:16.329433 31472 log.cc:824] T 00000000000000000000000000000000 P dd100f6e0c5e48ea9743660b60453e5f: Log is configured to *not* fsync() on all Append() calls
I20260808 15:51:16.332167 31472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd100f6e0c5e48ea9743660b60453e5f: No bootstrap required, opened a new log
Aug 08 15:51:16 dist-test-slave-8tdl krb5kdc[31385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204276, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:51:16.336876 31472 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd100f6e0c5e48ea9743660b60453e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd100f6e0c5e48ea9743660b60453e5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45601 } }
I20260808 15:51:16.337231 31472 raft_consensus.cc:374] T 00000000000000000000000000000000 P dd100f6e0c5e48ea9743660b60453e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:51:16.337329 31472 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd100f6e0c5e48ea9743660b60453e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd100f6e0c5e48ea9743660b60453e5f, State: Initialized, Role: FOLLOWER
I20260808 15:51:16.338023 31472 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd100f6e0c5e48ea9743660b60453e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd100f6e0c5e48ea9743660b60453e5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45601 } }
I20260808 15:51:16.338234 31472 raft_consensus.cc:388] T 00000000000000000000000000000000 P dd100f6e0c5e48ea9743660b60453e5f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:51:16.338343 31472 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd100f6e0c5e48ea9743660b60453e5f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:51:16.338470 31472 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd100f6e0c5e48ea9743660b60453e5f [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:51:16.339977 31472 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd100f6e0c5e48ea9743660b60453e5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd100f6e0c5e48ea9743660b60453e5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45601 } }
I20260808 15:51:16.340487 31472 leader_election.cc:302] T 00000000000000000000000000000000 P dd100f6e0c5e48ea9743660b60453e5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd100f6e0c5e48ea9743660b60453e5f; no voters:
I20260808 15:51:16.340571 31475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:16.325298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37187 (local address 127.8.39.126:45601)
0808 15:51:16.325762 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:16.325778 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:16.325816 (+ 38us) server_negotiation.cc:407] Connection header received
0808 15:51:16.326486 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:16.326504 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:16.326928 (+ 424us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:16.327223 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:16.328282 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:16.329412 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:16.330614 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:16.331174 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:16.331298 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:16.334462 (+ 3164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:16.334468 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:16.334489 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:16.334528 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:16.336613 (+ 2085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:16.337199 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:16.337204 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:16.337210 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:16.337411 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:16.337875 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:16.337878 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:16.337880 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:16.338538 (+ 658us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:16.338811 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:16.339195 (+ 384us) server_negotiation.cc:299] Negotiation successful
0808 15:51:16.339586 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":158,"threads_started":1}
I20260808 15:51:16.340960 31472 leader_election.cc:288] T 00000000000000000000000000000000 P dd100f6e0c5e48ea9743660b60453e5f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:51:16.341102 31477 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd100f6e0c5e48ea9743660b60453e5f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:51:16.341378 31477 raft_consensus.cc:686] T 00000000000000000000000000000000 P dd100f6e0c5e48ea9743660b60453e5f [term 1 LEADER]: Becoming Leader. State: Replica: dd100f6e0c5e48ea9743660b60453e5f, State: Running, Role: LEADER
I20260808 15:51:16.341779 31477 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd100f6e0c5e48ea9743660b60453e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd100f6e0c5e48ea9743660b60453e5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45601 } }
I20260808 15:51:16.342408 31472 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd100f6e0c5e48ea9743660b60453e5f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:51:16.343778 31478 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd100f6e0c5e48ea9743660b60453e5f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dd100f6e0c5e48ea9743660b60453e5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd100f6e0c5e48ea9743660b60453e5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45601 } } }
I20260808 15:51:16.343798 31479 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd100f6e0c5e48ea9743660b60453e5f [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd100f6e0c5e48ea9743660b60453e5f. Latest consensus state: current_term: 1 leader_uuid: "dd100f6e0c5e48ea9743660b60453e5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd100f6e0c5e48ea9743660b60453e5f" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45601 } } }
I20260808 15:51:16.343946 31479 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd100f6e0c5e48ea9743660b60453e5f [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:16.343946 31478 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd100f6e0c5e48ea9743660b60453e5f [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:16.344542 31487 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:51:16.345064 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:51:16.348031 31487 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:51:16.355159 31487 catalog_manager.cc:1347] Generated new cluster ID: b2ceef9b00df46c99258377520670a4b
I20260808 15:51:16.355239 31487 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:51:16.359583 31475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:16.348137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55115 (local address 127.8.39.126:45601)
0808 15:51:16.348255 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:16.348260 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:16.348944 (+ 684us) server_negotiation.cc:407] Connection header received
0808 15:51:16.349089 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:16.349092 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:16.349145 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:16.349256 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:16.350312 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:16.351014 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:16.352358 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:16.352704 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:16.352820 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:16.355813 (+ 2993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:16.355817 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:16.355820 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:16.355854 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:16.357687 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:16.358238 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:16.358241 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:16.358243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:16.358323 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:16.358647 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:16.358650 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:16.358652 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:16.358876 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:16.359068 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:16.359294 (+ 226us) server_negotiation.cc:299] Negotiation successful
0808 15:51:16.359420 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 15:51:16.366998 31487 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:51:16.368418 31487 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:51:16.376199 31487 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dd100f6e0c5e48ea9743660b60453e5f: Generated new TSK 0
I20260808 15:51:16.377118 31487 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:51:16.381098 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 31399
2026-08-08T15:51:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1496 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:51:16 dist-test-slave-8tdl krb5kdc[31504](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:51:16 dist-test-slave-8tdl krb5kdc[31504](info): set up 2 sockets
Aug 08 15:51:16 dist-test-slave-8tdl krb5kdc[31504](info): commencing operation
krb5kdc: starting...
W20260808 15:51:17.456848 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.052s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:51:17 dist-test-slave-8tdl krb5kdc[31504](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:51:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:51:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:51:17.594170 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:40391
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:42997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:40391
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:51:17.711710 31519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:51:17.712051 31519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:51:17.712143 31519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:51:17.716310 31519 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:51:17.716432 31519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:51:17.716471 31519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:51:17.716514 31519 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:51:17.716550 31519 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:51:17.722432 31519 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:42997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:40391
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:40391
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:51:17.724136 31519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:51:17.725657 31519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:51:17.736127 31525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:17.736115 31528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:17.736253 31526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:17.736749 31519 server_base.cc:1034] running on GCE node
I20260808 15:51:17.737391 31519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:51:17.739055 31519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:51:17.740309 31519 hybrid_clock.cc:648] HybridClock initialized: now 1786204277740266 us; error 54 us; skew 500 ppm
Aug 08 15:51:17 dist-test-slave-8tdl krb5kdc[31504](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204277, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:51:17.743736 31519 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:51:17.744911 31519 webserver.cc:460] Webserver started at http://127.8.39.126:44419/ using document root <none> and password file <none>
I20260808 15:51:17.745546 31519 fs_manager.cc:359] Metadata directory not provided
I20260808 15:51:17.745652 31519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:51:17.745932 31519 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:51:17.748378 31519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "59664cf884414816b9739f3892db966d"
format_stamp: "Formatted at 2026-08-08 15:51:17 on dist-test-slave-8tdl"
server_key: "ee975b39554f40eee4c39e6ae01a27c0"
server_key_iv: "73460213cf6631f11467a6531465a71f"
server_key_version: "encryptionkey@0"
I20260808 15:51:17.749114 31519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "59664cf884414816b9739f3892db966d"
format_stamp: "Formatted at 2026-08-08 15:51:17 on dist-test-slave-8tdl"
server_key: "ee975b39554f40eee4c39e6ae01a27c0"
server_key_iv: "73460213cf6631f11467a6531465a71f"
server_key_version: "encryptionkey@0"
I20260808 15:51:17.753515 31519 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 15:51:17.756620 31536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:51:17.758148 31519 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:51:17.758374 31519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "59664cf884414816b9739f3892db966d"
format_stamp: "Formatted at 2026-08-08 15:51:17 on dist-test-slave-8tdl"
server_key: "ee975b39554f40eee4c39e6ae01a27c0"
server_key_iv: "73460213cf6631f11467a6531465a71f"
server_key_version: "encryptionkey@0"
I20260808 15:51:17.758530 31519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:51:17.773222 31519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:51:17.776930 31519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:51:17.777171 31519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:51:17.784802 31519 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:40391
I20260808 15:51:17.784900 31590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:40391 every 8 connection(s)
I20260808 15:51:17.785897 31519 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:51:17.789172 31592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:51:17.792202 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 31519
I20260808 15:51:17.792335 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:51:17.792649 8349 external_mini_cluster.cc:1428] Setting key c4bd71137f656ac4cee9b440ca300dea
I20260808 15:51:17.796316 31592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59664cf884414816b9739f3892db966d: Bootstrap starting.
I20260808 15:51:17.799312 31592 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 59664cf884414816b9739f3892db966d: Neither blocks nor log segments found. Creating new log.
I20260808 15:51:17.800283 31592 log.cc:824] T 00000000000000000000000000000000 P 59664cf884414816b9739f3892db966d: Log is configured to *not* fsync() on all Append() calls
I20260808 15:51:17.803179 31592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59664cf884414816b9739f3892db966d: No bootstrap required, opened a new log
I20260808 15:51:17.804195 31595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:17.794287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38627 (local address 127.8.39.126:40391)
0808 15:51:17.794816 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:17.794854 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:17.794906 (+ 52us) server_negotiation.cc:407] Connection header received
0808 15:51:17.795818 (+ 912us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:17.795842 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:17.796343 (+ 501us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:17.796746 (+ 403us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:17.797212 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:17.798761 (+ 1549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:17.799881 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:17.800613 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:17.800797 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:17.801812 (+ 1015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:17.801818 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:17.801837 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:51:17.802391 (+ 554us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:17.802468 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:51:17.802498 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:17.802604 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:17.802860 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 15:51:17.803106 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":130,"threads_started":1}
I20260808 15:51:17.807410 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:51:17.807483 31592 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59664cf884414816b9739f3892db966d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59664cf884414816b9739f3892db966d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 40391 } }
I20260808 15:51:17.807782 31592 raft_consensus.cc:374] T 00000000000000000000000000000000 P 59664cf884414816b9739f3892db966d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:51:17.807869 31592 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59664cf884414816b9739f3892db966d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59664cf884414816b9739f3892db966d, State: Initialized, Role: FOLLOWER
I20260808 15:51:17.808364 31592 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59664cf884414816b9739f3892db966d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59664cf884414816b9739f3892db966d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 40391 } }
I20260808 15:51:17.808498 31592 raft_consensus.cc:388] T 00000000000000000000000000000000 P 59664cf884414816b9739f3892db966d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:51:17.808589 31592 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59664cf884414816b9739f3892db966d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:51:17.808709 31592 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59664cf884414816b9739f3892db966d [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:51:17.809857 31592 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59664cf884414816b9739f3892db966d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59664cf884414816b9739f3892db966d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 40391 } }
I20260808 15:51:17.810364 31592 leader_election.cc:302] T 00000000000000000000000000000000 P 59664cf884414816b9739f3892db966d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59664cf884414816b9739f3892db966d; no voters:
I20260808 15:51:17.810797 31592 leader_election.cc:288] T 00000000000000000000000000000000 P 59664cf884414816b9739f3892db966d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:51:17.810938 31602 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59664cf884414816b9739f3892db966d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:51:17.811216 31602 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59664cf884414816b9739f3892db966d [term 1 LEADER]: Becoming Leader. State: Replica: 59664cf884414816b9739f3892db966d, State: Running, Role: LEADER
I20260808 15:51:17.811625 31602 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59664cf884414816b9739f3892db966d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59664cf884414816b9739f3892db966d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 40391 } }
I20260808 15:51:17.812206 31592 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59664cf884414816b9739f3892db966d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:51:17.812925 31602 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59664cf884414816b9739f3892db966d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59664cf884414816b9739f3892db966d. Latest consensus state: current_term: 1 leader_uuid: "59664cf884414816b9739f3892db966d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59664cf884414816b9739f3892db966d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 40391 } } }
I20260808 15:51:17.813134 31602 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59664cf884414816b9739f3892db966d [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:17.813378 31604 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59664cf884414816b9739f3892db966d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "59664cf884414816b9739f3892db966d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59664cf884414816b9739f3892db966d" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 40391 } } }
I20260808 15:51:17.813570 31604 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59664cf884414816b9739f3892db966d [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:17.813604 31611 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:51:17.815044 31595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:17.809861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38633 (local address 127.8.39.126:40391)
0808 15:51:17.810067 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:17.810072 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:17.810127 (+ 55us) server_negotiation.cc:407] Connection header received
0808 15:51:17.810263 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:17.810266 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:17.810318 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:17.810413 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:17.810726 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:17.811516 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:17.812638 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:17.813019 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:17.813157 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:17.814340 (+ 1183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:17.814344 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:17.814347 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:51:17.814366 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:17.814395 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:51:17.814408 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:17.814478 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:17.814818 (+ 340us) server_negotiation.cc:299] Negotiation successful
0808 15:51:17.814900 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260808 15:51:17.817107 31611 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:51:17.822950 31611 catalog_manager.cc:1347] Generated new cluster ID: 1cc97b76ed544ae48414e5a0b77865d3
I20260808 15:51:17.823065 31611 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:51:17.829382 31611 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:51:17.830353 31611 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:51:17.834403 31611 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 59664cf884414816b9739f3892db966d: Generated new TSK 0
I20260808 15:51:17.835168 31611 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:51:17.840329 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 31519
2026-08-08T15:51:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1456 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:51:17 dist-test-slave-8tdl krb5kdc[31624](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:51:17 dist-test-slave-8tdl krb5kdc[31624](info): set up 2 sockets
Aug 08 15:51:17 dist-test-slave-8tdl krb5kdc[31624](info): commencing operation
krb5kdc: starting...
W20260808 15:51:18.912298 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.051s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:51:18 dist-test-slave-8tdl krb5kdc[31624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:51:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:51:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:51:19.049757 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:33183
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:36807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:33183
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:51:19.164868 31637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:51:19.165207 31637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:51:19.165290 31637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:51:19.169386 31637 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:51:19.169485 31637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:51:19.169518 31637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:51:19.169545 31637 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:51:19.169574 31637 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:51:19.175184 31637 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:36807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:33183
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:33183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31637
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:51:19.176340 31637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:51:19.177388 31637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 15:51:19.186380 31637 server_base.cc:1034] running on GCE node
W20260808 15:51:19.186328 31645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:19.186326 31642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:19.186326 31643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:19.187341 31637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:51:19.188534 31637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:51:19.189709 31637 hybrid_clock.cc:648] HybridClock initialized: now 1786204279189690 us; error 36 us; skew 500 ppm
Aug 08 15:51:19 dist-test-slave-8tdl krb5kdc[31624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204279, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:51:19.200013 31637 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:51:19.201052 31637 webserver.cc:460] Webserver started at http://127.8.39.126:34811/ using document root <none> and password file <none>
I20260808 15:51:19.201609 31637 fs_manager.cc:359] Metadata directory not provided
I20260808 15:51:19.201670 31637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:51:19.201846 31637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:51:19.204067 31637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "37c6579637254f7f8f90ea5437b250e6"
format_stamp: "Formatted at 2026-08-08 15:51:19 on dist-test-slave-8tdl"
server_key: "c457d7fb1c7e6cb3dd82c4927548c40c"
server_key_iv: "dfb4200c4489ac8e764f27ad6c78b207"
server_key_version: "encryptionkey@0"
I20260808 15:51:19.204620 31637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "37c6579637254f7f8f90ea5437b250e6"
format_stamp: "Formatted at 2026-08-08 15:51:19 on dist-test-slave-8tdl"
server_key: "c457d7fb1c7e6cb3dd82c4927548c40c"
server_key_iv: "dfb4200c4489ac8e764f27ad6c78b207"
server_key_version: "encryptionkey@0"
I20260808 15:51:19.208470 31637 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 15:51:19.210880 31653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:51:19.212131 31637 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:51:19.212275 31637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "37c6579637254f7f8f90ea5437b250e6"
format_stamp: "Formatted at 2026-08-08 15:51:19 on dist-test-slave-8tdl"
server_key: "c457d7fb1c7e6cb3dd82c4927548c40c"
server_key_iv: "dfb4200c4489ac8e764f27ad6c78b207"
server_key_version: "encryptionkey@0"
I20260808 15:51:19.212390 31637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:51:19.217096 31637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:51:19.220081 31637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:51:19.220280 31637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:51:19.227557 31637 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:33183
I20260808 15:51:19.227587 31707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:33183 every 8 connection(s)
I20260808 15:51:19.228490 31637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:51:19.231184 31708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:51:19.236699 31708 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37c6579637254f7f8f90ea5437b250e6: Bootstrap starting.
I20260808 15:51:19.237740 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 31637
I20260808 15:51:19.237882 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:51:19.238204 8349 external_mini_cluster.cc:1428] Setting key ee7dfdd136544699f7a8eeb85f62ee26
I20260808 15:51:19.239508 31708 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 37c6579637254f7f8f90ea5437b250e6: Neither blocks nor log segments found. Creating new log.
I20260808 15:51:19.240285 31708 log.cc:824] T 00000000000000000000000000000000 P 37c6579637254f7f8f90ea5437b250e6: Log is configured to *not* fsync() on all Append() calls
I20260808 15:51:19.242326 31708 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37c6579637254f7f8f90ea5437b250e6: No bootstrap required, opened a new log
I20260808 15:51:19.243366 31711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:19.239339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49897 (local address 127.8.39.126:33183)
0808 15:51:19.239821 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:19.239836 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:19.239871 (+ 35us) server_negotiation.cc:407] Connection header received
0808 15:51:19.240603 (+ 732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:19.240643 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:19.241002 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:19.241361 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:19.242145 (+ 784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:19.242149 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:19.242160 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:51:19.242169 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:19.242222 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:51:19.242240 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:19.242362 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:19.242461 (+ 99us) server_negotiation.cc:299] Negotiation successful
0808 15:51:19.242617 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":151,"threads_started":1}
I20260808 15:51:19.246258 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:51:19.246622 31708 raft_consensus.cc:348] T 00000000000000000000000000000000 P 37c6579637254f7f8f90ea5437b250e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37c6579637254f7f8f90ea5437b250e6" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 33183 } }
I20260808 15:51:19.246914 31708 raft_consensus.cc:374] T 00000000000000000000000000000000 P 37c6579637254f7f8f90ea5437b250e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:51:19.247001 31708 raft_consensus.cc:729] T 00000000000000000000000000000000 P 37c6579637254f7f8f90ea5437b250e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37c6579637254f7f8f90ea5437b250e6, State: Initialized, Role: FOLLOWER
I20260808 15:51:19.247463 31708 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37c6579637254f7f8f90ea5437b250e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37c6579637254f7f8f90ea5437b250e6" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 33183 } }
I20260808 15:51:19.247637 31708 raft_consensus.cc:388] T 00000000000000000000000000000000 P 37c6579637254f7f8f90ea5437b250e6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:51:19.247709 31708 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37c6579637254f7f8f90ea5437b250e6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:51:19.247810 31708 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37c6579637254f7f8f90ea5437b250e6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:51:19.248986 31708 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37c6579637254f7f8f90ea5437b250e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37c6579637254f7f8f90ea5437b250e6" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 33183 } }
I20260808 15:51:19.249372 31708 leader_election.cc:302] T 00000000000000000000000000000000 P 37c6579637254f7f8f90ea5437b250e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 37c6579637254f7f8f90ea5437b250e6; no voters:
I20260808 15:51:19.249743 31708 leader_election.cc:288] T 00000000000000000000000000000000 P 37c6579637254f7f8f90ea5437b250e6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:51:19.249850 31718 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 37c6579637254f7f8f90ea5437b250e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:51:19.250118 31718 raft_consensus.cc:686] T 00000000000000000000000000000000 P 37c6579637254f7f8f90ea5437b250e6 [term 1 LEADER]: Becoming Leader. State: Replica: 37c6579637254f7f8f90ea5437b250e6, State: Running, Role: LEADER
I20260808 15:51:19.250342 31711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:19.248533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35743 (local address 127.8.39.126:33183)
0808 15:51:19.248660 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:19.248665 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:19.248830 (+ 165us) server_negotiation.cc:407] Connection header received
0808 15:51:19.248910 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:19.248915 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:19.248961 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:19.249064 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:19.249854 (+ 790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:19.249857 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:19.249860 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:51:19.249871 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:19.249900 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:51:19.249912 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:19.250004 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:19.250189 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 15:51:19.250229 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 15:51:19.250779 31718 consensus_queue.cc:237] T 00000000000000000000000000000000 P 37c6579637254f7f8f90ea5437b250e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37c6579637254f7f8f90ea5437b250e6" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 33183 } }
I20260808 15:51:19.251226 31708 sys_catalog.cc:564] T 00000000000000000000000000000000 P 37c6579637254f7f8f90ea5437b250e6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:51:19.252457 31719 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37c6579637254f7f8f90ea5437b250e6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "37c6579637254f7f8f90ea5437b250e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37c6579637254f7f8f90ea5437b250e6" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 33183 } } }
I20260808 15:51:19.252592 31719 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37c6579637254f7f8f90ea5437b250e6 [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:19.252955 31720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37c6579637254f7f8f90ea5437b250e6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37c6579637254f7f8f90ea5437b250e6. Latest consensus state: current_term: 1 leader_uuid: "37c6579637254f7f8f90ea5437b250e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37c6579637254f7f8f90ea5437b250e6" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 33183 } } }
I20260808 15:51:19.253064 31727 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:51:19.253063 31720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37c6579637254f7f8f90ea5437b250e6 [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:19.256429 31727 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:51:19.262691 31727 catalog_manager.cc:1347] Generated new cluster ID: 1eef0b77e5f04ed4beaf43d0dcbb6c2d
I20260808 15:51:19.262771 31727 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:51:19.294016 31727 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:51:19.294417 31727 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:51:19.305452 31727 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 37c6579637254f7f8f90ea5437b250e6: Generated new TSK 0
I20260808 15:51:19.306331 31727 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:51:19.317595 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 31637
2026-08-08T15:51:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1478 ms)
[----------] 18 tests from AuthTokenIssuingTest (27301 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:51:19 dist-test-slave-8tdl krb5kdc[31740](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:51:19 dist-test-slave-8tdl krb5kdc[31740](info): set up 2 sockets
Aug 08 15:51:19 dist-test-slave-8tdl krb5kdc[31740](info): commencing operation
krb5kdc: starting...
W20260808 15:51:20.461639 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.122s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:51:20 dist-test-slave-8tdl krb5kdc[31740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204280, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:51:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:51:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:51:20.593779 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:42249
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:46285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:42249,127.8.39.125:40689,127.8.39.124:36897
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:51:20.710299 31754 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 15:51:20.710605 31754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:51:20.710630 31754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:51:20.710695 31754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:51:20.714804 31754 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:51:20.714924 31754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:51:20.714965 31754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:51:20.715025 31754 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:51:20.715065 31754 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:51:20.720935 31754 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:46285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:42249,127.8.39.125:40689,127.8.39.124:36897
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:42249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31754
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:51:20.722107 31754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:51:20.723306 31754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:51:20.732460 31763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:20.732460 31760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:20.732620 31754 server_base.cc:1034] running on GCE node
W20260808 15:51:20.733037 31761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:20.733778 31754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:51:20.735160 31754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:51:20.736349 31754 hybrid_clock.cc:648] HybridClock initialized: now 1786204280736318 us; error 47 us; skew 500 ppm
Aug 08 15:51:20 dist-test-slave-8tdl krb5kdc[31740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204280, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:51:20.739596 31754 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:51:20.740705 31754 webserver.cc:460] Webserver started at http://127.8.39.126:39425/ using document root <none> and password file <none>
I20260808 15:51:20.741331 31754 fs_manager.cc:359] Metadata directory not provided
I20260808 15:51:20.741431 31754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:51:20.741683 31754 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:51:20.744025 31754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "db83b36d9a504005b20e0af46bf56601"
format_stamp: "Formatted at 2026-08-08 15:51:20 on dist-test-slave-8tdl"
server_key: "8e5c0f93283fa4c7c05f96ab0a59b03c"
server_key_iv: "810b512567c0b903accbe34d9a2248b4"
server_key_version: "encryptionkey@0"
I20260808 15:51:20.744671 31754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "db83b36d9a504005b20e0af46bf56601"
format_stamp: "Formatted at 2026-08-08 15:51:20 on dist-test-slave-8tdl"
server_key: "8e5c0f93283fa4c7c05f96ab0a59b03c"
server_key_iv: "810b512567c0b903accbe34d9a2248b4"
server_key_version: "encryptionkey@0"
I20260808 15:51:20.748930 31754 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 15:51:20.751694 31770 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:51:20.753021 31754 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 15:51:20.753176 31754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "db83b36d9a504005b20e0af46bf56601"
format_stamp: "Formatted at 2026-08-08 15:51:20 on dist-test-slave-8tdl"
server_key: "8e5c0f93283fa4c7c05f96ab0a59b03c"
server_key_iv: "810b512567c0b903accbe34d9a2248b4"
server_key_version: "encryptionkey@0"
I20260808 15:51:20.753304 31754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:51:20.784047 31754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:51:20.787721 31754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:51:20.787959 31754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:51:20.795768 31754 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:42249
I20260808 15:51:20.796146 31825 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:42249 every 8 connection(s)
I20260808 15:51:20.796885 31754 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:51:20.799953 31826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:51:20.801856 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 31754
I20260808 15:51:20.801963 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:51:20.802321 8349 external_mini_cluster.cc:1428] Setting key a47625b902158eedea75bc8120739a16
I20260808 15:51:20.804147 31826 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42249 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.8.39.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.125@KRBTEST.COM" created.
Aug 08 15:51:20 dist-test-slave-8tdl krb5kdc[31740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204280, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:51:20.821249 31830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:20.806704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41582 (local address 127.8.39.126:42249)
0808 15:51:20.807296 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:20.807315 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:20.807544 (+ 229us) server_negotiation.cc:407] Connection header received
0808 15:51:20.809095 (+ 1551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:20.809100 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:20.809280 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:20.809440 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:20.810588 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:20.811528 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:20.812836 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:20.813241 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:20.813360 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:20.816086 (+ 2726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:20.816097 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:20.816114 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:20.816149 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:20.817942 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:20.818561 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:20.818567 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:20.818569 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:20.818728 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:20.819122 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:20.819124 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:20.819125 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:20.819509 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:20.819619 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:20.820207 (+ 588us) server_negotiation.cc:299] Negotiation successful
0808 15:51:20.820437 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":476,"spinlock_wait_cycles":61312,"thread_start_us":168,"threads_started":1}
I20260808 15:51:20.821251 31829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:20.806671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:42249 (local address 127.0.0.1:41582)
0808 15:51:20.807338 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:20.807403 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 15:51:20.808730 (+ 1327us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:51:20.809508 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:51:20.809516 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:51:20.810016 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:51:20.810405 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:20.810430 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:20.811665 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:20.811671 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:20.812712 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:20.812721 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:20.813395 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:20.813398 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:20.813494 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:20.814079 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:51:20.814095 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:51:20.815909 (+ 1814us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:51:20.818070 (+ 2161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:20.818083 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:20.818096 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:20.818448 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:20.818833 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:20.818839 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:20.818843 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:20.819002 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:20.819640 (+ 638us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:51:20.819650 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:51:20.819846 (+ 196us) client_negotiation.cc:769] Sending connection context
0808 15:51:20.820049 (+ 203us) client_negotiation.cc:240] Negotiation successful
0808 15:51:20.820549 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":380,"mutex_wait_us":104,"thread_start_us":168,"threads_started":1}
I20260808 15:51:20.823922 31826 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.125" port: 40689 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:51:20.824707 31829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:20.824406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:40689 (local address 127.0.0.1:32864)
0808 15:51:20.824571 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:20.824643 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.125:40689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260808 15:51:20.824904 31775 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.39.125:40689: connect: Connection refused (error 111)
I20260808 15:51:20.825834 31829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:20.825644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:40689 (local address 127.0.0.1:32880)
0808 15:51:20.825739 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:20.825783 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.125:40689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260808 15:51:20.826025 31826 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.125:40689: Network error: Client connection negotiation failed: client connection to 127.8.39.125:40689: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.125.keytab.
Entry for principal kudu/127.8.39.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.125.keytab.
I20260808 15:51:20.832208 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.125:40689
--webserver_interface=127.8.39.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.125.keytab
--principal=kudu/127.8.39.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:46285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:42249,127.8.39.125:40689,127.8.39.124:36897
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:51:20.875301 31826 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.125" port: 40689 } attempt: 1
I20260808 15:51:20.876315 31829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:20.875983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:40689 (local address 127.0.0.1:32894)
0808 15:51:20.876168 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:20.876234 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.125:40689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 15:51:20.877166 31829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:20.876932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:40689 (local address 127.0.0.1:32902)
0808 15:51:20.877050 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:20.877106 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.125:40689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 15:51:20.877301 31826 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.125:40689: Network error: Client connection negotiation failed: client connection to 127.8.39.125:40689: connect: Connection refused (error 111)
I20260808 15:51:20.945466 31826 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.125" port: 40689 } attempt: 2
I20260808 15:51:20.946337 31829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:20.946027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:40689 (local address 127.0.0.1:32906)
0808 15:51:20.946186 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:20.946258 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.125:40689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 15:51:20.947121 31829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:20.946895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:40689 (local address 127.0.0.1:32918)
0808 15:51:20.947003 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:20.947058 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.125:40689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260808 15:51:20.947257 31826 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.125:40689: Network error: Client connection negotiation failed: client connection to 127.8.39.125:40689: connect: Connection refused (error 111)
W20260808 15:51:20.949615 31833 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 15:51:20.949980 31833 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:51:20.950043 31833 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:51:20.950129 31833 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:51:20.954258 31833 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:51:20.954367 31833 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:51:20.954406 31833 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:51:20.954464 31833 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:51:20.954501 31833 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:51:20.960244 31833 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:46285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:42249,127.8.39.125:40689,127.8.39.124:36897
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.125.keytab
--principal=kudu/127.8.39.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.125:40689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.39.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31833
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:51:20.961493 31833 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:51:20.962589 31833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:51:20.971786 31840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:20.971750 31839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:20.971766 31842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:20.972034 31833 server_base.cc:1034] running on GCE node
I20260808 15:51:20.972817 31833 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:51:20.974123 31833 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:51:20.975356 31833 hybrid_clock.cc:648] HybridClock initialized: now 1786204280975322 us; error 46 us; skew 500 ppm
Aug 08 15:51:20 dist-test-slave-8tdl krb5kdc[31740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204280, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:51:20.978444 31833 init.cc:377] Logged in from keytab as kudu/127.8.39.125@KRBTEST.COM (short username kudu)
I20260808 15:51:20.979534 31833 webserver.cc:460] Webserver started at http://127.8.39.125:43717/ using document root <none> and password file <none>
I20260808 15:51:20.980131 31833 fs_manager.cc:359] Metadata directory not provided
I20260808 15:51:20.980264 31833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:51:20.980527 31833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:51:20.982760 31833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-1/data/instance:
uuid: "477d350b1533413183f331db7dafa637"
format_stamp: "Formatted at 2026-08-08 15:51:20 on dist-test-slave-8tdl"
server_key: "33aa15c80752d784744749d17b47d994"
server_key_iv: "c6c36af26ff424115e310ac3074bbb7c"
server_key_version: "encryptionkey@0"
I20260808 15:51:20.983476 31833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-1/wal/instance:
uuid: "477d350b1533413183f331db7dafa637"
format_stamp: "Formatted at 2026-08-08 15:51:20 on dist-test-slave-8tdl"
server_key: "33aa15c80752d784744749d17b47d994"
server_key_iv: "c6c36af26ff424115e310ac3074bbb7c"
server_key_version: "encryptionkey@0"
I20260808 15:51:20.987426 31833 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 15:51:20.990041 31850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:51:20.991567 31833 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 15:51:20.991739 31833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-1/wal
uuid: "477d350b1533413183f331db7dafa637"
format_stamp: "Formatted at 2026-08-08 15:51:20 on dist-test-slave-8tdl"
server_key: "33aa15c80752d784744749d17b47d994"
server_key_iv: "c6c36af26ff424115e310ac3074bbb7c"
server_key_version: "encryptionkey@0"
I20260808 15:51:20.991871 31833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:51:21.019057 31833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:51:21.022392 31833 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:51:21.022617 31833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:51:21.030043 31833 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.125:40689
I20260808 15:51:21.030380 31904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.125:40689 every 8 connection(s)
I20260808 15:51:21.031231 31833 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-1/data/info.pb
I20260808 15:51:21.034189 31905 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:51:21.038441 31826 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.125" port: 40689 } attempt: 3
I20260808 15:51:21.038364 31905 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42249 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:51:21.040690 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 31833
I20260808 15:51:21.040825 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-1/wal/instance
I20260808 15:51:21.041128 8349 external_mini_cluster.cc:1428] Setting key 19803fe22d78fdae5e6d63fb516df3be
Aug 08 15:51:21 dist-test-slave-8tdl krb5kdc[31740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204280, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for kudu/127.8.39.125@KRBTEST.COM
Aug 08 15:51:21 dist-test-slave-8tdl krb5kdc[31740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204280, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.125@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.39.124@KRBTEST.COM; defaulting to no policy
I20260808 15:51:21.053553 31829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.039141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:40689 (local address 127.0.0.1:32930)
0808 15:51:21.039313 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:21.039333 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 15:51:21.039445 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:51:21.042025 (+ 2580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:51:21.042029 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:51:21.042243 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:51:21.042369 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:21.042376 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.044008 (+ 1632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.044013 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:21.044885 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:21.044896 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.045812 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.045816 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:21.045934 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:21.046580 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:51:21.046601 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:51:21.048145 (+ 1544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:51:21.051310 (+ 3165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:21.051314 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:21.051317 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:21.051595 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:21.052006 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:21.052009 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:21.052011 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:21.052108 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:21.052958 (+ 850us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:51:21.052965 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:51:21.053039 (+ 74us) client_negotiation.cc:769] Sending connection context
0808 15:51:21.053164 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 15:51:21.053415 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63,"mutex_wait_us":108}
I20260808 15:51:21.053553 31830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.040561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41584 (local address 127.8.39.126:42249)
0808 15:51:21.040692 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:21.040696 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:21.041146 (+ 450us) server_negotiation.cc:407] Connection header received
0808 15:51:21.041832 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:21.041836 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:21.041898 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:21.041990 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:21.043198 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.043969 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.045025 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.045406 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.045517 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:21.049069 (+ 3552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:21.049075 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:21.049077 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:21.049105 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:21.051475 (+ 2370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.052108 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.052112 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.052113 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.052195 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.052477 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.052479 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.052480 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.052682 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:21.052808 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:21.053192 (+ 384us) server_negotiation.cc:299] Negotiation successful
0808 15:51:21.053351 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 15:51:21.054656 31907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.039939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32930 (local address 127.8.39.125:40689)
0808 15:51:21.040553 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:21.040572 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:21.040616 (+ 44us) server_negotiation.cc:407] Connection header received
0808 15:51:21.041593 (+ 977us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:21.041617 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:21.041851 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:21.042044 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:21.042498 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.043873 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.045063 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.045684 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.045818 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:21.048340 (+ 2522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:21.048351 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:21.048369 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:21.048405 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:21.051177 (+ 2772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.051688 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.051694 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.051695 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.051894 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.052197 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.052199 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.052200 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.052817 (+ 617us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:21.052985 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:21.053253 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 15:51:21.053510 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":420,"thread_start_us":160,"threads_started":1}
I20260808 15:51:21.054656 31908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.040471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:42249 (local address 127.0.0.1:41584)
0808 15:51:21.040993 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:21.041048 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 15:51:21.041593 (+ 545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:51:21.042196 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:51:21.042204 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:51:21.042768 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:51:21.043031 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:21.043049 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.044097 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.044101 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:21.044890 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:21.044899 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.045590 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.045596 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:21.045823 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:21.046748 (+ 925us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:51:21.046775 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:51:21.048859 (+ 2084us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:51:21.051591 (+ 2732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:21.051601 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:21.051613 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:21.051946 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:21.052301 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:21.052304 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:21.052306 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:21.052385 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:21.052775 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:51:21.052781 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:51:21.052943 (+ 162us) client_negotiation.cc:769] Sending connection context
0808 15:51:21.053115 (+ 172us) client_negotiation.cc:240] Negotiation successful
0808 15:51:21.053568 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"mutex_wait_us":115,"spinlock_wait_cycles":3968,"thread_start_us":167,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.124@KRBTEST.COM" created.
I20260808 15:51:21.056047 31905 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.125" port: 40689 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:51:21.058305 31826 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:51:21.059145 31829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.058853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36897 (local address 127.0.0.1:59908)
0808 15:51:21.058977 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:21.059034 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 15:51:21.059875 31829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.059572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36897 (local address 127.0.0.1:59916)
0808 15:51:21.059765 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:21.059811 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140}
W20260808 15:51:21.060000 31826 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.124:36897: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36897: connect: Connection refused (error 111)
Aug 08 15:51:21 dist-test-slave-8tdl krb5kdc[31740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204280, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.125@KRBTEST.COM for kudu/127.8.39.125@KRBTEST.COM
I20260808 15:51:21.065788 31907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.056778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32946 (local address 127.8.39.125:40689)
0808 15:51:21.056867 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:21.056871 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:21.056891 (+ 20us) server_negotiation.cc:407] Connection header received
0808 15:51:21.056959 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:21.056961 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:21.056996 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:21.057058 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:21.057660 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.058446 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.059661 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.060025 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.060150 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:21.062410 (+ 2260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:21.062414 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:21.062417 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:21.062440 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:21.064004 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.064493 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.064497 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.064499 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.064581 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.064854 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.064857 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.064859 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.065048 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:21.065170 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:21.065428 (+ 258us) server_negotiation.cc:299] Negotiation successful
0808 15:51:21.065638 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":105,"server-negotiator.queue_time_us":23}
I20260808 15:51:21.065789 31908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.056639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:40689 (local address 127.0.0.1:32946)
0808 15:51:21.056766 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:21.056784 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 15:51:21.056872 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:51:21.057101 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:51:21.057107 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:51:21.057308 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:51:21.057462 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:21.057471 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.058570 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.058575 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:21.059524 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:21.059538 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.060258 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.060260 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:21.060326 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:21.060835 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:51:21.060850 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:51:21.062272 (+ 1422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:51:21.064189 (+ 1917us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:21.064194 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:21.064196 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:21.064393 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:21.064671 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:21.064675 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:21.064677 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:21.064760 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:21.065160 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:51:21.065163 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:51:21.065272 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 15:51:21.065384 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 15:51:21.065581 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":5}
I20260808 15:51:21.066721 31905 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:51:21.067559 31908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.067249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36897 (local address 127.0.0.1:59924)
0808 15:51:21.067371 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:21.067482 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 15:51:21.067777 31854 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36897: connect: Connection refused (error 111)
I20260808 15:51:21.068719 31908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.068482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36897 (local address 127.0.0.1:59930)
0808 15:51:21.068606 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:21.068660 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260808 15:51:21.068863 31905 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.124:36897: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36897: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.124.keytab.
Entry for principal kudu/127.8.39.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.124.keytab.
I20260808 15:51:21.074597 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.124:36897
--webserver_interface=127.8.39.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.124.keytab
--principal=kudu/127.8.39.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:46285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:42249,127.8.39.125:40689,127.8.39.124:36897
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:51:21.091151 31826 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } attempt: 1
I20260808 15:51:21.092100 31829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.091759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36897 (local address 127.0.0.1:59932)
0808 15:51:21.091916 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:21.091987 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 15:51:21.092944 31829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.092722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36897 (local address 127.0.0.1:59942)
0808 15:51:21.092837 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:21.092890 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 15:51:21.093134 31826 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.124:36897: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36897: connect: Connection refused (error 111)
I20260808 15:51:21.118223 31905 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } attempt: 1
I20260808 15:51:21.119414 31908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.118958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36897 (local address 127.0.0.1:59950)
0808 15:51:21.119176 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:21.119274 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 15:51:21.120343 31908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.120102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36897 (local address 127.0.0.1:59964)
0808 15:51:21.120225 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:21.120282 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 15:51:21.120491 31905 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.124:36897: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36897: connect: Connection refused (error 111)
I20260808 15:51:21.168308 31826 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } attempt: 2
I20260808 15:51:21.169224 31829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.168891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36897 (local address 127.0.0.1:59980)
0808 15:51:21.169053 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:21.169143 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 15:51:21.169972 31829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.169760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36897 (local address 127.0.0.1:59996)
0808 15:51:21.169871 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:21.169921 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 15:51:21.170115 31826 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.124:36897: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36897: connect: Connection refused (error 111)
I20260808 15:51:21.188673 31905 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } attempt: 2
I20260808 15:51:21.189698 31908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.189296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36897 (local address 127.0.0.1:60004)
0808 15:51:21.189541 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:21.189613 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
I20260808 15:51:21.190649 31908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.190334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36897 (local address 127.0.0.1:60014)
0808 15:51:21.190513 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:21.190577 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260808 15:51:21.190855 31905 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.124:36897: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36897: connect: Connection refused (error 111)
W20260808 15:51:21.196502 31912 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 15:51:21.196870 31912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:51:21.196933 31912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:51:21.197013 31912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:51:21.201244 31912 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:51:21.201340 31912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:51:21.201382 31912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:51:21.201439 31912 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:51:21.201476 31912 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:51:21.207199 31912 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:46285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:42249,127.8.39.125:40689,127.8.39.124:36897
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.124.keytab
--principal=kudu/127.8.39.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.124:36897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.39.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31912
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:51:21.208390 31912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:51:21.209455 31912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:51:21.218248 31917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:21.218248 31920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:21.218268 31912 server_base.cc:1034] running on GCE node
W20260808 15:51:21.218263 31918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:21.219221 31912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:51:21.220547 31912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:51:21.221738 31912 hybrid_clock.cc:648] HybridClock initialized: now 1786204281221699 us; error 55 us; skew 500 ppm
Aug 08 15:51:21 dist-test-slave-8tdl krb5kdc[31740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204281, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:51:21.224783 31912 init.cc:377] Logged in from keytab as kudu/127.8.39.124@KRBTEST.COM (short username kudu)
I20260808 15:51:21.225735 31912 webserver.cc:460] Webserver started at http://127.8.39.124:32865/ using document root <none> and password file <none>
I20260808 15:51:21.226321 31912 fs_manager.cc:359] Metadata directory not provided
I20260808 15:51:21.226418 31912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:51:21.226719 31912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:51:21.228932 31912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-2/data/instance:
uuid: "615a6938c2e144eabee43aee6949126f"
format_stamp: "Formatted at 2026-08-08 15:51:21 on dist-test-slave-8tdl"
server_key: "68806e8b92c38ac63ba4ce9ba4fdab7e"
server_key_iv: "ee50d9e962cdd27ae32c841692c8b495"
server_key_version: "encryptionkey@0"
I20260808 15:51:21.229538 31912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-2/wal/instance:
uuid: "615a6938c2e144eabee43aee6949126f"
format_stamp: "Formatted at 2026-08-08 15:51:21 on dist-test-slave-8tdl"
server_key: "68806e8b92c38ac63ba4ce9ba4fdab7e"
server_key_iv: "ee50d9e962cdd27ae32c841692c8b495"
server_key_version: "encryptionkey@0"
I20260808 15:51:21.233589 31912 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 15:51:21.236249 31928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:51:21.237478 31912 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 15:51:21.237648 31912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-2/wal
uuid: "615a6938c2e144eabee43aee6949126f"
format_stamp: "Formatted at 2026-08-08 15:51:21 on dist-test-slave-8tdl"
server_key: "68806e8b92c38ac63ba4ce9ba4fdab7e"
server_key_iv: "ee50d9e962cdd27ae32c841692c8b495"
server_key_version: "encryptionkey@0"
I20260808 15:51:21.237771 31912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:51:21.269277 31826 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } attempt: 3
I20260808 15:51:21.270190 31829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.269855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36897 (local address 127.0.0.1:60020)
0808 15:51:21.270023 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:21.270099 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260808 15:51:21.271003 31829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.270756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36897 (local address 127.0.0.1:60022)
0808 15:51:21.270868 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:21.270932 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 15:51:21.271210 31826 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.124:36897: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36897: connect: Connection refused (error 111)
I20260808 15:51:21.282042 31905 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } attempt: 3
I20260808 15:51:21.283020 31908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.282638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36897 (local address 127.0.0.1:60032)
0808 15:51:21.282857 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:21.282919 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260808 15:51:21.283885 31908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.283583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36897 (local address 127.0.0.1:60046)
0808 15:51:21.283764 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:21.283814 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
W20260808 15:51:21.284104 31905 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.124:36897: Network error: Client connection negotiation failed: client connection to 127.8.39.124:36897: connect: Connection refused (error 111)
I20260808 15:51:21.284829 31912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:51:21.288108 31912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:51:21.288319 31912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:51:21.295960 31912 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.124:36897
I20260808 15:51:21.296268 31982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.124:36897 every 8 connection(s)
I20260808 15:51:21.297086 31912 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-2/data/info.pb
I20260808 15:51:21.300068 31983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:51:21.303659 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 31912
I20260808 15:51:21.303800 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786203987027663-8349-0/minicluster-data/master-2/wal/instance
I20260808 15:51:21.304112 8349 external_mini_cluster.cc:1428] Setting key 42aa44a1b8e9a0ec118ee4b18ed78154
I20260808 15:51:21.304067 31983 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42249 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 15:51:21 dist-test-slave-8tdl krb5kdc[31740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204281, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.124@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
Aug 08 15:51:21 dist-test-slave-8tdl krb5kdc[31740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204280, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.124@KRBTEST.COM
I20260808 15:51:21.317772 31830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.306297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41600 (local address 127.8.39.126:42249)
0808 15:51:21.306427 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:21.306431 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:21.306705 (+ 274us) server_negotiation.cc:407] Connection header received
0808 15:51:21.307223 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:21.307225 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:21.307273 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:21.307347 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:21.308450 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.308950 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.310060 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.310337 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.310416 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:21.313494 (+ 3078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:21.313498 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:21.313501 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:21.313533 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:21.315227 (+ 1694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.315781 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.315783 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.315784 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.315862 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.316251 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.316256 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.316258 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.316542 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:21.316621 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:21.317445 (+ 824us) server_negotiation.cc:299] Negotiation successful
0808 15:51:21.317580 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 15:51:21.319137 31988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.306136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:42249 (local address 127.0.0.1:41600)
0808 15:51:21.306518 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:21.306580 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 15:51:21.307005 (+ 425us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:51:21.307422 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:51:21.307426 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:51:21.307923 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:51:21.308301 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:21.308316 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.309060 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.309064 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:21.309937 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:21.309946 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.310484 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.310488 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:21.310705 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:21.311508 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:51:21.311529 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:51:21.313287 (+ 1758us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:51:21.315338 (+ 2051us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:21.315347 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:21.315359 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:21.315681 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:21.315954 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:21.315957 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:21.315959 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:21.316156 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:21.316715 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:51:21.316722 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:51:21.317131 (+ 409us) client_negotiation.cc:769] Sending connection context
0808 15:51:21.317383 (+ 252us) client_negotiation.cc:240] Negotiation successful
0808 15:51:21.317772 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"mutex_wait_us":1,"thread_start_us":109,"threads_started":1}
I20260808 15:51:21.319137 31987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.305542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60052 (local address 127.8.39.124:36897)
0808 15:51:21.305965 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:21.305980 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:21.306012 (+ 32us) server_negotiation.cc:407] Connection header received
0808 15:51:21.307004 (+ 992us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:21.307027 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:21.307271 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:21.307462 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:21.308234 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.309254 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.310152 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.310610 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.310740 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:21.313980 (+ 3240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:21.313989 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:21.314008 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:21.314037 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:21.316043 (+ 2006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.316552 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.316557 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.316559 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.316744 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.317033 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.317036 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.317038 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.317322 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:21.317535 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:21.317792 (+ 257us) server_negotiation.cc:299] Negotiation successful
0808 15:51:21.317943 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":288,"thread_start_us":113,"threads_started":1}
I20260808 15:51:21.320932 31983 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.125" port: 40689 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 15:51:21 dist-test-slave-8tdl krb5kdc[31740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204281, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.124@KRBTEST.COM for kudu/127.8.39.125@KRBTEST.COM
Aug 08 15:51:21 dist-test-slave-8tdl krb5kdc[31740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204280, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:51:21.330472 31988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.321495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:40689 (local address 127.0.0.1:32952)
0808 15:51:21.321612 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:21.321647 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 15:51:21.321737 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:51:21.322027 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:51:21.322029 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:51:21.322224 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:51:21.322359 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:21.322365 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.323522 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.323526 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:21.324318 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:21.324326 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.325046 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.325051 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:21.325162 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:21.325726 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:51:21.325738 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:51:21.327021 (+ 1283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:51:21.328866 (+ 1845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:21.328892 (+ 26us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:21.328895 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:21.329169 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:21.329473 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:21.329479 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:21.329483 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:21.329586 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:21.329967 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:51:21.329970 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:51:21.330102 (+ 132us) client_negotiation.cc:769] Sending connection context
0808 15:51:21.330201 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 15:51:21.330316 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 15:51:21.330621 31907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.321590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32952 (local address 127.8.39.125:40689)
0808 15:51:21.321743 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:21.321748 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:21.321766 (+ 18us) server_negotiation.cc:407] Connection header received
0808 15:51:21.321819 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:21.321822 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:21.321879 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:21.321976 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:21.322495 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.323416 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.324407 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.324803 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.324911 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:21.327210 (+ 2299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:21.327214 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:21.327216 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:21.327242 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:21.328749 (+ 1507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.329284 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.329288 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.329289 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.329374 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.329694 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.329697 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.329698 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.329871 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:21.329945 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:21.330289 (+ 344us) server_negotiation.cc:299] Negotiation successful
0808 15:51:21.330423 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 15:51:21.331453 31983 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:51:21.332010 31830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.322137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41602 (local address 127.8.39.126:42249)
0808 15:51:21.322251 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:21.322255 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:21.322268 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:51:21.322357 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:21.322360 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:21.322407 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:21.322495 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:21.323352 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.324098 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.325235 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.325447 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.325527 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:21.328192 (+ 2665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:21.328198 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:21.328202 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:21.328235 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:21.329992 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.330485 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.330492 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.330494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.330601 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.331005 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.331008 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.331010 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.331250 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:21.331539 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:21.331700 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 15:51:21.331817 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
Aug 08 15:51:21 dist-test-slave-8tdl krb5kdc[31740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204281, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.124@KRBTEST.COM for kudu/127.8.39.124@KRBTEST.COM
Aug 08 15:51:21 dist-test-slave-8tdl krb5kdc[31740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204280, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.125@KRBTEST.COM
I20260808 15:51:21.340396 31987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.332333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60056 (local address 127.8.39.124:36897)
0808 15:51:21.332460 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:21.332466 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:21.332480 (+ 14us) server_negotiation.cc:407] Connection header received
0808 15:51:21.332511 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:21.332514 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:21.332565 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:21.332628 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:21.333067 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.333848 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.334598 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.334941 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.335052 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:21.336912 (+ 1860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:21.336916 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:21.336918 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:21.336940 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:21.338493 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.339003 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.339006 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.339007 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.339084 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.339388 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.339393 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.339397 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.339673 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:21.339792 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:21.340115 (+ 323us) server_negotiation.cc:299] Negotiation successful
0808 15:51:21.340262 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":66,"server-negotiator.queue_time_us":51}
I20260808 15:51:21.340406 31988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.332176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36897 (local address 127.0.0.1:60056)
0808 15:51:21.332278 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:21.332293 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 15:51:21.332366 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:51:21.332676 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:51:21.332679 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:51:21.332843 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:51:21.332951 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:21.332958 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.333936 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.333939 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:21.334479 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:21.334488 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.335049 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.335053 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:21.335171 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:21.335633 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:51:21.335643 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:51:21.336786 (+ 1143us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:51:21.338618 (+ 1832us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:21.338622 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:21.338624 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:21.338898 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:21.339178 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:21.339182 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:21.339184 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:21.339280 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:21.339802 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:51:21.339805 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:51:21.339922 (+ 117us) client_negotiation.cc:769] Sending connection context
0808 15:51:21.340046 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 15:51:21.340210 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29,"mutex_wait_us":27}
I20260808 15:51:21.342422 31907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.333402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32962 (local address 127.8.39.125:40689)
0808 15:51:21.333516 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:21.333520 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:21.333538 (+ 18us) server_negotiation.cc:407] Connection header received
0808 15:51:21.333635 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:21.333636 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:21.333669 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:21.333731 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:21.334378 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.334948 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.335849 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.336085 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.336192 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:21.338971 (+ 2779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:21.338977 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:21.338980 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:21.339008 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:21.340698 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.341147 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.341151 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.341153 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.341243 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.341558 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.341561 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.341562 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.341787 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:21.342022 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:21.342155 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 15:51:21.342271 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 15:51:21.344584 31983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 615a6938c2e144eabee43aee6949126f: Bootstrap starting.
I20260808 15:51:21.345940 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:51:21.347939 31983 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 615a6938c2e144eabee43aee6949126f: Neither blocks nor log segments found. Creating new log.
I20260808 15:51:21.348893 31983 log.cc:824] T 00000000000000000000000000000000 P 615a6938c2e144eabee43aee6949126f: Log is configured to *not* fsync() on all Append() calls
I20260808 15:51:21.347607 31799 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "db83b36d9a504005b20e0af46bf56601"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41602
I20260808 15:51:21.351406 31983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 615a6938c2e144eabee43aee6949126f: No bootstrap required, opened a new log
I20260808 15:51:21.355779 31983 raft_consensus.cc:348] T 00000000000000000000000000000000 P 615a6938c2e144eabee43aee6949126f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db83b36d9a504005b20e0af46bf56601" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42249 } } peers { permanent_uuid: "477d350b1533413183f331db7dafa637" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 40689 } } peers { permanent_uuid: "615a6938c2e144eabee43aee6949126f" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } }
I20260808 15:51:21.356070 31983 raft_consensus.cc:729] T 00000000000000000000000000000000 P 615a6938c2e144eabee43aee6949126f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 615a6938c2e144eabee43aee6949126f, State: Initialized, Role: FOLLOWER
I20260808 15:51:21.356429 31983 consensus_queue.cc:260] T 00000000000000000000000000000000 P 615a6938c2e144eabee43aee6949126f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db83b36d9a504005b20e0af46bf56601" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42249 } } peers { permanent_uuid: "477d350b1533413183f331db7dafa637" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 40689 } } peers { permanent_uuid: "615a6938c2e144eabee43aee6949126f" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } }
I20260808 15:51:21.356998 31991 sys_catalog.cc:455] T 00000000000000000000000000000000 P 615a6938c2e144eabee43aee6949126f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db83b36d9a504005b20e0af46bf56601" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42249 } } peers { permanent_uuid: "477d350b1533413183f331db7dafa637" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 40689 } } peers { permanent_uuid: "615a6938c2e144eabee43aee6949126f" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } } }
I20260808 15:51:21.357159 31991 sys_catalog.cc:458] T 00000000000000000000000000000000 P 615a6938c2e144eabee43aee6949126f [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:51:21.357842 31983 sys_catalog.cc:564] T 00000000000000000000000000000000 P 615a6938c2e144eabee43aee6949126f [sys.catalog]: configured and running, proceeding with master startup.
W20260808 15:51:21.363318 32002 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 615a6938c2e144eabee43aee6949126f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:51:21.363451 32002 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:51:21.362500 31912 master_runner.cc:186] Error getting master registration for 127.8.39.126:42249: OK, instance_id { permanent_uuid: "db83b36d9a504005b20e0af46bf56601" instance_seqno: 1786204280793556 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 15:51:21.365290 31912 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 15:51:21.427258 31905 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } attempt: 4
Aug 08 15:51:21 dist-test-slave-8tdl krb5kdc[31740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204280, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.125@KRBTEST.COM for kudu/127.8.39.124@KRBTEST.COM
I20260808 15:51:21.435360 31826 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } attempt: 4
I20260808 15:51:21.437687 31908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.428021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36897 (local address 127.0.0.1:60072)
0808 15:51:21.428184 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:21.428203 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 15:51:21.428315 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:51:21.428619 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:51:21.428621 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:51:21.428839 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:51:21.428935 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:21.428941 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.429709 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.429714 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:21.430265 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:21.430274 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.430800 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.430803 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:21.430895 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:21.431469 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:51:21.431490 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:51:21.433265 (+ 1775us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:51:21.435509 (+ 2244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:21.435515 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:21.435518 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:21.435822 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:21.436459 (+ 637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:21.436466 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:21.436468 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:21.436580 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:21.437148 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:51:21.437152 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:51:21.437263 (+ 111us) client_negotiation.cc:769] Sending connection context
0808 15:51:21.437390 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 15:51:21.437542 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260808 15:51:21.437731 31987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.428127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60072 (local address 127.8.39.124:36897)
0808 15:51:21.428272 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:21.428276 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:21.428297 (+ 21us) server_negotiation.cc:407] Connection header received
0808 15:51:21.428442 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:21.428445 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:21.428502 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:21.428592 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:21.429064 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.429589 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.430397 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.430639 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.430792 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:21.433444 (+ 2652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:21.433447 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:21.433450 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:21.433477 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:21.435385 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.436234 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.436239 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.436244 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.436342 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.436692 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.436695 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.436697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.437018 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:21.437140 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:21.437449 (+ 309us) server_negotiation.cc:299] Negotiation successful
0808 15:51:21.437575 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 15:51:21.441642 31905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 477d350b1533413183f331db7dafa637: Bootstrap starting.
Aug 08 15:51:21 dist-test-slave-8tdl krb5kdc[31740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204280, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for kudu/127.8.39.124@KRBTEST.COM
I20260808 15:51:21.444948 31905 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 477d350b1533413183f331db7dafa637: Neither blocks nor log segments found. Creating new log.
I20260808 15:51:21.445981 31905 log.cc:824] T 00000000000000000000000000000000 P 477d350b1533413183f331db7dafa637: Log is configured to *not* fsync() on all Append() calls
I20260808 15:51:21.447250 31829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.435925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:36897 (local address 127.0.0.1:60088)
0808 15:51:21.436082 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:21.436101 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 15:51:21.436192 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:51:21.436933 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:51:21.436936 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:51:21.437168 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:51:21.437288 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:21.437297 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.438994 (+ 1697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.438998 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:21.439894 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:21.439908 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.440524 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.440528 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:21.440620 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:21.441192 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:51:21.441209 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:51:21.442978 (+ 1769us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:51:21.445417 (+ 2439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:21.445421 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:21.445423 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:21.445689 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:21.446043 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:21.446047 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:21.446049 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:21.446222 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:21.446718 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:51:21.446722 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:51:21.446823 (+ 101us) client_negotiation.cc:769] Sending connection context
0808 15:51:21.446911 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 15:51:21.447062 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 15:51:21.448096 32005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.436272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60088 (local address 127.8.39.124:36897)
0808 15:51:21.436662 (+ 390us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:21.436673 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:21.436688 (+ 15us) server_negotiation.cc:407] Connection header received
0808 15:51:21.436723 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:21.436726 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:21.436792 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:21.436904 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:21.437926 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.438860 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.440023 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.440405 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.440509 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:21.443158 (+ 2649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:21.443162 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:21.443165 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:21.443203 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:21.445274 (+ 2071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.445810 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.445814 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.445816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.445904 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.446339 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.446342 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.446344 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.446576 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:21.447703 (+ 1127us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:21.447783 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 15:51:21.447907 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":154,"threads_started":1}
I20260808 15:51:21.448768 31905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 477d350b1533413183f331db7dafa637: No bootstrap required, opened a new log
I20260808 15:51:21.451423 31826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601: Bootstrap starting.
I20260808 15:51:21.453428 31905 raft_consensus.cc:348] T 00000000000000000000000000000000 P 477d350b1533413183f331db7dafa637 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db83b36d9a504005b20e0af46bf56601" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42249 } } peers { permanent_uuid: "477d350b1533413183f331db7dafa637" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 40689 } } peers { permanent_uuid: "615a6938c2e144eabee43aee6949126f" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } }
I20260808 15:51:21.453702 31905 raft_consensus.cc:729] T 00000000000000000000000000000000 P 477d350b1533413183f331db7dafa637 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 477d350b1533413183f331db7dafa637, State: Initialized, Role: FOLLOWER
I20260808 15:51:21.454068 31905 consensus_queue.cc:260] T 00000000000000000000000000000000 P 477d350b1533413183f331db7dafa637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db83b36d9a504005b20e0af46bf56601" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42249 } } peers { permanent_uuid: "477d350b1533413183f331db7dafa637" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 40689 } } peers { permanent_uuid: "615a6938c2e144eabee43aee6949126f" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } }
I20260808 15:51:21.454269 31826 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601: Neither blocks nor log segments found. Creating new log.
I20260808 15:51:21.454802 32007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 477d350b1533413183f331db7dafa637 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db83b36d9a504005b20e0af46bf56601" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42249 } } peers { permanent_uuid: "477d350b1533413183f331db7dafa637" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 40689 } } peers { permanent_uuid: "615a6938c2e144eabee43aee6949126f" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } } }
I20260808 15:51:21.455191 32007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 477d350b1533413183f331db7dafa637 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:51:21.455224 31826 log.cc:824] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601: Log is configured to *not* fsync() on all Append() calls
I20260808 15:51:21.455694 31905 sys_catalog.cc:564] T 00000000000000000000000000000000 P 477d350b1533413183f331db7dafa637 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:51:21.457671 31826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601: No bootstrap required, opened a new log
W20260808 15:51:21.461884 32019 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 477d350b1533413183f331db7dafa637: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:51:21.461994 32019 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:51:21.462945 31826 raft_consensus.cc:348] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db83b36d9a504005b20e0af46bf56601" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42249 } } peers { permanent_uuid: "477d350b1533413183f331db7dafa637" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 40689 } } peers { permanent_uuid: "615a6938c2e144eabee43aee6949126f" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } }
I20260808 15:51:21.463435 31826 raft_consensus.cc:729] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db83b36d9a504005b20e0af46bf56601, State: Initialized, Role: FOLLOWER
I20260808 15:51:21.460031 31833 master_runner.cc:186] Error getting master registration for 127.8.39.126:42249: OK, instance_id { permanent_uuid: "db83b36d9a504005b20e0af46bf56601" instance_seqno: 1786204280793556 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 15:51:21.464007 31833 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 15:51:21.464257 31826 consensus_queue.cc:260] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db83b36d9a504005b20e0af46bf56601" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42249 } } peers { permanent_uuid: "477d350b1533413183f331db7dafa637" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 40689 } } peers { permanent_uuid: "615a6938c2e144eabee43aee6949126f" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } }
I20260808 15:51:21.464883 32021 sys_catalog.cc:455] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db83b36d9a504005b20e0af46bf56601" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42249 } } peers { permanent_uuid: "477d350b1533413183f331db7dafa637" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 40689 } } peers { permanent_uuid: "615a6938c2e144eabee43aee6949126f" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } } }
I20260808 15:51:21.465163 32021 sys_catalog.cc:458] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:51:21.465821 31826 sys_catalog.cc:564] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:51:21.465867 31799 raft_consensus.cc:482] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 15:51:21.465965 31799 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:51:21.467617 31799 raft_consensus.cc:504] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db83b36d9a504005b20e0af46bf56601" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42249 } } peers { permanent_uuid: "477d350b1533413183f331db7dafa637" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 40689 } } peers { permanent_uuid: "615a6938c2e144eabee43aee6949126f" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } }
I20260808 15:51:21.468725 31799 leader_election.cc:288] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601 [CANDIDATE]: Term 1 election: Requested vote from peers 477d350b1533413183f331db7dafa637 (127.8.39.125:40689), 615a6938c2e144eabee43aee6949126f (127.8.39.124:36897)
I20260808 15:51:21.472167 31877 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "db83b36d9a504005b20e0af46bf56601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "477d350b1533413183f331db7dafa637"
I20260808 15:51:21.472477 31877 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 477d350b1533413183f331db7dafa637 [term 0 FOLLOWER]: Advancing to term 1
W20260808 15:51:21.474439 32035 catalog_manager.cc:1558] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:51:21.474627 32035 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:51:21.475060 31957 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "db83b36d9a504005b20e0af46bf56601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "615a6938c2e144eabee43aee6949126f"
I20260808 15:51:21.475364 31957 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 615a6938c2e144eabee43aee6949126f [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:51:21.476966 31957 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 615a6938c2e144eabee43aee6949126f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db83b36d9a504005b20e0af46bf56601 in term 1.
I20260808 15:51:21.477519 31775 leader_election.cc:302] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 615a6938c2e144eabee43aee6949126f, db83b36d9a504005b20e0af46bf56601; no voters:
I20260808 15:51:21.477905 32021 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:51:21.478176 32021 raft_consensus.cc:686] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601 [term 1 LEADER]: Becoming Leader. State: Replica: db83b36d9a504005b20e0af46bf56601, State: Running, Role: LEADER
I20260808 15:51:21.478571 32021 consensus_queue.cc:237] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db83b36d9a504005b20e0af46bf56601" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42249 } } peers { permanent_uuid: "477d350b1533413183f331db7dafa637" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 40689 } } peers { permanent_uuid: "615a6938c2e144eabee43aee6949126f" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } }
I20260808 15:51:21.474637 31877 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 477d350b1533413183f331db7dafa637 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db83b36d9a504005b20e0af46bf56601 in term 1.
I20260808 15:51:21.481792 32041 sys_catalog.cc:455] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db83b36d9a504005b20e0af46bf56601. Latest consensus state: current_term: 1 leader_uuid: "db83b36d9a504005b20e0af46bf56601" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db83b36d9a504005b20e0af46bf56601" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42249 } } peers { permanent_uuid: "477d350b1533413183f331db7dafa637" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 40689 } } peers { permanent_uuid: "615a6938c2e144eabee43aee6949126f" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } } }
I20260808 15:51:21.485648 32041 sys_catalog.cc:458] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601 [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:21.488065 31754 master_runner.cc:263] No leader master found from master db83b36d9a504005b20e0af46bf56601
I20260808 15:51:21.488181 31754 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 15:51:21.491041 32046 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:51:21.492290 32046 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:51:21.512373 31957 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 615a6938c2e144eabee43aee6949126f [term 1 FOLLOWER]: Refusing update from remote peer db83b36d9a504005b20e0af46bf56601: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:51:21.513103 31907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.482582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32974 (local address 127.8.39.125:40689)
0808 15:51:21.482738 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:21.482743 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:21.492760 (+ 10017us) server_negotiation.cc:407] Connection header received
0808 15:51:21.493364 (+ 604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:21.493367 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:21.493428 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:21.493493 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:21.495812 (+ 2319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.496709 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.501497 (+ 4788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.501906 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.501993 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:21.506372 (+ 4379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:21.506376 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:21.506380 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:21.506418 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:21.508514 (+ 2096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.510488 (+ 1974us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.510492 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.510494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.510610 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.511034 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.511038 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.511040 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.511302 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:21.511453 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:21.512747 (+ 1294us) server_negotiation.cc:299] Negotiation successful
0808 15:51:21.512919 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 15:51:21.513259 32041 consensus_queue.cc:1035] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601 [LEADER]: Connected to new peer: Peer: permanent_uuid: "615a6938c2e144eabee43aee6949126f" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:51:21.515873 31830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.483143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41618 (local address 127.8.39.126:42249)
0808 15:51:21.483293 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:21.483298 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:21.493040 (+ 9742us) server_negotiation.cc:407] Connection header received
0808 15:51:21.493210 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:21.493214 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:21.493273 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:21.493377 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:21.499755 (+ 6378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.500530 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.501727 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.502068 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.502144 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:21.511638 (+ 9494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:21.511643 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:21.511646 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:21.511679 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:21.513453 (+ 1774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.513991 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.513995 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.513997 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.514088 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.514388 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.514391 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.514393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.514627 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:21.514819 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:21.515586 (+ 767us) server_negotiation.cc:299] Negotiation successful
0808 15:51:21.515713 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 15:51:21.518272 31991 sys_catalog.cc:455] T 00000000000000000000000000000000 P 615a6938c2e144eabee43aee6949126f [sys.catalog]: SysCatalogTable state changed. Reason: New leader db83b36d9a504005b20e0af46bf56601. Latest consensus state: current_term: 1 leader_uuid: "db83b36d9a504005b20e0af46bf56601" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db83b36d9a504005b20e0af46bf56601" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42249 } } peers { permanent_uuid: "477d350b1533413183f331db7dafa637" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 40689 } } peers { permanent_uuid: "615a6938c2e144eabee43aee6949126f" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } } }
I20260808 15:51:21.518452 31991 sys_catalog.cc:458] T 00000000000000000000000000000000 P 615a6938c2e144eabee43aee6949126f [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:51:21.519345 32005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:21.484627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60096 (local address 127.8.39.124:36897)
0808 15:51:21.484763 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:21.484769 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:21.500069 (+ 15300us) server_negotiation.cc:407] Connection header received
0808 15:51:21.500278 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:21.500282 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:21.500342 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:21.500402 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:21.504253 (+ 3851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.505108 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.509160 (+ 4052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:21.509611 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:21.509705 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:21.514727 (+ 5022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:21.514732 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:21.514735 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:21.514768 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:21.517008 (+ 2240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.517553 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.517558 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.517560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.517657 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:21.518004 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:21.518010 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:21.518013 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:21.518259 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:21.518403 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:21.519016 (+ 613us) server_negotiation.cc:299] Negotiation successful
0808 15:51:21.519180 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 15:51:21.519793 31877 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 477d350b1533413183f331db7dafa637 [term 1 FOLLOWER]: Refusing update from remote peer db83b36d9a504005b20e0af46bf56601: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:51:21.520532 32041 consensus_queue.cc:1035] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601 [LEADER]: Connected to new peer: Peer: permanent_uuid: "477d350b1533413183f331db7dafa637" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 40689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 15:51:21.524307 31856 tablet.cc:2369] T 00000000000000000000000000000000 P 477d350b1533413183f331db7dafa637: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:51:21.528250 32007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 477d350b1533413183f331db7dafa637 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db83b36d9a504005b20e0af46bf56601. Latest consensus state: current_term: 1 leader_uuid: "db83b36d9a504005b20e0af46bf56601" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db83b36d9a504005b20e0af46bf56601" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42249 } } peers { permanent_uuid: "477d350b1533413183f331db7dafa637" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 40689 } } peers { permanent_uuid: "615a6938c2e144eabee43aee6949126f" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } } }
I20260808 15:51:21.528409 32007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 477d350b1533413183f331db7dafa637 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:51:21.531821 32041 sys_catalog.cc:455] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "db83b36d9a504005b20e0af46bf56601" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db83b36d9a504005b20e0af46bf56601" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42249 } } peers { permanent_uuid: "477d350b1533413183f331db7dafa637" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 40689 } } peers { permanent_uuid: "615a6938c2e144eabee43aee6949126f" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } } }
I20260808 15:51:21.531997 32041 sys_catalog.cc:458] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601 [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:21.533366 31991 sys_catalog.cc:455] T 00000000000000000000000000000000 P 615a6938c2e144eabee43aee6949126f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "db83b36d9a504005b20e0af46bf56601" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db83b36d9a504005b20e0af46bf56601" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42249 } } peers { permanent_uuid: "477d350b1533413183f331db7dafa637" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 40689 } } peers { permanent_uuid: "615a6938c2e144eabee43aee6949126f" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } } }
I20260808 15:51:21.533525 31991 sys_catalog.cc:458] T 00000000000000000000000000000000 P 615a6938c2e144eabee43aee6949126f [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:51:21.542655 32046 catalog_manager.cc:1347] Generated new cluster ID: db5f89cc39a3461f8f9975cf90605b86
I20260808 15:51:21.542770 32046 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:51:21.552909 32021 sys_catalog.cc:455] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "db83b36d9a504005b20e0af46bf56601" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db83b36d9a504005b20e0af46bf56601" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42249 } } peers { permanent_uuid: "477d350b1533413183f331db7dafa637" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 40689 } } peers { permanent_uuid: "615a6938c2e144eabee43aee6949126f" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } } }
I20260808 15:51:21.553113 32021 sys_catalog.cc:458] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601 [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:21.554641 32007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 477d350b1533413183f331db7dafa637 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "db83b36d9a504005b20e0af46bf56601" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db83b36d9a504005b20e0af46bf56601" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 42249 } } peers { permanent_uuid: "477d350b1533413183f331db7dafa637" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 40689 } } peers { permanent_uuid: "615a6938c2e144eabee43aee6949126f" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 36897 } } }
I20260808 15:51:21.554841 32007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 477d350b1533413183f331db7dafa637 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:51:21.570446 32046 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:51:21.571928 32046 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:51:21.585162 32046 catalog_manager.cc:5868] T 00000000000000000000000000000000 P db83b36d9a504005b20e0af46bf56601: Generated new TSK 0
I20260808 15:51:21.588336 32046 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 15:51:21.621047 31907 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:51:21.618963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32990 (local address 127.8.39.125:40689)
0808 15:51:21.619097 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:21.619102 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:21.619758 (+ 656us) server_negotiation.cc:407] Connection header received
0808 15:51:21.620011 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:21.620015 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:21.620073 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:21.620141 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:21.620862 (+ 721us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32990: BlockingRecv error: recv got EOF from 127.0.0.1:32990 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260808 15:51:21.621865 31830 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:51:21.618963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41620 (local address 127.8.39.126:42249)
0808 15:51:21.619097 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:21.619102 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:21.620436 (+ 1334us) server_negotiation.cc:407] Connection header received
0808 15:51:21.620630 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:21.620634 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:21.620694 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:21.620754 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:21.621721 (+ 967us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41620: BlockingRecv error: recv got EOF from 127.0.0.1:41620 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260808 15:51:21.622573 32005 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:51:21.619791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60098 (local address 127.8.39.124:36897)
0808 15:51:21.619926 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:21.619930 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:21.621543 (+ 1613us) server_negotiation.cc:407] Connection header received
0808 15:51:21.621744 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:21.621748 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:21.621801 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:21.621853 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:21.622434 (+ 581us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60098: BlockingRecv error: recv got EOF from 127.0.0.1:60098 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260808 15:51:21.626354 31907 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:51:21.624945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32996 (local address 127.8.39.125:40689)
0808 15:51:21.625075 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:21.625078 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:21.625494 (+ 416us) server_negotiation.cc:407] Connection header received
0808 15:51:21.625674 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:21.625676 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:21.625742 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:21.625832 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:21.626255 (+ 423us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32996: BlockingRecv error: recv got EOF from 127.0.0.1:32996 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260808 15:51:21.631273 31907 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:51:21.630239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33008 (local address 127.8.39.125:40689)
0808 15:51:21.630388 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:21.630392 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:21.630404 (+ 12us) server_negotiation.cc:407] Connection header received
0808 15:51:21.630454 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:21.630456 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:21.630498 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:21.630601 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:21.631140 (+ 539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33008: BlockingRecv error: recv got EOF from 127.0.0.1:33008 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260808 15:51:21.636659 31907 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:51:21.635360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33022 (local address 127.8.39.125:40689)
0808 15:51:21.635489 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:21.635494 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:21.635758 (+ 264us) server_negotiation.cc:407] Connection header received
0808 15:51:21.635937 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:21.635941 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:21.635989 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:21.636086 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:21.636539 (+ 453us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33022: BlockingRecv error: recv got EOF from 127.0.0.1:33022 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260808 15:51:21.644174 31907 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:51:21.642802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33032 (local address 127.8.39.125:40689)
0808 15:51:21.642935 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:21.642940 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:21.643199 (+ 259us) server_negotiation.cc:407] Connection header received
0808 15:51:21.643391 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:21.643394 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:21.643457 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:21.643552 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:21.644050 (+ 498us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33032: BlockingRecv error: recv got EOF from 127.0.0.1:33032 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260808 15:51:21.655661 31907 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:51:21.654177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33036 (local address 127.8.39.125:40689)
0808 15:51:21.654313 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:21.654318 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:21.654595 (+ 277us) server_negotiation.cc:407] Connection header received
0808 15:51:21.654812 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:21.654815 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:21.654891 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:21.654992 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:21.655526 (+ 534us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33036: BlockingRecv error: recv got EOF from 127.0.0.1:33036 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260808 15:51:21.675011 31907 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:51:21.673656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33052 (local address 127.8.39.125:40689)
0808 15:51:21.673812 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:21.673816 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:21.674037 (+ 221us) server_negotiation.cc:407] Connection header received
0808 15:51:21.674223 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:21.674225 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:21.674275 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:21.674369 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:21.674881 (+ 512us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33052: BlockingRecv error: recv got EOF from 127.0.0.1:33052 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260808 15:51:21.710739 31907 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:51:21.709404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33066 (local address 127.8.39.125:40689)
0808 15:51:21.709570 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:21.709575 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:21.709691 (+ 116us) server_negotiation.cc:407] Connection header received
0808 15:51:21.709797 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:21.709801 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:21.709865 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:21.710110 (+ 245us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:21.710577 (+ 467us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33066: BlockingRecv error: recv got EOF from 127.0.0.1:33066 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260808 15:51:21.778304 31907 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:51:21.777184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33078 (local address 127.8.39.125:40689)
0808 15:51:21.777335 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:21.777339 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:21.777480 (+ 141us) server_negotiation.cc:407] Connection header received
0808 15:51:21.777617 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:21.777620 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:21.777668 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:21.777754 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:21.778202 (+ 448us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33078: BlockingRecv error: recv got EOF from 127.0.0.1:33078 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260808 15:51:21.910120 31907 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:51:21.908856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33092 (local address 127.8.39.125:40689)
0808 15:51:21.909005 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:21.909009 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:21.909233 (+ 224us) server_negotiation.cc:407] Connection header received
0808 15:51:21.909357 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:21.909360 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:21.909409 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:21.909493 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:21.909986 (+ 493us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33092: BlockingRecv error: recv got EOF from 127.0.0.1:33092 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260808 15:51:22.170058 31907 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:51:22.168827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33104 (local address 127.8.39.125:40689)
0808 15:51:22.169018 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:22.169022 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:22.169042 (+ 20us) server_negotiation.cc:407] Connection header received
0808 15:51:22.169190 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:22.169193 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:22.169256 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:22.169404 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:22.169884 (+ 480us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33104: BlockingRecv error: recv got EOF from 127.0.0.1:33104 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 15:51:22.364807 32002 catalog_manager.cc:1259] Loaded cluster ID: db5f89cc39a3461f8f9975cf90605b86
I20260808 15:51:22.364903 32002 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 615a6938c2e144eabee43aee6949126f: loading cluster ID for follower catalog manager: success
I20260808 15:51:22.366917 32002 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 615a6938c2e144eabee43aee6949126f: acquiring CA information for follower catalog manager: success
I20260808 15:51:22.368242 32002 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 615a6938c2e144eabee43aee6949126f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 15:51:22.463358 32019 catalog_manager.cc:1259] Loaded cluster ID: db5f89cc39a3461f8f9975cf90605b86
I20260808 15:51:22.463481 32019 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 477d350b1533413183f331db7dafa637: loading cluster ID for follower catalog manager: success
I20260808 15:51:22.465195 32019 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 477d350b1533413183f331db7dafa637: acquiring CA information for follower catalog manager: success
I20260808 15:51:22.466555 32019 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 477d350b1533413183f331db7dafa637: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 15:51:22.689061 32126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:22.684556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33120 (local address 127.8.39.125:40689)
0808 15:51:22.684787 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:22.684791 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:22.684807 (+ 16us) server_negotiation.cc:407] Connection header received
0808 15:51:22.685008 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:22.685011 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:22.685152 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:22.685278 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:51:22.685581 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:22.686150 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:22.687278 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:22.687575 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:22.687693 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:22.688044 (+ 351us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:51:22.688559 (+ 515us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:51:22.688667 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:22.688750 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 15:51:22.688814 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":73,"threads_started":1}
I20260808 15:51:22.697196 32132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:22.692654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60114 (local address 127.8.39.124:36897)
0808 15:51:22.692930 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:22.692936 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:22.692951 (+ 15us) server_negotiation.cc:407] Connection header received
0808 15:51:22.693183 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:22.693189 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:22.693319 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:22.693451 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:51:22.693685 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:22.694354 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:22.695634 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:22.695877 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:22.696010 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:22.696343 (+ 333us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:51:22.696785 (+ 442us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:51:22.696922 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:22.696962 (+ 40us) server_negotiation.cc:299] Negotiation successful
0808 15:51:22.697022 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":79,"threads_started":1}
I20260808 15:51:22.704339 32126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:22.700505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33132 (local address 127.8.39.125:40689)
0808 15:51:22.700643 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:22.700648 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:22.700825 (+ 177us) server_negotiation.cc:407] Connection header received
0808 15:51:22.701049 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:22.701052 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:22.701118 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:22.701195 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:51:22.701463 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:22.702245 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:22.703181 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:22.703518 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:22.703622 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:22.703872 (+ 250us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:51:22.703968 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:51:22.704048 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:22.704134 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 15:51:22.704189 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 15:51:22.705435 32132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:22.700942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60124 (local address 127.8.39.124:36897)
0808 15:51:22.701066 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:22.701071 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:22.701655 (+ 584us) server_negotiation.cc:407] Connection header received
0808 15:51:22.701833 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:22.701836 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:22.701894 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:22.701970 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:51:22.702241 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:22.702991 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:22.703974 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:22.704295 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:22.704393 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:22.704808 (+ 415us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:51:22.704884 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:51:22.704928 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:22.705222 (+ 294us) server_negotiation.cc:299] Negotiation successful
0808 15:51:22.705281 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 15:51:22.705651 32140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:22.700430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41628 (local address 127.8.39.126:42249)
0808 15:51:22.700800 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:22.700805 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:22.700819 (+ 14us) server_negotiation.cc:407] Connection header received
0808 15:51:22.700954 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:22.701092 (+ 138us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:22.701280 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:22.701425 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:51:22.701651 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:22.702433 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:22.703900 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:22.704275 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:22.704389 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:22.704852 (+ 463us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:51:22.705238 (+ 386us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:51:22.705342 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:22.705421 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 15:51:22.705479 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":84,"threads_started":1}
I20260808 15:51:22.708792 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 31754
I20260808 15:51:22.718415 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 31833
I20260808 15:51:22.725844 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 31912
2026-08-08T15:51:22Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3409 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:51:22 dist-test-slave-8tdl krb5kdc[32144](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:51:22 dist-test-slave-8tdl krb5kdc[32144](info): set up 2 sockets
Aug 08 15:51:22 dist-test-slave-8tdl krb5kdc[32144](info): commencing operation
krb5kdc: starting...
W20260808 15:51:23.836282 8349 mini_kdc.cc:121] Time spent starting KDC: real 1.087s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/krb5kdc/test-user.keytab.
Aug 08 15:51:23 dist-test-slave-8tdl krb5kdc[32144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204283, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:51:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:51:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.39.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
Entry for principal kudu/127.8.39.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab.
I20260808 15:51:23.973647 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:45533
--webserver_interface=127.8.39.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:33495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:45533,127.8.39.125:37621,127.8.39.124:34775
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:51:24.088950 32158 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 15:51:24.089319 32158 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:51:24.089372 32158 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:51:24.089447 32158 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:51:24.093583 32158 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:51:24.093689 32158 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:51:24.093724 32158 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:51:24.093770 32158 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:51:24.093804 32158 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:51:24.099354 32158 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:33495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:45533,127.8.39.125:37621,127.8.39.124:34775
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.126.keytab
--principal=kudu/127.8.39.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.126:45533
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.39.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32158
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:51:24.100546 32158 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:51:24.101600 32158 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:51:24.110483 32163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:24.110499 32167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:24.110564 32158 server_base.cc:1034] running on GCE node
W20260808 15:51:24.110499 32165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:24.111426 32158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:51:24.112629 32158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:51:24.113823 32158 hybrid_clock.cc:648] HybridClock initialized: now 1786204284113806 us; error 34 us; skew 500 ppm
Aug 08 15:51:24 dist-test-slave-8tdl krb5kdc[32144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204284, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:51:24.116744 32158 init.cc:377] Logged in from keytab as kudu/127.8.39.126@KRBTEST.COM (short username kudu)
I20260808 15:51:24.117714 32158 webserver.cc:460] Webserver started at http://127.8.39.126:40613/ using document root <none> and password file <none>
I20260808 15:51:24.118264 32158 fs_manager.cc:359] Metadata directory not provided
I20260808 15:51:24.118328 32158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:51:24.118503 32158 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:51:24.120668 32158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-0/data/instance:
uuid: "db508334df204518ad7a4dfab034ac5c"
format_stamp: "Formatted at 2026-08-08 15:51:24 on dist-test-slave-8tdl"
server_key: "8e86c67357c63ece525d937d6bcc4872"
server_key_iv: "334b16e62d9ca965c05382767f9b0239"
server_key_version: "encryptionkey@0"
I20260808 15:51:24.121279 32158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-0/wal/instance:
uuid: "db508334df204518ad7a4dfab034ac5c"
format_stamp: "Formatted at 2026-08-08 15:51:24 on dist-test-slave-8tdl"
server_key: "8e86c67357c63ece525d937d6bcc4872"
server_key_iv: "334b16e62d9ca965c05382767f9b0239"
server_key_version: "encryptionkey@0"
I20260808 15:51:24.125175 32158 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 15:51:24.127825 32175 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:51:24.129153 32158 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:51:24.129277 32158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-0/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-0/wal
uuid: "db508334df204518ad7a4dfab034ac5c"
format_stamp: "Formatted at 2026-08-08 15:51:24 on dist-test-slave-8tdl"
server_key: "8e86c67357c63ece525d937d6bcc4872"
server_key_iv: "334b16e62d9ca965c05382767f9b0239"
server_key_version: "encryptionkey@0"
I20260808 15:51:24.129377 32158 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:51:24.142717 32158 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:51:24.145678 32158 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:51:24.145850 32158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:51:24.153501 32158 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.126:45533
I20260808 15:51:24.153790 32231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.126:45533 every 8 connection(s)
I20260808 15:51:24.154556 32158 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-0/data/info.pb
I20260808 15:51:24.157400 32232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:51:24.161319 32232 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45533 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:51:24.161758 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 32158
I20260808 15:51:24.161912 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-0/wal/instance
I20260808 15:51:24.162226 8349 external_mini_cluster.cc:1428] Setting key a4acec597dec14e47877b95741e66258
WARNING: no policy specified for kudu/127.8.39.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.125@KRBTEST.COM" created.
Aug 08 15:51:24 dist-test-slave-8tdl krb5kdc[32144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204284, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:51:24.182094 32236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.163923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42124 (local address 127.8.39.126:45533)
0808 15:51:24.164553 (+ 630us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:24.164572 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:24.164966 (+ 394us) server_negotiation.cc:407] Connection header received
0808 15:51:24.166388 (+ 1422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:24.166396 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:24.166665 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:24.166891 (+ 226us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:24.167836 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.169365 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.170410 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.171134 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.171318 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:24.176701 (+ 5383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:24.176712 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:24.176733 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:24.176773 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:24.178624 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.179221 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.179227 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.179229 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.179349 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.179697 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.179702 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.179704 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.180140 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:24.180285 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:24.180667 (+ 382us) server_negotiation.cc:299] Negotiation successful
0808 15:51:24.180949 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":475,"spinlock_wait_cycles":19456,"thread_start_us":165,"threads_started":1}
I20260808 15:51:24.182094 32235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.163923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45533 (local address 127.0.0.1:42124)
0808 15:51:24.164770 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.164835 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 15:51:24.166048 (+ 1213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:51:24.166905 (+ 857us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:51:24.166909 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:51:24.167287 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:51:24.167545 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:24.167560 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.169518 (+ 1958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.169521 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:24.170279 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:24.170288 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.171308 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.171311 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:24.171448 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:24.172166 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:51:24.172184 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:51:24.176477 (+ 4293us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:51:24.178823 (+ 2346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:24.178837 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:24.178852 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:24.179099 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:24.179456 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:24.179461 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:24.179467 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:24.179598 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:24.180266 (+ 668us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:51:24.180272 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:51:24.180415 (+ 143us) client_negotiation.cc:769] Sending connection context
0808 15:51:24.180605 (+ 190us) client_negotiation.cc:240] Negotiation successful
0808 15:51:24.181003 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"mutex_wait_us":165,"thread_start_us":150,"threads_started":1}
I20260808 15:51:24.185148 32232 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.125" port: 37621 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:51:24.186082 32235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.185757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:37621 (local address 127.0.0.1:53454)
0808 15:51:24.185931 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.186005 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.125:37621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 15:51:24.186298 32178 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.39.125:37621: connect: Connection refused (error 111)
I20260808 15:51:24.187291 32235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.187072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:37621 (local address 127.0.0.1:53466)
0808 15:51:24.187182 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.187234 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.125:37621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 15:51:24.187456 32232 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.125:37621: Network error: Client connection negotiation failed: client connection to 127.8.39.125:37621: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.125.keytab.
Entry for principal kudu/127.8.39.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.125.keytab.
I20260808 15:51:24.193733 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.125:37621
--webserver_interface=127.8.39.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.125.keytab
--principal=kudu/127.8.39.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:33495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:45533,127.8.39.125:37621,127.8.39.124:34775
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:51:24.236682 32232 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.125" port: 37621 } attempt: 1
I20260808 15:51:24.237641 32235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.237330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:37621 (local address 127.0.0.1:53482)
0808 15:51:24.237493 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.237564 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.125:37621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 15:51:24.238425 32235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.238217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:37621 (local address 127.0.0.1:53490)
0808 15:51:24.238320 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.238366 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.125:37621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 15:51:24.238596 32232 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.125:37621: Network error: Client connection negotiation failed: client connection to 127.8.39.125:37621: connect: Connection refused (error 111)
I20260808 15:51:24.306808 32232 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.125" port: 37621 } attempt: 2
I20260808 15:51:24.307732 32235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.307428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:37621 (local address 127.0.0.1:40712)
0808 15:51:24.307589 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.307654 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.125:37621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 15:51:24.308557 32235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.308321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:37621 (local address 127.0.0.1:40724)
0808 15:51:24.308423 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.308469 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.125:37621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 15:51:24.308791 32232 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.125:37621: Network error: Client connection negotiation failed: client connection to 127.8.39.125:37621: connect: Connection refused (error 111)
W20260808 15:51:24.313592 32239 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 15:51:24.313923 32239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:51:24.313999 32239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:51:24.314101 32239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:51:24.318264 32239 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:51:24.318356 32239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:51:24.318403 32239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:51:24.318460 32239 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:51:24.318496 32239 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:51:24.324043 32239 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:33495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:45533,127.8.39.125:37621,127.8.39.124:34775
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.125.keytab
--principal=kudu/127.8.39.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.125:37621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.39.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32239
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:51:24.325240 32239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:51:24.326663 32239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:51:24.335980 32245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:24.336151 32239 server_base.cc:1034] running on GCE node
W20260808 15:51:24.336387 32246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:24.335978 32248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:24.337031 32239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:51:24.338201 32239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:51:24.339383 32239 hybrid_clock.cc:648] HybridClock initialized: now 1786204284339351 us; error 45 us; skew 500 ppm
Aug 08 15:51:24 dist-test-slave-8tdl krb5kdc[32144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204284, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:51:24.346324 32239 init.cc:377] Logged in from keytab as kudu/127.8.39.125@KRBTEST.COM (short username kudu)
I20260808 15:51:24.347323 32239 webserver.cc:460] Webserver started at http://127.8.39.125:41525/ using document root <none> and password file <none>
I20260808 15:51:24.347865 32239 fs_manager.cc:359] Metadata directory not provided
I20260808 15:51:24.347930 32239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:51:24.348112 32239 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:51:24.350178 32239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-1/data/instance:
uuid: "5e3537dd119a4bdbacd86073f833a337"
format_stamp: "Formatted at 2026-08-08 15:51:24 on dist-test-slave-8tdl"
server_key: "682adc95a56640eb129812e6f39886a2"
server_key_iv: "b06f31f5615d43c46722de95a1ed5399"
server_key_version: "encryptionkey@0"
I20260808 15:51:24.350757 32239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-1/wal/instance:
uuid: "5e3537dd119a4bdbacd86073f833a337"
format_stamp: "Formatted at 2026-08-08 15:51:24 on dist-test-slave-8tdl"
server_key: "682adc95a56640eb129812e6f39886a2"
server_key_iv: "b06f31f5615d43c46722de95a1ed5399"
server_key_version: "encryptionkey@0"
I20260808 15:51:24.354630 32239 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 15:51:24.357236 32256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:51:24.358567 32239 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 15:51:24.358739 32239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-1/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-1/wal
uuid: "5e3537dd119a4bdbacd86073f833a337"
format_stamp: "Formatted at 2026-08-08 15:51:24 on dist-test-slave-8tdl"
server_key: "682adc95a56640eb129812e6f39886a2"
server_key_iv: "b06f31f5615d43c46722de95a1ed5399"
server_key_version: "encryptionkey@0"
I20260808 15:51:24.358856 32239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:51:24.388612 32239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:51:24.392109 32239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:51:24.392280 32239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:51:24.399904 32239 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.125:37621
I20260808 15:51:24.399964 32232 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.125" port: 37621 } attempt: 3
I20260808 15:51:24.400300 32314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.125:37621 every 8 connection(s)
I20260808 15:51:24.401178 32239 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-1/data/info.pb
I20260808 15:51:24.401885 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 32239
I20260808 15:51:24.402035 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-1/wal/instance
I20260808 15:51:24.402338 8349 external_mini_cluster.cc:1428] Setting key 4200f6bf8f4c6ac138b238ccd9b2ac88
I20260808 15:51:24.406567 32316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 15:51:24 dist-test-slave-8tdl krb5kdc[32144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204284, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for kudu/127.8.39.125@KRBTEST.COM
I20260808 15:51:24.411739 32316 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45533 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.8.39.124@KRBTEST.COM; defaulting to no policy
I20260808 15:51:24.414631 32235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.400605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:37621 (local address 127.0.0.1:40734)
0808 15:51:24.400775 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.400796 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 15:51:24.400902 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:51:24.403423 (+ 2521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:51:24.403429 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:51:24.403660 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:51:24.403835 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:24.403847 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.405686 (+ 1839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.405689 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:24.406254 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:24.406264 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.407269 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.407276 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:24.407426 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:24.408063 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:51:24.408084 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:51:24.409748 (+ 1664us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:51:24.412303 (+ 2555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:24.412306 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:24.412308 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:24.412583 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:24.413026 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:24.413029 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:24.413031 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:24.413136 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:24.413986 (+ 850us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:51:24.413989 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:51:24.414120 (+ 131us) client_negotiation.cc:769] Sending connection context
0808 15:51:24.414214 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 15:51:24.414366 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 15:51:24.416010 32315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.401265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40734 (local address 127.8.39.125:37621)
0808 15:51:24.401753 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:24.401771 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:24.401822 (+ 51us) server_negotiation.cc:407] Connection header received
0808 15:51:24.402668 (+ 846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:24.402739 (+ 71us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:24.403132 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:24.403423 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:24.404021 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.405527 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.406389 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.407112 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.407333 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:24.409969 (+ 2636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:24.409978 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:24.409998 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:24.410032 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:24.412157 (+ 2125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.412718 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.412726 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.412733 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.412897 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.413248 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.413252 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.413254 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.413834 (+ 580us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:24.414800 (+ 966us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:24.414955 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 15:51:24.415198 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":167,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.39.124@KRBTEST.COM" created.
I20260808 15:51:24.418159 32232 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:51:24.419018 32235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.418702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:34775 (local address 127.0.0.1:39868)
0808 15:51:24.418888 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.418943 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:34775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260808 15:51:24.419905 32235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.419599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:34775 (local address 127.0.0.1:39878)
0808 15:51:24.419788 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.419841 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:34775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
Aug 08 15:51:24 dist-test-slave-8tdl krb5kdc[32144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204284, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.125@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
W20260808 15:51:24.420089 32232 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.124:34775: Network error: Client connection negotiation failed: client connection to 127.8.39.124:34775: connect: Connection refused (error 111)
I20260808 15:51:24.424927 32236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.413831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53858 (local address 127.8.39.126:45533)
0808 15:51:24.413990 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:24.413995 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:24.414344 (+ 349us) server_negotiation.cc:407] Connection header received
0808 15:51:24.414531 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:24.414535 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:24.414595 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:24.414637 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:24.415669 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.416315 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.417296 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.417649 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.417752 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:24.420527 (+ 2775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:24.420533 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:24.420538 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:24.420570 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:24.423087 (+ 2517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.423599 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.423607 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.423608 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.423685 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.423970 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.423975 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.423977 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.424172 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:24.424276 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:24.424641 (+ 365us) server_negotiation.cc:299] Negotiation successful
0808 15:51:24.424771 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 15:51:24.424952 32319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.413822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45533 (local address 127.0.0.1:53858)
0808 15:51:24.414225 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.414273 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 15:51:24.414427 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:51:24.414996 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:51:24.415002 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:51:24.415378 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:51:24.415494 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:24.415501 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.416440 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.416442 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:24.417179 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:24.417189 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.417777 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.417783 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:24.417936 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:24.418620 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:51:24.418634 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:51:24.420387 (+ 1753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:51:24.423213 (+ 2826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:24.423223 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:24.423228 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:24.423468 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:24.423783 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:24.423786 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:24.423788 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:24.423875 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:24.424293 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:51:24.424301 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:51:24.424419 (+ 118us) client_negotiation.cc:769] Sending connection context
0808 15:51:24.424568 (+ 149us) client_negotiation.cc:240] Negotiation successful
0808 15:51:24.424771 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":138,"threads_started":1}
I20260808 15:51:24.426358 32316 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.125" port: 37621 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 15:51:24 dist-test-slave-8tdl krb5kdc[32144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204284, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.125@KRBTEST.COM for kudu/127.8.39.125@KRBTEST.COM
I20260808 15:51:24.435773 32319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.426904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:37621 (local address 127.0.0.1:40738)
0808 15:51:24.427054 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.427073 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 15:51:24.427164 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:51:24.427412 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:51:24.427417 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:51:24.427590 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:51:24.427724 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:24.427735 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.428491 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.428494 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:24.429152 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:24.429161 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.429722 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.429725 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:24.429815 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:24.430335 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:51:24.430348 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:51:24.432103 (+ 1755us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:51:24.434032 (+ 1929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:24.434035 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:24.434037 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:24.434300 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:24.434576 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:24.434579 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:24.434580 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:24.434662 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:24.435170 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:51:24.435173 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:51:24.435265 (+ 92us) client_negotiation.cc:769] Sending connection context
0808 15:51:24.435389 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 15:51:24.435558 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 15:51:24.435772 32315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.426988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40738 (local address 127.8.39.125:37621)
0808 15:51:24.427095 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:24.427098 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:24.427113 (+ 15us) server_negotiation.cc:407] Connection header received
0808 15:51:24.427261 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:24.427263 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:24.427299 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:24.427360 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:24.427838 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.428371 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.429281 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.429588 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.429671 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:24.432254 (+ 2583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:24.432257 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:24.432259 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:24.432279 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:24.433895 (+ 1616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.434396 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.434403 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.434405 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.434483 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.434857 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.434863 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.434867 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.435068 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:24.435170 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:24.435434 (+ 264us) server_negotiation.cc:299] Negotiation successful
0808 15:51:24.435614 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":78,"server-negotiator.queue_time_us":36}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.39.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.124.keytab.
Entry for principal kudu/127.8.39.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.124.keytab.
I20260808 15:51:24.436673 32316 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:51:24.437487 32319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.437207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:34775 (local address 127.0.0.1:39888)
0808 15:51:24.437334 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.437421 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:34775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 15:51:24.437683 8349 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
/tmp/dist-test-taskCGl7YH/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.124:34775
--webserver_interface=127.8.39.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.124.keytab
--principal=kudu/127.8.39.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.39.84:33495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.39.126:45533,127.8.39.125:37621,127.8.39.124:34775
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:51:24.438133 32259 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.39.124:34775: connect: Connection refused (error 111)
I20260808 15:51:24.439095 32319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.438842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:34775 (local address 127.0.0.1:39902)
0808 15:51:24.438956 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.439007 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:34775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 15:51:24.439271 32316 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.124:34775: Network error: Client connection negotiation failed: client connection to 127.8.39.124:34775: connect: Connection refused (error 111)
I20260808 15:51:24.451251 32232 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } attempt: 1
I20260808 15:51:24.452178 32235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.451867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:34775 (local address 127.0.0.1:39918)
0808 15:51:24.452029 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.452098 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:34775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 15:51:24.453116 32235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.452828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:34775 (local address 127.0.0.1:39924)
0808 15:51:24.452996 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.453052 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:34775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
W20260808 15:51:24.453366 32232 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.124:34775: Network error: Client connection negotiation failed: client connection to 127.8.39.124:34775: connect: Connection refused (error 111)
I20260808 15:51:24.488520 32316 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } attempt: 1
I20260808 15:51:24.489477 32319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.489166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:34775 (local address 127.0.0.1:39936)
0808 15:51:24.489332 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.489398 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:34775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260808 15:51:24.490257 32319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.490054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:34775 (local address 127.0.0.1:39944)
0808 15:51:24.490159 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.490203 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:34775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 15:51:24.490423 32316 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.124:34775: Network error: Client connection negotiation failed: client connection to 127.8.39.124:34775: connect: Connection refused (error 111)
I20260808 15:51:24.528592 32232 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } attempt: 2
I20260808 15:51:24.529618 32235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.529273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:34775 (local address 127.0.0.1:39956)
0808 15:51:24.529454 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.529520 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:34775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 15:51:24.530395 32235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.530172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:34775 (local address 127.0.0.1:39962)
0808 15:51:24.530285 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.530337 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:34775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260808 15:51:24.530517 32232 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.124:34775: Network error: Client connection negotiation failed: client connection to 127.8.39.124:34775: connect: Connection refused (error 111)
I20260808 15:51:24.558600 32316 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } attempt: 2
W20260808 15:51:24.558885 32322 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 15:51:24.559320 32322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:51:24.559376 32322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:51:24.559442 32322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 15:51:24.559618 32319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.559234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:34775 (local address 127.0.0.1:39966)
0808 15:51:24.559441 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.559524 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:34775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260808 15:51:24.560438 32319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.560222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:34775 (local address 127.0.0.1:39970)
0808 15:51:24.560332 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.560381 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:34775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260808 15:51:24.560611 32316 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.124:34775: Network error: Client connection negotiation failed: client connection to 127.8.39.124:34775: connect: Connection refused (error 111)
W20260808 15:51:24.564409 32322 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:51:24.564477 32322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:51:24.564497 32322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:51:24.564514 32322 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:51:24.564530 32322 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:51:24.570192 32322 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.39.84:33495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.8.39.126:45533,127.8.39.125:37621,127.8.39.124:34775
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/krb5kdc/kudu_127.8.39.124.keytab
--principal=kudu/127.8.39.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.39.124:34775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.39.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32322
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 15:01:44 UTC on ccycloud.quasar-hllaxn.root.comops.site
build id 4574922
I20260808 15:51:24.571430 32322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:51:24.572536 32322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:51:24.581594 32331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:24.581594 32329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:51:24.581797 32328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:51:24.582142 32322 server_base.cc:1034] running on GCE node
I20260808 15:51:24.582886 32322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:51:24.584126 32322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:51:24.585295 32322 hybrid_clock.cc:648] HybridClock initialized: now 1786204284585276 us; error 34 us; skew 500 ppm
Aug 08 15:51:24 dist-test-slave-8tdl krb5kdc[32144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204284, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:51:24.588368 32322 init.cc:377] Logged in from keytab as kudu/127.8.39.124@KRBTEST.COM (short username kudu)
I20260808 15:51:24.589318 32322 webserver.cc:460] Webserver started at http://127.8.39.124:40509/ using document root <none> and password file <none>
I20260808 15:51:24.589876 32322 fs_manager.cc:359] Metadata directory not provided
I20260808 15:51:24.589937 32322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:51:24.590113 32322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:51:24.592238 32322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-2/data/instance:
uuid: "df0de98b9ded4b2a8b2c2fd9285634f9"
format_stamp: "Formatted at 2026-08-08 15:51:24 on dist-test-slave-8tdl"
server_key: "6cb8dde45522ebe4b0508bb273e8e139"
server_key_iv: "3ffe50c6f8c729a01e25839c034dc6af"
server_key_version: "encryptionkey@0"
I20260808 15:51:24.592773 32322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-2/wal/instance:
uuid: "df0de98b9ded4b2a8b2c2fd9285634f9"
format_stamp: "Formatted at 2026-08-08 15:51:24 on dist-test-slave-8tdl"
server_key: "6cb8dde45522ebe4b0508bb273e8e139"
server_key_iv: "3ffe50c6f8c729a01e25839c034dc6af"
server_key_version: "encryptionkey@0"
I20260808 15:51:24.596657 32322 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260808 15:51:24.599169 32338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:51:24.600446 32322 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 15:51:24.600586 32322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-2/data,/tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-2/wal
uuid: "df0de98b9ded4b2a8b2c2fd9285634f9"
format_stamp: "Formatted at 2026-08-08 15:51:24 on dist-test-slave-8tdl"
server_key: "6cb8dde45522ebe4b0508bb273e8e139"
server_key_iv: "3ffe50c6f8c729a01e25839c034dc6af"
server_key_version: "encryptionkey@0"
I20260808 15:51:24.600710 32322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:51:24.624341 32322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:51:24.627739 32322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:51:24.627965 32322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:51:24.629691 32232 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } attempt: 3
I20260808 15:51:24.630528 32235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.630238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:34775 (local address 127.0.0.1:39978)
0808 15:51:24.630390 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.630452 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:34775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 15:51:24.631311 32235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.631081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:34775 (local address 127.0.0.1:39988)
0808 15:51:24.631194 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.631249 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.39.124:34775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260808 15:51:24.631450 32232 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.39.124:34775: Network error: Client connection negotiation failed: client connection to 127.8.39.124:34775: connect: Connection refused (error 111)
I20260808 15:51:24.635809 32322 rpc_server.cc:307] RPC server started. Bound to: 127.8.39.124:34775
I20260808 15:51:24.636129 32394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.39.124:34775 every 8 connection(s)
I20260808 15:51:24.636832 32322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-2/data/info.pb
I20260808 15:51:24.639823 32395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:51:24.643923 32395 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45533 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:51:24.645977 8349 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu as pid 32322
I20260808 15:51:24.646162 8349 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCGl7YH/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786203987027663-8349-0/minicluster-data/master-2/wal/instance
I20260808 15:51:24.646461 8349 external_mini_cluster.cc:1428] Setting key 4692f7ce7f08c1ce9a7aa19859c2cb13
I20260808 15:51:24.651795 32316 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } attempt: 3
Aug 08 15:51:24 dist-test-slave-8tdl krb5kdc[32144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204283, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.124@KRBTEST.COM
Aug 08 15:51:24 dist-test-slave-8tdl krb5kdc[32144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204284, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.124@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
Aug 08 15:51:24 dist-test-slave-8tdl krb5kdc[32144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204284, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.125@KRBTEST.COM for kudu/127.8.39.124@KRBTEST.COM
I20260808 15:51:24.660354 32236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.646031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53870 (local address 127.8.39.126:45533)
0808 15:51:24.646209 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:24.646215 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:24.647335 (+ 1120us) server_negotiation.cc:407] Connection header received
0808 15:51:24.648548 (+ 1213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:24.648551 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:24.648614 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:24.648713 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:24.649600 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.650423 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.651901 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.652205 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.652338 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:24.656312 (+ 3974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:24.656318 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:24.656323 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:24.656359 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:24.658001 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.658582 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.658585 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.658587 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.658723 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.659140 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.659144 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.659146 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.659411 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:24.659511 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:24.660042 (+ 531us) server_negotiation.cc:299] Negotiation successful
0808 15:51:24.660175 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 15:51:24.661501 32399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.647221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40000 (local address 127.8.39.124:34775)
0808 15:51:24.647617 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:24.647629 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:24.647857 (+ 228us) server_negotiation.cc:407] Connection header received
0808 15:51:24.648315 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:24.648335 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:24.648626 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:24.648824 (+ 198us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:24.649705 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.650921 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.652114 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.652676 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.652776 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:24.655743 (+ 2967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:24.655751 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:24.655766 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:24.655791 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:24.658072 (+ 2281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.658770 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.658779 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.658782 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.658966 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.659302 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.659307 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.659310 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.659808 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:24.660043 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:24.660230 (+ 187us) server_negotiation.cc:299] Negotiation successful
0808 15:51:24.660383 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":291,"spinlock_wait_cycles":1280,"thread_start_us":163,"threads_started":1}
I20260808 15:51:24.661499 32397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.646520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.126:45533 (local address 127.0.0.1:53870)
0808 15:51:24.647176 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.647231 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 15:51:24.648310 (+ 1079us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:51:24.648767 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:51:24.648772 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:51:24.649140 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:51:24.649444 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:24.649458 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.650567 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.650572 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:24.651749 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:24.651760 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.652390 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.652394 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:24.652617 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:24.653779 (+ 1162us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:51:24.653799 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:51:24.656115 (+ 2316us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:51:24.658132 (+ 2017us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:24.658144 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:24.658156 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:24.658451 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:24.658817 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:24.658823 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:24.658828 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:24.658995 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:24.659520 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:51:24.659529 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:51:24.659792 (+ 263us) client_negotiation.cc:769] Sending connection context
0808 15:51:24.659963 (+ 171us) client_negotiation.cc:240] Negotiation successful
0808 15:51:24.660307 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"mutex_wait_us":1,"thread_start_us":290,"threads_started":1}
I20260808 15:51:24.663282 32319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.652449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:34775 (local address 127.0.0.1:40004)
0808 15:51:24.652673 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.652690 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:51:24.652778 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:51:24.653203 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:51:24.653206 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:51:24.653411 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:51:24.653531 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:24.653537 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.654563 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.654574 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:24.655504 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:24.655518 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.656210 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.656213 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:24.656315 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:24.656756 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:51:24.656777 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:51:24.658258 (+ 1481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:51:24.661531 (+ 3273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:24.661536 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:24.661540 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:24.661855 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:24.662181 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:24.662184 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:24.662185 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:24.662290 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:24.662761 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:51:24.662764 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:51:24.662869 (+ 105us) client_negotiation.cc:769] Sending connection context
0808 15:51:24.662953 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 15:51:24.663102 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141}
I20260808 15:51:24.663341 32395 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.125" port: 37621 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:51:24.663864 32400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.652613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40004 (local address 127.8.39.124:34775)
0808 15:51:24.652982 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:24.652990 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:24.653001 (+ 11us) server_negotiation.cc:407] Connection header received
0808 15:51:24.653030 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:24.653031 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:24.653064 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:24.653164 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:24.653653 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.654435 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.655704 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.656074 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.656204 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:24.658404 (+ 2200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:24.658410 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:24.658412 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:24.658452 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:24.661398 (+ 2946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.661951 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.661957 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.661958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.662051 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.662398 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.662402 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.662404 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.662612 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:24.663470 (+ 858us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:24.663554 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 15:51:24.663667 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"spinlock_wait_cycles":3968,"thread_start_us":130,"threads_started":1}
I20260808 15:51:24.667146 32316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e3537dd119a4bdbacd86073f833a337: Bootstrap starting.
Aug 08 15:51:24 dist-test-slave-8tdl krb5kdc[32144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204284, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.124@KRBTEST.COM for kudu/127.8.39.125@KRBTEST.COM
Aug 08 15:51:24 dist-test-slave-8tdl krb5kdc[32144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204283, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.126@KRBTEST.COM
I20260808 15:51:24.670230 32316 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e3537dd119a4bdbacd86073f833a337: Neither blocks nor log segments found. Creating new log.
I20260808 15:51:24.671316 32316 log.cc:824] T 00000000000000000000000000000000 P 5e3537dd119a4bdbacd86073f833a337: Log is configured to *not* fsync() on all Append() calls
I20260808 15:51:24.673357 32315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.664112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40744 (local address 127.8.39.125:37621)
0808 15:51:24.664565 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:24.664570 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:24.664583 (+ 13us) server_negotiation.cc:407] Connection header received
0808 15:51:24.664623 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:24.664627 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:24.664671 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:24.664755 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:24.665318 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.666082 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.667105 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.667389 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.667507 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:24.669639 (+ 2132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:24.669642 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:24.669645 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:24.669670 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:24.671381 (+ 1711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.671978 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.671983 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.671986 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.672073 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.672409 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.672412 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.672414 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.672647 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:24.672766 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:24.673077 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 15:51:24.673202 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372}
I20260808 15:51:24.673406 32397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.663815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.125:37621 (local address 127.0.0.1:40744)
0808 15:51:24.664039 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.664053 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:51:24.664124 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:51:24.664958 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:51:24.664960 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:51:24.665105 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:51:24.665197 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:24.665202 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.666201 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.666204 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:24.666971 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:24.666981 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.667506 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.667509 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:24.667650 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:24.668170 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:51:24.668190 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:51:24.669489 (+ 1299us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:51:24.671544 (+ 2055us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:24.671549 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:24.671553 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:24.671847 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:24.672200 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:24.672206 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:24.672211 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:24.672314 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:24.672756 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:51:24.672759 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:51:24.672868 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 15:51:24.672998 (+ 130us) client_negotiation.cc:240] Negotiation successful
0808 15:51:24.673174 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153}
I20260808 15:51:24.673988 32316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e3537dd119a4bdbacd86073f833a337: No bootstrap required, opened a new log
I20260808 15:51:24.674144 32395 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:51:24.674782 32236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.664476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53874 (local address 127.8.39.126:45533)
0808 15:51:24.664596 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:24.664602 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:24.664613 (+ 11us) server_negotiation.cc:407] Connection header received
0808 15:51:24.664644 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:24.664646 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:24.664686 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:24.664763 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:24.665543 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.666261 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.667197 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.667499 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.667600 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:24.670656 (+ 3056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:24.670660 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:24.670662 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:24.670727 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:24.672378 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.672861 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.672865 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.672866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.672973 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.673374 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.673378 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.673380 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.673623 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:24.673833 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:24.674451 (+ 618us) server_negotiation.cc:299] Negotiation successful
0808 15:51:24.674603 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 15:51:24.678396 32316 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5e3537dd119a4bdbacd86073f833a337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db508334df204518ad7a4dfab034ac5c" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45533 } } peers { permanent_uuid: "5e3537dd119a4bdbacd86073f833a337" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 37621 } } peers { permanent_uuid: "df0de98b9ded4b2a8b2c2fd9285634f9" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } }
I20260808 15:51:24.678711 32316 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5e3537dd119a4bdbacd86073f833a337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e3537dd119a4bdbacd86073f833a337, State: Initialized, Role: FOLLOWER
I20260808 15:51:24.679090 32316 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e3537dd119a4bdbacd86073f833a337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db508334df204518ad7a4dfab034ac5c" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45533 } } peers { permanent_uuid: "5e3537dd119a4bdbacd86073f833a337" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 37621 } } peers { permanent_uuid: "df0de98b9ded4b2a8b2c2fd9285634f9" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } }
I20260808 15:51:24.679695 32402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e3537dd119a4bdbacd86073f833a337 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db508334df204518ad7a4dfab034ac5c" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45533 } } peers { permanent_uuid: "5e3537dd119a4bdbacd86073f833a337" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 37621 } } peers { permanent_uuid: "df0de98b9ded4b2a8b2c2fd9285634f9" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } } }
I20260808 15:51:24.680305 32402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e3537dd119a4bdbacd86073f833a337 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:51:24.680806 32316 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5e3537dd119a4bdbacd86073f833a337 [sys.catalog]: configured and running, proceeding with master startup.
Aug 08 15:51:24 dist-test-slave-8tdl krb5kdc[32144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204283, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.39.125@KRBTEST.COM
Aug 08 15:51:24 dist-test-slave-8tdl krb5kdc[32144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204284, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.124@KRBTEST.COM for kudu/127.8.39.124@KRBTEST.COM
I20260808 15:51:24.686417 32315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.676174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40760 (local address 127.8.39.125:37621)
0808 15:51:24.676291 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:24.676294 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:24.676306 (+ 12us) server_negotiation.cc:407] Connection header received
0808 15:51:24.676403 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:24.676405 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:24.676442 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:24.676503 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:24.677287 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.677777 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.678884 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.679217 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.679300 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:24.682619 (+ 3319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:24.682624 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:24.682629 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:24.682665 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:24.684389 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.684916 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.684921 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.684926 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.685020 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.685348 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.685351 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.685353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.685584 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:24.685734 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:24.686124 (+ 390us) server_negotiation.cc:299] Negotiation successful
0808 15:51:24.686256 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260808 15:51:24.687125 32413 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5e3537dd119a4bdbacd86073f833a337: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:51:24.687207 32413 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:51:24.687788 32397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.674637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:34775 (local address 127.0.0.1:40020)
0808 15:51:24.675272 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.675286 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:51:24.675361 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:51:24.679105 (+ 3744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:51:24.679108 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:51:24.679325 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:51:24.679425 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:24.679432 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.680540 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.680544 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:24.681155 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:24.681165 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.681655 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.681658 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:24.681751 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:24.682338 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:51:24.682351 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:51:24.683928 (+ 1577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:51:24.685896 (+ 1968us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:24.685899 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:24.685900 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:24.686170 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:24.686442 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:24.686445 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:24.686447 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:24.686616 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:24.687194 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:51:24.687197 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:51:24.687298 (+ 101us) client_negotiation.cc:769] Sending connection context
0808 15:51:24.687391 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 15:51:24.687556 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550}
I20260808 15:51:24.688277 32400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.674930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40020 (local address 127.8.39.124:34775)
0808 15:51:24.678869 (+ 3939us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:24.678875 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:24.678892 (+ 17us) server_negotiation.cc:407] Connection header received
0808 15:51:24.678941 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:24.678945 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:24.678986 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:24.679093 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:24.679587 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.680430 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.681273 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.681530 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.681655 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:24.684089 (+ 2434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:24.684093 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:24.684095 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:24.684119 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:24.685776 (+ 1657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.686280 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.686283 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.686285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.686358 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.686760 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.686762 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.686764 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.687057 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:24.687153 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:24.688015 (+ 862us) server_negotiation.cc:299] Negotiation successful
0808 15:51:24.688132 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3840}
I20260808 15:51:24.686143 32239 master_runner.cc:186] Error getting master registration for 127.8.39.126:45533: OK, instance_id { permanent_uuid: "db508334df204518ad7a4dfab034ac5c" instance_seqno: 1786204284151401 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 15:51:24.690480 32239 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 15:51:24.691143 32395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df0de98b9ded4b2a8b2c2fd9285634f9: Bootstrap starting.
I20260808 15:51:24.693962 32395 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df0de98b9ded4b2a8b2c2fd9285634f9: Neither blocks nor log segments found. Creating new log.
I20260808 15:51:24.694204 8349 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:51:24.694947 32395 log.cc:824] T 00000000000000000000000000000000 P df0de98b9ded4b2a8b2c2fd9285634f9: Log is configured to *not* fsync() on all Append() calls
I20260808 15:51:24.695604 32204 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "db508334df204518ad7a4dfab034ac5c"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53874
I20260808 15:51:24.697400 32395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df0de98b9ded4b2a8b2c2fd9285634f9: No bootstrap required, opened a new log
I20260808 15:51:24.700519 32395 raft_consensus.cc:348] T 00000000000000000000000000000000 P df0de98b9ded4b2a8b2c2fd9285634f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db508334df204518ad7a4dfab034ac5c" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45533 } } peers { permanent_uuid: "5e3537dd119a4bdbacd86073f833a337" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 37621 } } peers { permanent_uuid: "df0de98b9ded4b2a8b2c2fd9285634f9" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } }
I20260808 15:51:24.700762 32395 raft_consensus.cc:729] T 00000000000000000000000000000000 P df0de98b9ded4b2a8b2c2fd9285634f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df0de98b9ded4b2a8b2c2fd9285634f9, State: Initialized, Role: FOLLOWER
I20260808 15:51:24.701109 32395 consensus_queue.cc:260] T 00000000000000000000000000000000 P df0de98b9ded4b2a8b2c2fd9285634f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db508334df204518ad7a4dfab034ac5c" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45533 } } peers { permanent_uuid: "5e3537dd119a4bdbacd86073f833a337" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 37621 } } peers { permanent_uuid: "df0de98b9ded4b2a8b2c2fd9285634f9" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } }
I20260808 15:51:24.701619 32416 sys_catalog.cc:455] T 00000000000000000000000000000000 P df0de98b9ded4b2a8b2c2fd9285634f9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db508334df204518ad7a4dfab034ac5c" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45533 } } peers { permanent_uuid: "5e3537dd119a4bdbacd86073f833a337" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 37621 } } peers { permanent_uuid: "df0de98b9ded4b2a8b2c2fd9285634f9" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } } }
I20260808 15:51:24.701752 32416 sys_catalog.cc:458] T 00000000000000000000000000000000 P df0de98b9ded4b2a8b2c2fd9285634f9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:51:24.702447 32395 sys_catalog.cc:564] T 00000000000000000000000000000000 P df0de98b9ded4b2a8b2c2fd9285634f9 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 15:51:24.708597 32428 catalog_manager.cc:1558] T 00000000000000000000000000000000 P df0de98b9ded4b2a8b2c2fd9285634f9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:51:24.708688 32428 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:51:24.706780 32322 master_runner.cc:186] Error getting master registration for 127.8.39.126:45533: OK, instance_id { permanent_uuid: "db508334df204518ad7a4dfab034ac5c" instance_seqno: 1786204284151401 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 15:51:24.710139 32322 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 15:51:24.795619 32232 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } attempt: 4
Aug 08 15:51:24 dist-test-slave-8tdl krb5kdc[32144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786204284, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.39.126@KRBTEST.COM for kudu/127.8.39.124@KRBTEST.COM
I20260808 15:51:24.806248 32400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.796444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40028 (local address 127.8.39.124:34775)
0808 15:51:24.796590 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:24.796595 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:24.796658 (+ 63us) server_negotiation.cc:407] Connection header received
0808 15:51:24.796814 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:24.796818 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:24.796873 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:24.796979 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:24.797549 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.798325 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.799460 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.799804 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.799910 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:24.802490 (+ 2580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:24.802494 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:24.802497 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:24.802549 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:24.804350 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.804899 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.804904 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.804906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.805006 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.805319 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.805323 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.805325 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.805584 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:24.805678 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:24.805960 (+ 282us) server_negotiation.cc:299] Negotiation successful
0808 15:51:24.806086 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 15:51:24.806248 32235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.796349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.39.124:34775 (local address 127.0.0.1:40028)
0808 15:51:24.796584 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0808 15:51:24.796601 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:51:24.796712 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:51:24.797022 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:51:24.797025 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:51:24.797288 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:51:24.797422 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:24.797429 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.798469 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.798473 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:24.799331 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:51:24.799345 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.799934 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.799940 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:51:24.800062 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:24.800648 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:51:24.800663 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:51:24.802319 (+ 1656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:51:24.804520 (+ 2201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:24.804523 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:24.804525 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:24.804778 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:24.805112 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:51:24.805115 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:51:24.805117 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:51:24.805216 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:51:24.805683 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:51:24.805687 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:51:24.805796 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 15:51:24.805907 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 15:51:24.806066 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147}
I20260808 15:51:24.810164 32232 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c: Bootstrap starting.
I20260808 15:51:24.813158 32232 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c: Neither blocks nor log segments found. Creating new log.
I20260808 15:51:24.814059 32232 log.cc:824] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c: Log is configured to *not* fsync() on all Append() calls
I20260808 15:51:24.816488 32232 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c: No bootstrap required, opened a new log
I20260808 15:51:24.819748 32232 raft_consensus.cc:348] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db508334df204518ad7a4dfab034ac5c" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45533 } } peers { permanent_uuid: "5e3537dd119a4bdbacd86073f833a337" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 37621 } } peers { permanent_uuid: "df0de98b9ded4b2a8b2c2fd9285634f9" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } }
I20260808 15:51:24.820083 32232 raft_consensus.cc:729] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db508334df204518ad7a4dfab034ac5c, State: Initialized, Role: FOLLOWER
I20260808 15:51:24.820469 32232 consensus_queue.cc:260] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db508334df204518ad7a4dfab034ac5c" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45533 } } peers { permanent_uuid: "5e3537dd119a4bdbacd86073f833a337" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 37621 } } peers { permanent_uuid: "df0de98b9ded4b2a8b2c2fd9285634f9" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } }
I20260808 15:51:24.821228 32431 sys_catalog.cc:455] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db508334df204518ad7a4dfab034ac5c" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45533 } } peers { permanent_uuid: "5e3537dd119a4bdbacd86073f833a337" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 37621 } } peers { permanent_uuid: "df0de98b9ded4b2a8b2c2fd9285634f9" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } } }
I20260808 15:51:24.821447 32431 sys_catalog.cc:458] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:51:24.822096 32232 sys_catalog.cc:564] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:51:24.822189 32204 raft_consensus.cc:482] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 15:51:24.822304 32204 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:51:24.823827 32204 raft_consensus.cc:504] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db508334df204518ad7a4dfab034ac5c" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45533 } } peers { permanent_uuid: "5e3537dd119a4bdbacd86073f833a337" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 37621 } } peers { permanent_uuid: "df0de98b9ded4b2a8b2c2fd9285634f9" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } }
I20260808 15:51:24.824860 32204 leader_election.cc:288] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c [CANDIDATE]: Term 1 election: Requested vote from peers 5e3537dd119a4bdbacd86073f833a337 (127.8.39.125:37621), df0de98b9ded4b2a8b2c2fd9285634f9 (127.8.39.124:34775)
I20260808 15:51:24.825784 32367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "db508334df204518ad7a4dfab034ac5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "df0de98b9ded4b2a8b2c2fd9285634f9"
I20260808 15:51:24.826041 32367 raft_consensus.cc:3037] T 00000000000000000000000000000000 P df0de98b9ded4b2a8b2c2fd9285634f9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:51:24.825985 32289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "db508334df204518ad7a4dfab034ac5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "5e3537dd119a4bdbacd86073f833a337"
I20260808 15:51:24.826246 32289 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5e3537dd119a4bdbacd86073f833a337 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:51:24.827675 32289 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5e3537dd119a4bdbacd86073f833a337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db508334df204518ad7a4dfab034ac5c in term 1.
I20260808 15:51:24.827692 32367 raft_consensus.cc:2454] T 00000000000000000000000000000000 P df0de98b9ded4b2a8b2c2fd9285634f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db508334df204518ad7a4dfab034ac5c in term 1.
I20260808 15:51:24.830185 32177 leader_election.cc:302] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: db508334df204518ad7a4dfab034ac5c, df0de98b9ded4b2a8b2c2fd9285634f9; no voters:
W20260808 15:51:24.831246 32442 catalog_manager.cc:1558] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:51:24.831470 32442 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:51:24.833940 32431 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:51:24.838955 32431 raft_consensus.cc:686] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c [term 1 LEADER]: Becoming Leader. State: Replica: db508334df204518ad7a4dfab034ac5c, State: Running, Role: LEADER
I20260808 15:51:24.839349 32431 consensus_queue.cc:237] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db508334df204518ad7a4dfab034ac5c" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45533 } } peers { permanent_uuid: "5e3537dd119a4bdbacd86073f833a337" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 37621 } } peers { permanent_uuid: "df0de98b9ded4b2a8b2c2fd9285634f9" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } }
I20260808 15:51:24.841395 32431 sys_catalog.cc:455] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader db508334df204518ad7a4dfab034ac5c. Latest consensus state: current_term: 1 leader_uuid: "db508334df204518ad7a4dfab034ac5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db508334df204518ad7a4dfab034ac5c" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45533 } } peers { permanent_uuid: "5e3537dd119a4bdbacd86073f833a337" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 37621 } } peers { permanent_uuid: "df0de98b9ded4b2a8b2c2fd9285634f9" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } } }
I20260808 15:51:24.841542 32431 sys_catalog.cc:458] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:24.835906 32158 master_runner.cc:263] No leader master found from master db508334df204518ad7a4dfab034ac5c
I20260808 15:51:24.841799 32158 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 15:51:24.853325 32453 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:51:24.854465 32453 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:51:24.856217 32315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.834494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40776 (local address 127.8.39.125:37621)
0808 15:51:24.834623 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:24.834628 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:24.836610 (+ 1982us) server_negotiation.cc:407] Connection header received
0808 15:51:24.836810 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:24.836814 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:24.836869 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:24.836925 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:24.839536 (+ 2611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.840299 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.843545 (+ 3246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.843878 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.843970 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:24.848382 (+ 4412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:24.848386 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:24.848389 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:24.848424 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:24.850423 (+ 1999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.853408 (+ 2985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.853412 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.853414 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.853520 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.854329 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.854333 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.854335 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.854592 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:24.854760 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:24.855884 (+ 1124us) server_negotiation.cc:299] Negotiation successful
0808 15:51:24.856031 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 15:51:24.856843 32400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.835379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40042 (local address 127.8.39.124:34775)
0808 15:51:24.835491 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:24.835495 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:24.838226 (+ 2731us) server_negotiation.cc:407] Connection header received
0808 15:51:24.838409 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:24.838412 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:24.838461 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:24.838513 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:24.841524 (+ 3011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.842339 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.844779 (+ 2440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.845124 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.845210 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:24.851029 (+ 5819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:24.851033 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:24.851036 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:24.851080 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:24.852825 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.853878 (+ 1053us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.853882 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.853884 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.853977 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.855123 (+ 1146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.855127 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.855129 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.855360 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:24.855508 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:24.856564 (+ 1056us) server_negotiation.cc:299] Negotiation successful
0808 15:51:24.856693 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 15:51:24.862254 32236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:24.836079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53878 (local address 127.8.39.126:45533)
0808 15:51:24.836203 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:24.836208 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:24.843014 (+ 6806us) server_negotiation.cc:407] Connection header received
0808 15:51:24.843213 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:24.843217 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:24.843269 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:24.843322 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:24.844327 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.845102 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.850806 (+ 5704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:24.851195 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:24.851282 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:24.858536 (+ 7254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:51:24.858540 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:51:24.858543 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:51:24.858573 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:51:24.860337 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.860869 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.860873 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.860875 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.860970 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:51:24.861301 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:51:24.861304 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:51:24.861306 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:51:24.861524 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:51:24.861634 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:24.861947 (+ 313us) server_negotiation.cc:299] Negotiation successful
0808 15:51:24.862102 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 15:51:24.876995 32367 raft_consensus.cc:1261] T 00000000000000000000000000000000 P df0de98b9ded4b2a8b2c2fd9285634f9 [term 1 FOLLOWER]: Refusing update from remote peer db508334df204518ad7a4dfab034ac5c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:51:24.876986 32289 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5e3537dd119a4bdbacd86073f833a337 [term 1 FOLLOWER]: Refusing update from remote peer db508334df204518ad7a4dfab034ac5c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:51:24.878007 32451 consensus_queue.cc:1035] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "df0de98b9ded4b2a8b2c2fd9285634f9" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:51:24.880254 32451 consensus_queue.cc:1035] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e3537dd119a4bdbacd86073f833a337" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 15:51:24.880798 32345 tablet.cc:2369] T 00000000000000000000000000000000 P df0de98b9ded4b2a8b2c2fd9285634f9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:51:24.883481 32416 sys_catalog.cc:455] T 00000000000000000000000000000000 P df0de98b9ded4b2a8b2c2fd9285634f9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db508334df204518ad7a4dfab034ac5c. Latest consensus state: current_term: 1 leader_uuid: "db508334df204518ad7a4dfab034ac5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db508334df204518ad7a4dfab034ac5c" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45533 } } peers { permanent_uuid: "5e3537dd119a4bdbacd86073f833a337" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 37621 } } peers { permanent_uuid: "df0de98b9ded4b2a8b2c2fd9285634f9" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } } }
I20260808 15:51:24.883611 32416 sys_catalog.cc:458] T 00000000000000000000000000000000 P df0de98b9ded4b2a8b2c2fd9285634f9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:51:24.885275 32402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e3537dd119a4bdbacd86073f833a337 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db508334df204518ad7a4dfab034ac5c. Latest consensus state: current_term: 1 leader_uuid: "db508334df204518ad7a4dfab034ac5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db508334df204518ad7a4dfab034ac5c" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45533 } } peers { permanent_uuid: "5e3537dd119a4bdbacd86073f833a337" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 37621 } } peers { permanent_uuid: "df0de98b9ded4b2a8b2c2fd9285634f9" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } } }
I20260808 15:51:24.885421 32402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e3537dd119a4bdbacd86073f833a337 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:51:24.888324 32451 sys_catalog.cc:455] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "db508334df204518ad7a4dfab034ac5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db508334df204518ad7a4dfab034ac5c" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45533 } } peers { permanent_uuid: "5e3537dd119a4bdbacd86073f833a337" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 37621 } } peers { permanent_uuid: "df0de98b9ded4b2a8b2c2fd9285634f9" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } } }
I20260808 15:51:24.888474 32451 sys_catalog.cc:458] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:24.889601 32416 sys_catalog.cc:455] T 00000000000000000000000000000000 P df0de98b9ded4b2a8b2c2fd9285634f9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "db508334df204518ad7a4dfab034ac5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db508334df204518ad7a4dfab034ac5c" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45533 } } peers { permanent_uuid: "5e3537dd119a4bdbacd86073f833a337" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 37621 } } peers { permanent_uuid: "df0de98b9ded4b2a8b2c2fd9285634f9" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } } }
I20260808 15:51:24.889724 32416 sys_catalog.cc:458] T 00000000000000000000000000000000 P df0de98b9ded4b2a8b2c2fd9285634f9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:51:24.890244 32454 mvcc.cc:205] Tried to move back new op lower bound from 7316292750848012288 to 7316292750706036736. Current Snapshot: MvccSnapshot[applied={T|T < 7316292750848012288}]
I20260808 15:51:24.892568 32455 mvcc.cc:205] Tried to move back new op lower bound from 7316292750848012288 to 7316292750706036736. Current Snapshot: MvccSnapshot[applied={T|T < 7316292750848012288}]
W20260808 15:51:24.893945 32265 tablet.cc:2369] T 00000000000000000000000000000000 P 5e3537dd119a4bdbacd86073f833a337: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:51:24.895779 32453 catalog_manager.cc:1347] Generated new cluster ID: 3d57985f0a38443187b309ff3c1d2b67
I20260808 15:51:24.895733 32431 sys_catalog.cc:455] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "db508334df204518ad7a4dfab034ac5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db508334df204518ad7a4dfab034ac5c" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45533 } } peers { permanent_uuid: "5e3537dd119a4bdbacd86073f833a337" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 37621 } } peers { permanent_uuid: "df0de98b9ded4b2a8b2c2fd9285634f9" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } } }
I20260808 15:51:24.895861 32453 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:51:24.895861 32431 sys_catalog.cc:458] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c [sys.catalog]: This master's current role is: LEADER
I20260808 15:51:24.898524 32402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e3537dd119a4bdbacd86073f833a337 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "db508334df204518ad7a4dfab034ac5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db508334df204518ad7a4dfab034ac5c" member_type: VOTER last_known_addr { host: "127.8.39.126" port: 45533 } } peers { permanent_uuid: "5e3537dd119a4bdbacd86073f833a337" member_type: VOTER last_known_addr { host: "127.8.39.125" port: 37621 } } peers { permanent_uuid: "df0de98b9ded4b2a8b2c2fd9285634f9" member_type: VOTER last_known_addr { host: "127.8.39.124" port: 34775 } } }
I20260808 15:51:24.898650 32402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e3537dd119a4bdbacd86073f833a337 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:51:24.906786 32453 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:51:24.908017 32453 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:51:24.925410 32453 catalog_manager.cc:5868] T 00000000000000000000000000000000 P db508334df204518ad7a4dfab034ac5c: Generated new TSK 0
I20260808 15:51:24.926616 32453 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 15:51:24.958326 32315 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:51:24.956878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40790 (local address 127.8.39.125:37621)
0808 15:51:24.957013 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:24.957017 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:24.957242 (+ 225us) server_negotiation.cc:407] Connection header received
0808 15:51:24.957343 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:24.957347 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:24.957405 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:24.957491 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:24.958180 (+ 689us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40790: BlockingRecv error: recv got EOF from 127.0.0.1:40790 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260808 15:51:24.958382 32236 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:51:24.956821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53892 (local address 127.8.39.126:45533)
0808 15:51:24.956942 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:24.956947 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:24.957161 (+ 214us) server_negotiation.cc:407] Connection header received
0808 15:51:24.957350 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:24.957354 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:24.957413 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:24.957473 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:24.958215 (+ 742us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53892: BlockingRecv error: recv got EOF from 127.0.0.1:53892 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260808 15:51:24.958597 32400 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:51:24.956459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40052 (local address 127.8.39.124:34775)
0808 15:51:24.956611 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:24.956616 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:24.957542 (+ 926us) server_negotiation.cc:407] Connection header received
0808 15:51:24.957729 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:24.957735 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:24.957797 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:24.957858 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:24.958463 (+ 605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40052: BlockingRecv error: recv got EOF from 127.0.0.1:40052 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260808 15:51:24.961992 32315 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:51:24.960910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40796 (local address 127.8.39.125:37621)
0808 15:51:24.961044 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:24.961049 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:24.961190 (+ 141us) server_negotiation.cc:407] Connection header received
0808 15:51:24.961317 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:24.961320 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:24.961398 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:24.961485 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:24.961900 (+ 415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40796: BlockingRecv error: recv got EOF from 127.0.0.1:40796 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260808 15:51:24.965898 32315 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:51:24.965027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40810 (local address 127.8.39.125:37621)
0808 15:51:24.965158 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:24.965161 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:24.965173 (+ 12us) server_negotiation.cc:407] Connection header received
0808 15:51:24.965220 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:24.965222 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:24.965262 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:24.965358 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:24.965799 (+ 441us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40810: BlockingRecv error: recv got EOF from 127.0.0.1:40810 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260808 15:51:24.972396 32315 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:51:24.971108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40824 (local address 127.8.39.125:37621)
0808 15:51:24.971236 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:24.971239 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:24.971476 (+ 237us) server_negotiation.cc:407] Connection header received
0808 15:51:24.971645 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:24.971649 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:24.971707 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:24.971797 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:24.972255 (+ 458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40824: BlockingRecv error: recv got EOF from 127.0.0.1:40824 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260808 15:51:24.979908 32315 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:51:24.978586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40832 (local address 127.8.39.125:37621)
0808 15:51:24.978808 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:24.978813 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:24.978965 (+ 152us) server_negotiation.cc:407] Connection header received
0808 15:51:24.979107 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:24.979110 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:24.979162 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:24.979238 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:24.979778 (+ 540us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40832: BlockingRecv error: recv got EOF from 127.0.0.1:40832 (error 108)
Metrics: {"server-negotiator.queue_time_us":135}
W20260808 15:51:24.991629 32315 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:51:24.990277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40838 (local address 127.8.39.125:37621)
0808 15:51:24.990436 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:24.990443 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:24.990650 (+ 207us) server_negotiation.cc:407] Connection header received
0808 15:51:24.990824 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:24.990826 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:24.990878 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:24.990952 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:24.991486 (+ 534us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40838: BlockingRecv error: recv got EOF from 127.0.0.1:40838 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260808 15:51:25.011395 32315 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:51:25.010191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40846 (local address 127.8.39.125:37621)
0808 15:51:25.010337 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:25.010341 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:25.010485 (+ 144us) server_negotiation.cc:407] Connection header received
0808 15:51:25.010614 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:25.010617 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:25.010703 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:25.010802 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:25.011271 (+ 469us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40846: BlockingRecv error: recv got EOF from 127.0.0.1:40846 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260808 15:51:25.047084 32315 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:51:25.045772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40854 (local address 127.8.39.125:37621)
0808 15:51:25.045972 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:25.045976 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:25.046013 (+ 37us) server_negotiation.cc:407] Connection header received
0808 15:51:25.046241 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:25.046244 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:25.046304 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:25.046392 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:25.046920 (+ 528us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40854: BlockingRecv error: recv got EOF from 127.0.0.1:40854 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
W20260808 15:51:25.114435 32315 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:51:25.113296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40870 (local address 127.8.39.125:37621)
0808 15:51:25.113524 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:25.113528 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:25.113547 (+ 19us) server_negotiation.cc:407] Connection header received
0808 15:51:25.113683 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:25.113685 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:25.113735 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:25.113809 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:25.114304 (+ 495us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40870: BlockingRecv error: recv got EOF from 127.0.0.1:40870 (error 108)
Metrics: {"server-negotiator.queue_time_us":136}
W20260808 15:51:25.246340 32315 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:51:25.244873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40886 (local address 127.8.39.125:37621)
0808 15:51:25.245066 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:25.245072 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:25.245351 (+ 279us) server_negotiation.cc:407] Connection header received
0808 15:51:25.245547 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:25.245557 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:25.245621 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:25.245702 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:25.246207 (+ 505us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40886: BlockingRecv error: recv got EOF from 127.0.0.1:40886 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
W20260808 15:51:25.506165 32315 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:51:25.504785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40892 (local address 127.8.39.125:37621)
0808 15:51:25.504955 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:25.504959 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:25.505023 (+ 64us) server_negotiation.cc:407] Connection header received
0808 15:51:25.505282 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:25.505285 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:25.505376 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:25.505511 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:51:25.506032 (+ 521us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40892: BlockingRecv error: recv got EOF from 127.0.0.1:40892 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 15:51:25.688609 32413 catalog_manager.cc:1259] Loaded cluster ID: 3d57985f0a38443187b309ff3c1d2b67
I20260808 15:51:25.688705 32413 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5e3537dd119a4bdbacd86073f833a337: loading cluster ID for follower catalog manager: success
I20260808 15:51:25.690658 32413 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5e3537dd119a4bdbacd86073f833a337: acquiring CA information for follower catalog manager: success
I20260808 15:51:25.691990 32413 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5e3537dd119a4bdbacd86073f833a337: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 15:51:25.710052 32428 catalog_manager.cc:1259] Loaded cluster ID: 3d57985f0a38443187b309ff3c1d2b67
I20260808 15:51:25.710131 32428 catalog_manager.cc:1552] T 00000000000000000000000000000000 P df0de98b9ded4b2a8b2c2fd9285634f9: loading cluster ID for follower catalog manager: success
I20260808 15:51:25.711850 32428 catalog_manager.cc:1574] T 00000000000000000000000000000000 P df0de98b9ded4b2a8b2c2fd9285634f9: acquiring CA information for follower catalog manager: success
I20260808 15:51:25.713016 32428 catalog_manager.cc:1602] T 00000000000000000000000000000000 P df0de98b9ded4b2a8b2c2fd9285634f9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 15:51:26.025552 32532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:26.020612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40902 (local address 127.8.39.125:37621)
0808 15:51:26.020917 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:26.020921 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:26.020942 (+ 21us) server_negotiation.cc:407] Connection header received
0808 15:51:26.021176 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:26.021179 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:26.021317 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:26.021454 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:51:26.021794 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:26.022530 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:26.023775 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:26.024026 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:26.024164 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:26.024573 (+ 409us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:51:26.025065 (+ 492us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:51:26.025223 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:26.025294 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 15:51:26.025365 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":87,"threads_started":1}
I20260808 15:51:26.033926 32538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:26.029338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40060 (local address 127.8.39.124:34775)
0808 15:51:26.029623 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:26.029626 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:26.029643 (+ 17us) server_negotiation.cc:407] Connection header received
0808 15:51:26.029731 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:26.029733 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:26.029858 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:26.029965 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:51:26.030277 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:26.030990 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:26.032003 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:26.032242 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:26.032331 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:26.032803 (+ 472us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:51:26.033382 (+ 579us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:51:26.033491 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:26.033601 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 15:51:26.033695 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":104,"threads_started":1}
I20260808 15:51:26.041975 32532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:26.037801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40904 (local address 127.8.39.125:37621)
0808 15:51:26.037970 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:26.037974 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:26.038240 (+ 266us) server_negotiation.cc:407] Connection header received
0808 15:51:26.038379 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:26.038385 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:26.038456 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:26.038547 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:51:26.038834 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:26.039658 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:26.040680 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:26.040916 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:26.041036 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:26.041300 (+ 264us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:51:26.041399 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:51:26.041489 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:26.041670 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 15:51:26.041755 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 15:51:26.042583 32538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:26.037702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40070 (local address 127.8.39.124:34775)
0808 15:51:26.037832 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:26.037837 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:26.038435 (+ 598us) server_negotiation.cc:407] Connection header received
0808 15:51:26.038529 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:26.038532 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:26.038584 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:26.038666 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:51:26.039111 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:26.039842 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:26.041127 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:26.041410 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:26.041522 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:26.041983 (+ 461us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:51:26.042105 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:51:26.042190 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:26.042371 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 15:51:26.042432 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 15:51:26.043057 32546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:51:26.037850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53908 (local address 127.8.39.126:45533)
0808 15:51:26.038181 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0808 15:51:26.038188 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:51:26.038206 (+ 18us) server_negotiation.cc:407] Connection header received
0808 15:51:26.038321 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:51:26.038327 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:51:26.038579 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:51:26.038741 (+ 162us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:51:26.039023 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:26.039643 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:26.041125 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:51:26.041501 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:51:26.041624 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:51:26.042107 (+ 483us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:51:26.042522 (+ 415us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:51:26.042617 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 15:51:26.042800 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 15:51:26.042863 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":87,"threads_started":1}
I20260808 15:51:26.046541 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 32158
I20260808 15:51:26.056088 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 32239
I20260808 15:51:26.063690 8349 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCGl7YH/build/debug/bin/kudu with pid 32322
2026-08-08T15:51:26Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3338 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6748 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (299028 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST